upvote
This comment is giving "100% tested virus free" on a free downloads site vibes.
reply
In-prompt "security" is not reliable. You can not tell if the LLM/agent actually followed your instructions or whether it fell for a prompt injection.
reply
Thanks! I wanted to add hugging face token field to speed up model download, but then I realised that people might not trust to give their tokens And yeah, local models are better for security, at least your conversation stay on the machine
reply
seems like a great little chrome extension or tool we could use to just quickly validate stuff like that.
reply
Has AI made you so lazy you can't even open up a terminal, copy-paste a URL, and type "review this for security issues"?
reply
Ridiculous question and implication. Having a utility for something you do over and over with the same steps is automation 101.
reply
This is Laziness in Larry Wall's "Three Virtues" sense. It's exactly the sort of labour-saving automation that belongs in a script/extension.
reply
I'm not being too lazy when I autofill to login from my password manager, am I?
reply
Please don't do this. I know you mean well, but if you think you're providing a service here, you're not. This is not the same as posting an archive.today link to a paywalled article. This is not actually contributing anything to the discussion. Anyone who wants an LLM review can do so themselves. You have no idea if this is good output or slop. Nobody else knows if you even actually sent this through an LLM or not.
reply
I trust them but it's immediately evident the instruction it gives to future bad actors: buy HN accounts, post false "security check passed" comments.

Is there a VirusTotal.com-but-LLM-analysis that folks could link to instead where we'd trust the prompts were sent and the responses were indeed received from the stated models? Hopefully run by someone with quite the budget and/or reputation.

reply
I disagree. I thought of it as a noble public service. But as with everything else on the internet buyer beware.
reply
Agree. I see it as informative to newcomers as to what they should do themselves.

This is how people learn.

reply
Right. Dude even included the prompt. Exemplary for this community I would hope.
reply
Someone could come into this post and leave a comment saying they're a security researcher, that they audited the codebase, and include a summary of their findings. And that person could be lying.

I think saying that it contributes nothing because a) someone could do it themselves, b) the output might be slop, and/or c) they could be lying, is a bit silly. Those things apply to basically everything posted on the internet.

Whether an LLM security review is actually valuable is an entirely different discussion.

reply
Sure, though I'd be more understanding of someone with little in the way of technical chops posting "here's my alleged LLM output" than someone saying "I'm a security researcher, looks great" when they've never linked any of their publications or anything. That's why I see this as a newer, slightly more dangerous spin on the old issue. (mitigation suggestion in my sibling comment)
reply
Mythos alone proves the future of cybersecurity and software is agentic, and if you don’t believe that, run it back in 2 years when you are fired for someone who does..

+1 at least he cited his sources lol

reply
Friend, you have upvote / downvote with which you can signal to a person the value of their comment. Pontification from a four month old account at that.. nah.
reply
What does their account age have to do with what they said?
reply
deleted
reply
deleted
reply
"Review this project" is that how you use LLMs lmao

Just toss GBs of file structure: "AI, do your work baby!"

I for one break things down much smaller into very specific tasks involving very particular text. Maybe I'm overdoing it lol.

For me, an AI security review would still take hours or days, it would hardly be a 1-shot prompt like this.

reply
Nah I asked the ai and I said it was fine :p
reply
Depends on the size of the repo, a few files and <~10,000 loc this prompt is probably fine, but as it grows it becomes less effective.
reply
If you have any LLM write code, you'll notice it breaks down at about ~1k lines. Anything under that - simple API endpoint, React component, is fine.

But it quickly loses fidelity as you load more into the context. The context window is supposed to be much larger, but in reality, it loses accuracy and fidelity the more you load in.

If I loaded 10k+ lines of code across files into a RAG db (since that's much too large for LLM context) - which is what the foundation of "an agent" is - I highly doubt that it would be very effective on its own. And it isn't IME, that's why so-called agentic coding isn't very good compared to an expert using an LLM manually, breaking it down into task-specific work.

reply