In the rare occasion I use LLMs, I always add at least one of the following:
reply - Do not include opinions, just official documentation.
- Add all references you have used as a bibliography section at the end.
You have reinvented the search engine.
replyThat’s not meant to be glib; Google and friends are pretty trash now.
That’s the point. I only use LLMs if and only if Kagi can’t unearth the thing I’m looking for for a week or so.
replyThis means it finds me a single video which is not in a language which I know, or similar.
An LLM-vector-based search engine has the potential to be fantastic. No autocomplete - just make it search for similar vectors.
replyTo be fair, LLMs didn't really change this that much: Throughout my career, I've been generating docs that nobody is going to read, only because some process somewhere says "In order to get engineering approval to commence work, an Engineering Risks Document (ERD) must be produced." Everyone knows that nobody reads these, but someone with a rubber stamp checks to see that the doc exists and it looks sufficiently long, and then he stamps the stamp. LLMs just make producing this shit faster.
replyFor my medical notes assistant I had to set a global "write in a telegraphic, minimal style" because it was fluffing up every aspect of the notes. Nobody wants to read that BS and it's impossible to find information in a series of walls of text.
replyIt can also go the other way. It outputs a paragraph so full of telegraphic technobabble that it’s just unreadable, inventing new jargon every other sentence, using terminology invented in its thinking stream and never explained. And when it combines the two issues and it outputs 4 pages of technobabble, it gets just exhausting to read. Paradoxically, given that 2 years ago everyone was using LLMs to summarize web pages, their ability to condense text (including their own thought stream) is still lackluster.
I dream of some post-processing diffusion optimizer just condensing all of their slop away. Until then, I just tell it to _avoid_ telegraphic and newspaper-title speech and to output one or two paragraphs of prose only.
replyI wonder if reading cooking recipe sites in training contributed to this.
reply9 pages about how it felt to be a kid eating the dish, for 7 ingredients and a one line recipe.