upvote

points

by pammf2 hours ago |
comments
upvoteby Barbing2 hours ago|
next
[-]
Or no memories or history.

Would be interesting if someone said “I spent $2.50 using llm-council with the three top SOTA models and think this reply makes sense: {paste}”

(But better “not sure, though after spending a few bucks on model APIs, perhaps {human-written analysis} is in the right direction”)

Also like you, I did think on the angry version “they have the same AI you do” isn’t likely to be right in the consumer space since their AI is ChatGPT (free version?!) and yours is Claude or something.

reply
upvoteby pammf1 hours ago|
parent|
next
[-]
Even with the same model results are different. I work in a startup where they went bonks with AI ~1 year ago. Every employee got a Claude account that I don’t even know what tier is (we just have what feels like unlimited tokens), they implemented infamous AI usage leaderboards, people were getting “you’re not using AI enough” feedback and all of that…

Over time, it was impressive to see how much the output of the same prompt would differ between us, and it seems to be heavily influenced by the role of the user. I.e. answers coming from the agent of a Data Engineer, a Backend Engineer and a Domain Researcher would not be the same at all. Some of us use harnessing tools, some not, but regardless it we saw differences.

So, for example, when a backend engineer would send a question to a data engineer, there was *some* added value even when it was a lazy copy & paste.

reply
upvoteby user_78321 hours ago|
parent|
prev|
[-]
You're giving too much credit to people. The folks who run an LLM council aren't the ones blindly copy pasting things.

There's responsible AI use (which I think you - and I, and many people here) do, and the "I don't care, I've outsourced my brain to OpenAI" type of people.

reply
upvoteby parasti1 hours ago|
prev|
[-]
Similar thoughts here. My gut tells me "if I wanted AI responses I would just ask AI", but in truth LLMs are not like Google Search. LLMs are more like a slot machine where you put your prompt in and out comes a combination of insights that are personalized to the inputs.
reply