upvote
Of course anecdotal but 2 months ago I tried to do that for a missing bolt in a popular scooter (roughly 7 years old, bought 2nd hand so didn't know exact specs). I fed it various images that I took + internet images. It found a bunch of local shops but always found the wrong part (but very similar looking). I double-checked everything multiple times, via multiple contexts, even different pre-prompts from various sources, and asking plenty of questions. We chatted in thinking mode for what felt like ages, and according to paragraphs explaining why it HAD to be the right one, multiple times, with evidence that it sometimes gladly generated in image form (often completely garbage imagery e.g. with half-drawn bolts extruding from multiple surfaces). Eventually it found something very plausible which I ordered. It was the wrong part.

I had to get someone on the phone to help me find and order the right part (which was on their website, for many years according to waybackmachien).

I love LLMs but it's still totally hit/miss what you get. I'd rather not give it write-access to my bank account just yet.

reply
Conversely, I did something similar, but I took a picture of the model number, copy/pasted the text from the image into a search engine, and that was that. Either way you're taking a picture and performing a manual step (query an LLM, query a search engine)

I would never trust an LLM to accurately identify and purchase something for me based on a picture, a prompt, and a prayer.

reply
It's simple, just tell it not to hallucinate.
reply