upvote
> Chrome and anything electron based don't provide any accessibility information to the OS

Are we sure about this? At least on windows, NVDA works fine with chrome and any electron apps.

reply
> And no the solution here is not computer vision with an LLM.

Also, even if you hypothetically wanted to use computer vision with an LLM… what API is that LLM going to use to take screenshots and click on stuff?

reply