Now that is insightful! The demo definitely fooled me and even the first repo requires you to train the model.
replyLip reading AI would be pretty big since privacy would probably go out the window.
but can't a decision model or some other model deduce "P" or "B" based on the context (i.e., previous words said)?
replyreminds me of tesla fsd v. waymo. may be a market for both? i.e., camera-only or camera + specific hardware.
Not well enough! You can get to 15-20%ish WER but going beyond that doesn't seem feasible with the info available from a camera, even with a great language model
replyWhy not a pencil in the ear or something you can put in a shirt pocket? Or even earbuds?
replyAny deaf/HoH person who has tried to do lipreading could have told you all of this too.
replyGood luck on the project!