upvote
I wouldn't use the word necessary.

IMO, we are probably talking about a 6x slow down (for typical english). You would need to be absolutely stupid not to implement some kind of optimisation along these lines.

Slower and maybe a little dumber; But it would work.

reply
Not sure about “dumber” - it may be better than SOTA models at identifying which days of the week contain the letter “d”.
reply