Any idea why you only got 160TPS when the blog post claims 1000+TPS? That seems like the only draw to this model right now while capabilities are behind the frontier.
replyYou should be able to skip the OCR step by grabbing the actual text from the windows via OS APIs, unless your PDFs are scanned and not encoding digital text.
replyLots of them are scanned sadly! But I added an alt mode where a selection gets translated without the OCR step - though OCR is on the order of 100ms so I don’t mind it that much
reply