I hope the irony of being concerned about hallucinations in a bible study app is not lost on you or others reading this!
replyPhilosophically, I don’t believe we should outsource the accuracy of scripture to any single entity (let alone a for profit secular one).
replySo it’s less about model choice and more about governance of scripture.
I will check out the link you sent for sure!
I was under the impression you were getting BOOK.CHAPTER.VERSE references from the model and then sourcing them from a ground truth db.
replyAnyways, impressive app! We haven't tackled such an ambitious project just for it being daunting.
It can still generate a wrong reference and select the wrong verse.
replyThat’s okay, IMO. Ultimately it’s the readers responsibility to apply their own intelligence. But the app should not misquote scripture itself.
replyAll models hallucinate. Everything in production with a model will too. It is not a "deal breaker"
reply> Is the difference between this and a frontier model that the scripture is guaranteed to be real?
replyflash is suitable only for a toy apps, not for production environments :)