How do you deal with context length degradation here?
replyThe harder questions will only arrive when the context is getting full.
If you have it question you for 1M tokens (aka the full length of the Wheel of Time series), I think your own context might get full before the LLMs.
reply