There was some work done on this a while back, during the FrankenMerge craze of 23'
replyI am working with TurboDerp to integrate this into the Exllama v3 format.
Wow, super interesting keywords. Are you a ML researcher? What kind of experiments do you do?
reply