I’m currently using and so far it gives really good results for stuff I work on. It’s definitely my new main model I’ll keep using.
The only problem I have, is that after few prompts especially if they are more complex, the spark memory is completely eaten and token generations slows down to like 1/2 tokens/s.
Even if I interrupt it, then it never returns any memory so essentially I need to bring the ds4-server down and start again.
Initially I was using context 256K, now I’m on 131072.
Is there anything I can change to make it behave better?
thank you