I've been wanting Go to be used more in this space, its a simple yet strong language, so I'm thankful for your work!
One thing worries me:
Update the older code..
The old code was mainly based off the llama.cpp from back then right? And currently the project is facing issues with becoming too large to easily maintain.
My thoughts and worries are, that the old code is mimicking llama.cpp too much (even if older), and would cause more headaches down the line, be it maintenance difficulty or lack of flexibility.
If you've already thought of that, what plans do you have for the code update? I'd like to help contribute and learn more of the ins, rather than outs of running LLM models. But I 'd need to know the code design idea for this reborn project.
I've been wanting Go to be used more in this space, its a simple yet strong language, so I'm thankful for your work!
One thing worries me:
The old code was mainly based off the llama.cpp from back then right? And currently the project is facing issues with becoming too large to easily maintain.
My thoughts and worries are, that the old code is mimicking llama.cpp too much (even if older), and would cause more headaches down the line, be it maintenance difficulty or lack of flexibility.
If you've already thought of that, what plans do you have for the code update? I'd like to help contribute and learn more of the ins, rather than outs of running LLM models. But I 'd need to know the code design idea for this reborn project.