I'm falling behind here! I still have yet to implement DeepSeek v2 (#16), and they've released a new model.
Release notes are here.
At this point, the plan is to implement it, but I can't test it, as that requires loading 671B parameters, which I don't currently have the personal capacity to run. All testing will be done on v2.
I'm falling behind here! I still have yet to implement DeepSeek v2 (#16), and they've released a new model.
Release notes are here.
At this point, the plan is to implement it, but I can't test it, as that requires loading 671B parameters, which I don't currently have the personal capacity to run. All testing will be done on v2.