Hi @KingdalfGoodman 🤗
I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work on Arxiv and was wondering whether you would like to submit it to hf.co/papers to improve its discoverability. If you are one of the authors, you can submit it at https://huggingface.co/papers/submit.
The paper page lets people discuss about your paper and lets them find artifacts about it (your models for instance), you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.
I saw in your paper that you've achieved impressive results quantizing Qwen2.5-72B and Ministral models to 2-bit using BPDQ. These quantized checkpoints would be incredibly useful for the community, especially for researchers looking to run large models on consumer-grade GPUs like the RTX 3090.
I noticed the GitHub link in the paper (https://github.com/KingdalfGoodman/BPDQ) is currently unavailable. When you are ready to release, would you like to host the quantized model checkpoints you've produced on https://huggingface.co/models? Hosting on Hugging Face will give you more visibility and enable better discoverability. We can add tags in the model cards (like text-generation and quantization-specific metadata) so that people find the models easier and link them directly to the paper page.
If you're down, leaving a guide here. For the weights, people can easily use hf_hub_download to integrate them into their serving frameworks.
Let me know if you're interested or need any guidance :)
Kind regards,
Niels
Hi @KingdalfGoodman 🤗
I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work on Arxiv and was wondering whether you would like to submit it to hf.co/papers to improve its discoverability. If you are one of the authors, you can submit it at https://huggingface.co/papers/submit.
The paper page lets people discuss about your paper and lets them find artifacts about it (your models for instance), you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.
I saw in your paper that you've achieved impressive results quantizing Qwen2.5-72B and Ministral models to 2-bit using BPDQ. These quantized checkpoints would be incredibly useful for the community, especially for researchers looking to run large models on consumer-grade GPUs like the RTX 3090.
I noticed the GitHub link in the paper (https://github.com/KingdalfGoodman/BPDQ) is currently unavailable. When you are ready to release, would you like to host the quantized model checkpoints you've produced on https://huggingface.co/models? Hosting on Hugging Face will give you more visibility and enable better discoverability. We can add tags in the model cards (like
text-generationand quantization-specific metadata) so that people find the models easier and link them directly to the paper page.If you're down, leaving a guide here. For the weights, people can easily use hf_hub_download to integrate them into their serving frameworks.
Let me know if you're interested or need any guidance :)
Kind regards,
Niels