Hey! I'm very interested in this, however I've been having a lot of trouble trying to get an actual model to run. When trying models I've already downloaded (E.G: Qwen3.6 27b) the configurations were missing, or just not in the correct format. however when trying to redownload using the built-in feature, repositories with multiple model files fail to download. is there a way to choose one of the available quantizations provided?
example repository:
unsloth/Qwen3.6-27B-MTP-GGUF
Thank you and have a great day!
Hey! I'm very interested in this, however I've been having a lot of trouble trying to get an actual model to run. When trying models I've already downloaded (E.G: Qwen3.6 27b) the configurations were missing, or just not in the correct format. however when trying to redownload using the built-in feature, repositories with multiple model files fail to download. is there a way to choose one of the available quantizations provided?
example repository:
unsloth/Qwen3.6-27B-MTP-GGUF
Thank you and have a great day!