ggml-org/Qwen3.8-27B-GGUF
apache-2.0 12/12 files local @ 0669b98607d4
HF_ENDPOINT=https://huffingface.co \
python -c "from huggingface_hub import snapshot_download; snapshot_download('ggml-org/Qwen3.8-27B-GGUF')"Model card
Qwen3.8-27B
Run with https://llama.app
llama serve -hf ggml-org/Qwen3.8-27B-GGUF
Source models
TODOs
- add info
[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert
Files
| File | Size | Status |
|---|---|---|
| .gitattributes | 2 kB | huffed |
| .src_sha | 0 kB | huffed |
| Qwen3.8-27B-BF16.gguf | 53.8 GB | huffed |
| Qwen3.8-27B-Q4_K_M.gguf | 19.0 GB | huffed |
| Qwen3.8-27B-Q8_0.gguf | 28.6 GB | huffed |
| README.md | 0 kB | huffed |
| convert.log | 486 kB | huffed |
| mmproj-Qwen3.8-27B-BF16.gguf | 931.1 MB | huffed |
| mmproj-Qwen3.8-27B-Q8_0.gguf | 629.2 MB | huffed |
| mtp-Qwen3.8-27B-BF16.gguf | 5.9 GB | huffed |
| mtp-Qwen3.8-27B-Q4_0.gguf | 1.7 GB | huffed |
| mtp-Qwen3.8-27B-Q8_0.gguf | 3.2 GB | huffed |