Filter by type:
Filter by tags:
sage-a1.5-q4
Sage-A1.5 is a 35B mixture-of-experts model based on Qwen3.6 for
scientific reasoning, coding, and tool use. This official Q4_K_M GGUF
build uses llama.cpp and includes the vision projector.
Repository: localaiLicense: apache-2.0
sage-a1.5-q8
Sage-A1.5 is a 35B mixture-of-experts model based on Qwen3.6 for
scientific reasoning, coding, and tool use. This official Q8_0 GGUF
build uses llama.cpp and includes the vision projector.
Repository: localaiLicense: apache-2.0
tess-4.5-27b-q4
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use.
This Q4_K_M GGUF build includes the F16 vision projector and uses
llama.cpp with the embedded chat template. Speculative decoding is disabled.
Repository: localaiLicense: apache-2.0
tess-4.5-27b-q6
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use.
This Q6_K GGUF build includes the F16 vision projector and uses
llama.cpp with the embedded chat template. Speculative decoding is disabled.
Repository: localaiLicense: apache-2.0
tess-4.5-27b-q8
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use.
This Q8_0 GGUF build includes the F16 vision projector and uses
llama.cpp with the embedded chat template. Speculative decoding is disabled.
Repository: localaiLicense: apache-2.0
ornith-1.5-122b-ud-q4-k-xl
Ornith 1.5 122B is a Qwen3.5 mixture-of-experts model for reasoning,
coding, and tool use. This UD-Q4_K_XL GGUF build includes the F16 vision
projector for image input and uses an 8,192-token default context.
Repository: localaiLicense: mit
ornith-1.5-122b-q8
Ornith 1.5 122B is a Qwen3.5 mixture-of-experts model for reasoning,
coding, and tool use. This Q8_0 GGUF build includes the F16 vision
projector for image input and uses an 8,192-token default context.
Repository: localaiLicense: mit
ternary-bonsai-2-2b
Ternary Bonsai 2 2B is a vision-language model derived from Qwen3.5-2B
with ternary transformer weights. This PQ2_0 build uses the Bonsai
backend and includes the Q8_0 vision projector. The three standard
packings contain the same weights in different storage layouts.
Repository: localaiLicense: apache-2.0
ternary-bonsai-2-2b-ptq1
Ternary Bonsai 2 2B is a vision-language model derived from Qwen3.5-2B
with ternary transformer weights. This PTQ1_0 build uses the Bonsai
backend and includes the Q8_0 vision projector. The three standard
packings contain the same weights in different storage layouts.
Repository: localaiLicense: apache-2.0
ternary-bonsai-2-2b-q2
Ternary Bonsai 2 2B is a vision-language model derived from Qwen3.5-2B
with ternary transformer weights. This Q2_0 build uses the Bonsai
backend and includes the Q8_0 vision projector. The three standard
packings contain the same weights in different storage layouts.
Repository: localaiLicense: apache-2.0
ternary-bonsai-2-9b
Ternary Bonsai 2 9B is a vision-language model derived from Qwen3.5-9B
with ternary transformer weights. This PQ2_0 build uses the Bonsai
backend and includes the Q8_0 vision projector. The three standard
packings contain the same weights in different storage layouts.
Repository: localaiLicense: apache-2.0
ternary-bonsai-2-9b-ptq1
Ternary Bonsai 2 9B is a vision-language model derived from Qwen3.5-9B
with ternary transformer weights. This PTQ1_0 build uses the Bonsai
backend and includes the Q8_0 vision projector. The three standard
packings contain the same weights in different storage layouts.
Repository: localaiLicense: apache-2.0
ternary-bonsai-2-9b-q2
Ternary Bonsai 2 9B is a vision-language model derived from Qwen3.5-9B
with ternary transformer weights. This Q2_0 build uses the Bonsai
backend and includes the Q8_0 vision projector. The three standard
packings contain the same weights in different storage layouts.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-imatrix-nvfp4-mtp
Qwen3.8-27B in cdiamond's iMatrix-calibrated mixed-precision NVFP4
build. Selected attention and feed-forward tensors retain higher
precision. Includes the F16 vision projector and enables the embedded
MTP draft head with one draft token per step.
Repository: localaiLicense: apache-2.0
qwen3.5-0.8b-artemis-q5
TurinTech Artemis Q5_K_M quantization of Qwen3.5 0.8B for text chat,
reasoning, and tool use. This text-only build omits the vision encoder
and MTP layer. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-0.8b-artemis-q4
TurinTech Artemis Q4_K_M quantization of Qwen3.5 0.8B for text chat,
reasoning, and tool use. This text-only build omits the vision encoder
and MTP layer. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
atomic-minicpm-v-4.7-35b-a3b-uncensored-q4
AtomicChat's abliterated MiniCPM-V 4.7 is a 35B mixture-of-experts model
with 3B active parameters for chat and image understanding. This
AD-Q4_K-IQ4_XS build includes all 11 weight shards and the F16 vision
projector, with the embedded chat template and a 32K-token default context.
Repository: localaiLicense: apache-2.0
atomic-minicpm-v-4.7-35b-a3b-uncensored-q6
AtomicChat's abliterated MiniCPM-V 4.7 is a 35B mixture-of-experts model
with 3B active parameters for chat and image understanding. This
AD-Q6_K build includes all 16 weight shards and the F16 vision
projector, with the embedded chat template and a 32K-token default context.
Repository: localaiLicense: apache-2.0
huihui-qwen3.8-flash-next-abliterated-v2-q4
Huihui's second abliterated Qwen3.8-Flash-Next release adjusts the
abliteration without modifying the experts. This vision-language
mixture-of-experts model uses the publisher's UD-Q4_K_XL GGUF
and BF16 projector for text chat and image input through llama.cpp.
The default context is 32,768 tokens. Model weights use the
Qwen Community License 1.0.
Repository: localaiLicense: other
huihui-qwen3.8-flash-next-abliterated-v2-iq4
Huihui's second abliterated Qwen3.8-Flash-Next release adjusts the
abliteration without modifying the experts. This vision-language
mixture-of-experts model uses the publisher's UD-IQ4_XS GGUF
and BF16 projector for text chat and image input through llama.cpp.
The default context is 32,768 tokens. Model weights use the
Qwen Community License 1.0.
Repository: localaiLicense: other
glm-5.3-flash-maya-s
GLM-5.3-Flash is a mixture-of-experts model for reasoning, coding, tool use, and vision. Maya-S v2 mixes IQ2_XXS and IQ2_S experts with Q6_K attention and shared experts.
Repository: localaiLicense: mit
Page 1