Model Gallery

490 models from 1 repositories

Filter by type:

Filter by tags:

sage-a1.5-q4
Sage-A1.5 is a 35B mixture-of-experts model based on Qwen3.6 for scientific reasoning, coding, and tool use. This official Q4_K_M GGUF build uses llama.cpp and includes the vision projector.

Repository: localaiLicense: apache-2.0

sage-a1.5-q8
Sage-A1.5 is a 35B mixture-of-experts model based on Qwen3.6 for scientific reasoning, coding, and tool use. This official Q8_0 GGUF build uses llama.cpp and includes the vision projector.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q4
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q4_K_M GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q6
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q6_K GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q8
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q8_0 GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-defiance-iq4
Defiance combines HauhauCS's uncensored Qwen3.8-27B weights with a customized Turbo Brilliance chat template for reasoning and roleplay. This IQ4_XS GGUF build uses llama.cpp and the embedded template, with a 32,768-token context. Text input only; MTP is not enabled.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-defiance-q6
Defiance combines HauhauCS's uncensored Qwen3.8-27B weights with a customized Turbo Brilliance chat template for reasoning and roleplay. This Q6_K_P GGUF build uses llama.cpp and the embedded template, with a 32,768-token context. Text input only; MTP is not enabled.

Repository: localaiLicense: apache-2.0

humanizer-12b-bf16
Humanizer is a 12B Gemma 4 fine-tune for rewriting English and Chinese text. This unquantized BF16 GGUF build uses llama.cpp with an 8,192-token context. This entry uses the completions API with the publisher's exact rewriting prompt.

Repository: localaiLicense: apache-2.0

underdog-saluki-27b-1.0-abliterated
Kujira's abliterated adaptation of Underdog Saluki 27B 1.0 uses mixed IQ2 weights with an embedded MTP head. This text-only llama.cpp build uses ordinary decoding; the MTP variant enables speculative decoding.

Repository: localaiLicense: apache-2.0

underdog-saluki-27b-1.0-abliterated-mtp
Kujira's abliterated adaptation of Underdog Saluki 27B 1.0 uses mixed IQ2 weights with an embedded MTP head. This text-only llama.cpp build enables multi-token prediction with up to two draft tokens.

Repository: localaiLicense: apache-2.0

huihui-qwen3.8-flash-next-abliterated-v2-q4
Huihui's second abliterated Qwen3.8-Flash-Next release adjusts the abliteration without modifying the experts. This vision-language mixture-of-experts model uses the publisher's UD-Q4_K_XL GGUF and BF16 projector for text chat and image input through llama.cpp. The default context is 32,768 tokens. Model weights use the Qwen Community License 1.0.

Repository: localaiLicense: other

huihui-qwen3.8-flash-next-abliterated-v2-iq4
Huihui's second abliterated Qwen3.8-Flash-Next release adjusts the abliteration without modifying the experts. This vision-language mixture-of-experts model uses the publisher's UD-IQ4_XS GGUF and BF16 projector for text chat and image input through llama.cpp. The default context is 32,768 tokens. Model weights use the Qwen Community License 1.0.

Repository: localaiLicense: other

underdog-saluki-27b-1.0-mtp
Underdog Saluki 27B 1.0 with its mixed IQ2 main weights preserved and a Qwen3.8-27B MTP head added. This llama.cpp build enables multi-token prediction with up to two draft tokens and includes the F16 vision projector. The weights and projector total approximately 9.28 GB.

Repository: localaiLicense: apache-2.0

simplicio-27b-q4
Simplicio-27B is a Qwen3.8-27B fine-tune for code editing and software engineering. This Q4_K_M GGUF build uses llama.cpp and includes the F16 vision projector.

Repository: localaiLicense: apache-2.0

simplicio-27b-q8
Simplicio-27B is a Qwen3.8-27B fine-tune for code editing and software engineering. This Q8_0 GGUF build uses llama.cpp and includes the F16 vision projector.

Repository: localaiLicense: apache-2.0

ternary-bonsai-2-27b
Ternary Bonsai 2 27B (PrismML) is a 27B-class reasoning model with ternary transformer weights. This PTQ1_0 build packs the trits densely at 1.75 bits per weight (5.95 GB) and includes the Q8_0 vision projector. PTQ1_0 is a Prism-private GGUF type, so the entry uses the bonsai backend (PrismML's llama.cpp fork) instead of stock llama.cpp.

Repository: localaiLicense: apache-2.0

cyber-ornith-1.5-9b-obliterated
Cyber-Ornith 1.5 is a 9B Qwen3.5 fine-tune for security auditing, terminal tasks, and tool use. This importance-matrix Q4_K_M GGUF build uses llama.cpp with the embedded chat template for text chat.

Repository: localaiLicense: apache-2.0

cyber-ornith-1.5-9b-obliterated-q6
Cyber-Ornith 1.5 is a 9B Qwen3.5 fine-tune for security auditing, terminal tasks, and tool use. This importance-matrix Q6_K GGUF build uses llama.cpp with the embedded chat template for text chat.

Repository: localaiLicense: apache-2.0

qwopus3.8-27b-flash-v2
Qwopus3.8-27B-Flash-V2 is a new post-training release for reasoning and agent workloads. This Q4_K_M GGUF includes the F32 vision projector and uses llama.cpp's embedded chat template with MTP speculative decoding.

Repository: localaiLicense: apache-2.0

qwopus3.8-27b-flash-v2-q8
Qwopus3.8-27B-Flash-V2 is a new post-training release for reasoning and agent workloads. This Q8_0 GGUF includes the F32 vision projector and uses llama.cpp's embedded chat template with MTP speculative decoding.

Repository: localaiLicense: apache-2.0

qwopus3.8-27b-flash
Qwopus3.8-27B-Flash is a Qwen3.8-27B fine-tune for reasoning and agent workloads. This Q4_K_M GGUF includes the F32 vision projector and uses llama.cpp's embedded chat template with MTP speculative decoding. The publisher reports a known Python code indentation issue.

Repository: localaiLicense: apache-2.0

Page 1