Model Gallery

242 models from 1 repositories

Filter by type:

Filter by tags:

tess-4.5-27b-q4
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q4_K_M GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q6
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q6_K GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q8
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q8_0 GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-defiance-iq4
Defiance combines HauhauCS's uncensored Qwen3.8-27B weights with a customized Turbo Brilliance chat template for reasoning and roleplay. This IQ4_XS GGUF build uses llama.cpp and the embedded template, with a 32,768-token context. Text input only; MTP is not enabled.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-defiance-q6
Defiance combines HauhauCS's uncensored Qwen3.8-27B weights with a customized Turbo Brilliance chat template for reasoning and roleplay. This Q6_K_P GGUF build uses llama.cpp and the embedded template, with a 32,768-token context. Text input only; MTP is not enabled.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-imatrix-nvfp4-mtp
Qwen3.8-27B in cdiamond's iMatrix-calibrated mixed-precision NVFP4 build. Selected attention and feed-forward tensors retain higher precision. Includes the F16 vision projector and enables the embedded MTP draft head with one draft token per step.

Repository: localaiLicense: apache-2.0

underdog-saluki-27b-1.0-abliterated
Kujira's abliterated adaptation of Underdog Saluki 27B 1.0 uses mixed IQ2 weights with an embedded MTP head. This text-only llama.cpp build uses ordinary decoding; the MTP variant enables speculative decoding.

Repository: localaiLicense: apache-2.0

underdog-saluki-27b-1.0-abliterated-mtp
Kujira's abliterated adaptation of Underdog Saluki 27B 1.0 uses mixed IQ2 weights with an embedded MTP head. This text-only llama.cpp build enables multi-token prediction with up to two draft tokens.

Repository: localaiLicense: apache-2.0

underdog-saluki-27b-1.0-mtp
Underdog Saluki 27B 1.0 with its mixed IQ2 main weights preserved and a Qwen3.8-27B MTP head added. This llama.cpp build enables multi-token prediction with up to two draft tokens and includes the F16 vision projector. The weights and projector total approximately 9.28 GB.

Repository: localaiLicense: apache-2.0

simplicio-27b-q4
Simplicio-27B is a Qwen3.8-27B fine-tune for code editing and software engineering. This Q4_K_M GGUF build uses llama.cpp and includes the F16 vision projector.

Repository: localaiLicense: apache-2.0

simplicio-27b-q8
Simplicio-27B is a Qwen3.8-27B fine-tune for code editing and software engineering. This Q8_0 GGUF build uses llama.cpp and includes the F16 vision projector.

Repository: localaiLicense: apache-2.0

ternary-bonsai-2-27b
Ternary Bonsai 2 27B (PrismML) is a 27B-class reasoning model with ternary transformer weights. This PTQ1_0 build packs the trits densely at 1.75 bits per weight (5.95 GB) and includes the Q8_0 vision projector. PTQ1_0 is a Prism-private GGUF type, so the entry uses the bonsai backend (PrismML's llama.cpp fork) instead of stock llama.cpp.

Repository: localaiLicense: apache-2.0

swift-qwen3.8-27b
Swift-Qwen3.8-27B is UkisAI's reasoning-efficient fine-tune of Qwen3.8-27B. The publisher reports 58.3% fewer thinking tokens with less than 1% quality loss. This Q4_K_M GGUF includes the F16 vision projector and enables MTP speculative decoding. The weights use the Swift Open License v1.0.

Repository: localaiLicense: swift-open-license-1.0

qwopus3.8-27b-flash-v2
Qwopus3.8-27B-Flash-V2 is a new post-training release for reasoning and agent workloads. This Q4_K_M GGUF includes the F32 vision projector and uses llama.cpp's embedded chat template with MTP speculative decoding.

Repository: localaiLicense: apache-2.0

qwopus3.8-27b-flash-v2-q8
Qwopus3.8-27B-Flash-V2 is a new post-training release for reasoning and agent workloads. This Q8_0 GGUF includes the F32 vision projector and uses llama.cpp's embedded chat template with MTP speculative decoding.

Repository: localaiLicense: apache-2.0

qwopus3.8-27b-flash
Qwopus3.8-27B-Flash is a Qwen3.8-27B fine-tune for reasoning and agent workloads. This Q4_K_M GGUF includes the F32 vision projector and uses llama.cpp's embedded chat template with MTP speculative decoding. The publisher reports a known Python code indentation issue.

Repository: localaiLicense: apache-2.0

qwopus3.8-27b-flash-q8
Qwopus3.8-27B-Flash is a Qwen3.8-27B fine-tune for reasoning and agent workloads. This Q8_0 GGUF includes the F32 vision projector and uses llama.cpp's embedded chat template with MTP speculative decoding. The publisher reports a known Python code indentation issue.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-fable-5-coding-distilled
A 27B Qwen3.8 fine-tune for coding, debugging, and agentic reasoning. This Q4_K_M GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-fable-5-coding-distilled-q8
A 27B Qwen3.8 fine-tune for coding, debugging, and agentic reasoning. This Q8_0 GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector.

Repository: localaiLicense: apache-2.0

thinkingcap-qwen3.8-27b
ThinkingCap is a 27B Qwen3.8 fine-tune trained to reduce reasoning tokens, with text and image input. This Q4_K_M GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector. Licensed under PolyForm Small Business 1.0.0 with the publisher's personal-use grant; see the model license for permitted use.

Repository: localaiLicense: polyform-small-business-1.0.0

thinkingcap-qwen3.8-27b-q8
ThinkingCap is a 27B Qwen3.8 fine-tune trained to reduce reasoning tokens, with text and image input. This Q8_0 GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector. Licensed under PolyForm Small Business 1.0.0 with the publisher's personal-use grant; see the model license for permitted use.

Repository: localaiLicense: polyform-small-business-1.0.0

Page 1