Model Gallery

437 models from 1 repositories

Filter by type:

Filter by tags:

sage-a1.5-q4
Sage-A1.5 is a 35B mixture-of-experts model based on Qwen3.6 for scientific reasoning, coding, and tool use. This official Q4_K_M GGUF build uses llama.cpp and includes the vision projector.

Repository: localaiLicense: apache-2.0

sage-a1.5-q8
Sage-A1.5 is a 35B mixture-of-experts model based on Qwen3.6 for scientific reasoning, coding, and tool use. This official Q8_0 GGUF build uses llama.cpp and includes the vision projector.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q4
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q4_K_M GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q6
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q6_K GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q8
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q8_0 GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

spark-x2.6-4b-q4
Spark-X2.6-4B is XHToken's 4B text model for conversation, reasoning, coding, and multilingual tasks. This build uses Q4_K_M GGUF weights, the embedded Jinja chat template, and a 32K-token default context.

Repository: localaiLicense: apache-2.0

spark-x2.6-4b-q8
Spark-X2.6-4B is XHToken's 4B text model for conversation, reasoning, coding, and multilingual tasks. This build uses Q8_0 GGUF weights, the embedded Jinja chat template, and a 32K-token default context.

Repository: localaiLicense: apache-2.0

ornith-1.5-122b-ud-q4-k-xl
Ornith 1.5 122B is a Qwen3.5 mixture-of-experts model for reasoning, coding, and tool use. This UD-Q4_K_XL GGUF build includes the F16 vision projector for image input and uses an 8,192-token default context.

Repository: localaiLicense: mit

ornith-1.5-122b-q8
Ornith 1.5 122B is a Qwen3.5 mixture-of-experts model for reasoning, coding, and tool use. This Q8_0 GGUF build includes the F16 vision projector for image input and uses an 8,192-token default context.

Repository: localaiLicense: mit

deepseek-v4.1-flash-1017
# DeepSeek-V4.1-Flash-1017 Technical Report 👁️ ## Introduction **DeepSeek-V4.1-Flash-1017** is a minor update to **DeepSeek-V4.1-Flash**, delivering substantial improvements across reasoning, coding, agentic tasks, and visual benchmarks. Alongside these gains, the model reduces task execution time and output length, enabling users to complete tasks faster and at lower cost and advancing the performance–cost Pareto frontier across multiple agent harnesses. *† denotes the text-only subset of HLE. We use the Claude Code harness for Terminal-Bench 4.0 and the Mini-SWE-V2 harness for DeepSWE v1.1.* ## Prompt Encoding This release does not include a Jinja-format chat template. The `encoding` folder contains a self-contained Python reference implementation (`encoding.py`) with test cases for multi-turn conversations, tool calling, thinking mode, numeric reasoning effort, mid-conversation system messages, and interleaved image content. ...

Repository: localaiLicense: mit

qwen3.8-27b-imatrix-nvfp4-mtp
Qwen3.8-27B in cdiamond's iMatrix-calibrated mixed-precision NVFP4 build. Selected attention and feed-forward tensors retain higher precision. Includes the F16 vision projector and enables the embedded MTP draft head with one draft token per step.

Repository: localaiLicense: apache-2.0

underdog-saluki-27b-1.0-abliterated
Kujira's abliterated adaptation of Underdog Saluki 27B 1.0 uses mixed IQ2 weights with an embedded MTP head. This text-only llama.cpp build uses ordinary decoding; the MTP variant enables speculative decoding.

Repository: localaiLicense: apache-2.0

glm-5.3-flash-maya-s
GLM-5.3-Flash is a mixture-of-experts model for reasoning, coding, tool use, and vision. Maya-S v2 mixes IQ2_XXS and IQ2_S experts with Q6_K attention and shared experts.

Repository: localaiLicense: mit

glm-5.3-flash-maya-s24
GLM-5.3-Flash is a mixture-of-experts model for reasoning, coding, tool use, and vision. Maya-S24 uses mixed 2-bit experts with Q4_K attention and shared experts.

Repository: localaiLicense: mit

glm-5.3-flash-maya-m
GLM-5.3-Flash is a mixture-of-experts model for reasoning, coding, tool use, and vision. Maya-M uses mixed 2-bit and 3-bit experts with Q6_K attention and shared experts.

Repository: localaiLicense: mit

glm-5.3-flash-maya-l
GLM-5.3-Flash is a mixture-of-experts model for reasoning, coding, tool use, and vision. Maya-L uses mixed 3-bit and 4-bit experts with higher precision in sensitive layers.

Repository: localaiLicense: mit

simplicio-27b-q4
Simplicio-27B is a Qwen3.8-27B fine-tune for code editing and software engineering. This Q4_K_M GGUF build uses llama.cpp and includes the F16 vision projector.

Repository: localaiLicense: apache-2.0

simplicio-27b-q8
Simplicio-27B is a Qwen3.8-27B fine-tune for code editing and software engineering. This Q8_0 GGUF build uses llama.cpp and includes the F16 vision projector.

Repository: localaiLicense: apache-2.0

swift-qwen3.8-27b
Swift-Qwen3.8-27B is UkisAI's reasoning-efficient fine-tune of Qwen3.8-27B. The publisher reports 58.3% fewer thinking tokens with less than 1% quality loss. This Q4_K_M GGUF includes the F16 vision projector and enables MTP speculative decoding. The weights use the Swift Open License v1.0.

Repository: localaiLicense: swift-open-license-1.0

cyber-ornith-1.5-9b-obliterated
Cyber-Ornith 1.5 is a 9B Qwen3.5 fine-tune for security auditing, terminal tasks, and tool use. This importance-matrix Q4_K_M GGUF build uses llama.cpp with the embedded chat template for text chat.

Repository: localaiLicense: apache-2.0

cyber-ornith-1.5-9b-obliterated-q6
Cyber-Ornith 1.5 is a 9B Qwen3.5 fine-tune for security auditing, terminal tasks, and tool use. This importance-matrix Q6_K GGUF build uses llama.cpp with the embedded chat template for text chat.

Repository: localaiLicense: apache-2.0

Page 1