Model Gallery

341 models from 1 repositories

Filter by type:

Filter by tags:

sage-a1.5-q4
Sage-A1.5 is a 35B mixture-of-experts model based on Qwen3.6 for scientific reasoning, coding, and tool use. This official Q4_K_M GGUF build uses llama.cpp and includes the vision projector.

Repository: localaiLicense: apache-2.0

sage-a1.5-q8
Sage-A1.5 is a 35B mixture-of-experts model based on Qwen3.6 for scientific reasoning, coding, and tool use. This official Q8_0 GGUF build uses llama.cpp and includes the vision projector.

Repository: localaiLicense: apache-2.0

lfm2.5-24b-a2b-turbo-brilliance-iq4-xs
DavidAU's Turbo Brilliance build of LFM2.5-24B-A2B, a text-only reasoning model with 24B total parameters and 2.45B active parameters. This entry uses the IQ4_XS GGUF quantization and the embedded Turbo Brilliance chat template for multilingual chat and tool use.

Repository: localaiLicense: other

lfm2.5-24b-a2b-turbo-brilliance-q8
DavidAU's Turbo Brilliance build of LFM2.5-24B-A2B, a text-only reasoning model with 24B total parameters and 2.45B active parameters. This entry uses the Q8_0 MAX GGUF quantization and the embedded Turbo Brilliance chat template for multilingual chat and tool use.

Repository: localaiLicense: other

tess-4.5-27b-q4
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q4_K_M GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q6
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q6_K GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

tess-4.5-27b-q8
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use. This Q8_0 GGUF build includes the F16 vision projector and uses llama.cpp with the embedded chat template. Speculative decoding is disabled.

Repository: localaiLicense: apache-2.0

ornith-1.5-122b-ud-q4-k-xl
Ornith 1.5 122B is a Qwen3.5 mixture-of-experts model for reasoning, coding, and tool use. This UD-Q4_K_XL GGUF build includes the F16 vision projector for image input and uses an 8,192-token default context.

Repository: localaiLicense: mit

ornith-1.5-122b-q8
Ornith 1.5 122B is a Qwen3.5 mixture-of-experts model for reasoning, coding, and tool use. This Q8_0 GGUF build includes the F16 vision projector for image input and uses an 8,192-token default context.

Repository: localaiLicense: mit

deepseek-v4.1-flash-1017
# DeepSeek-V4.1-Flash-1017 Technical Report 👁️ ## Introduction **DeepSeek-V4.1-Flash-1017** is a minor update to **DeepSeek-V4.1-Flash**, delivering substantial improvements across reasoning, coding, agentic tasks, and visual benchmarks. Alongside these gains, the model reduces task execution time and output length, enabling users to complete tasks faster and at lower cost and advancing the performance–cost Pareto frontier across multiple agent harnesses. *† denotes the text-only subset of HLE. We use the Claude Code harness for Terminal-Bench 4.0 and the Mini-SWE-V2 harness for DeepSWE v1.1.* ## Prompt Encoding This release does not include a Jinja-format chat template. The `encoding` folder contains a self-contained Python reference implementation (`encoding.py`) with test cases for multi-turn conversations, tool calling, thinking mode, numeric reasoning effort, mid-conversation system messages, and interleaved image content. ...

Repository: localaiLicense: mit

lfm2.5-24b-a2b-ud-q4
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total parameters and 2.45B active parameters for multilingual chat and tool use. This entry uses Unsloth's dynamic UD-Q4_K_XL GGUF quantization.

Repository: localaiLicense: other

lfm2.5-24b-a2b-ud-q6
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total parameters and 2.45B active parameters for multilingual chat and tool use. This entry uses Unsloth's dynamic UD-Q6_K_XL GGUF quantization.

Repository: localaiLicense: other

qwen3.8-27b-imatrix-nvfp4-mtp
Qwen3.8-27B in cdiamond's iMatrix-calibrated mixed-precision NVFP4 build. Selected attention and feed-forward tensors retain higher precision. Includes the F16 vision projector and enables the embedded MTP draft head with one draft token per step.

Repository: localaiLicense: apache-2.0

qwen3.5-0.8b-artemis-q5
TurinTech Artemis Q5_K_M quantization of Qwen3.5 0.8B for text chat, reasoning, and tool use. This text-only build omits the vision encoder and MTP layer. Uses the embedded chat template and an 8192-token context.

Repository: localaiLicense: apache-2.0

qwen3.5-0.8b-artemis-q4
TurinTech Artemis Q4_K_M quantization of Qwen3.5 0.8B for text chat, reasoning, and tool use. This text-only build omits the vision encoder and MTP layer. Uses the embedded chat template and an 8192-token context.

Repository: localaiLicense: apache-2.0

diplodocus-preview-q4
Diplodocus preview 4 is OsaurusAI's K2 Horizon 7B fine-tune for documents, spreadsheets, and tool-assisted tasks. This Q4_K_M GGUF build uses the embedded chat template and enables reasoning by default. Applications must provide the tools; the model download does not include workspace tools.

Repository: localaiLicense: apache-2.0

diplodocus-preview-q6
Diplodocus preview 4 is OsaurusAI's K2 Horizon 7B fine-tune for documents, spreadsheets, and tool-assisted tasks. This Q6_K GGUF build uses the embedded chat template and enables reasoning by default. Applications must provide the tools; the model download does not include workspace tools.

Repository: localaiLicense: apache-2.0

diplodocus-preview-q8
Diplodocus preview 4 is OsaurusAI's K2 Horizon 7B fine-tune for documents, spreadsheets, and tool-assisted tasks. This Q8_0 GGUF build uses the embedded chat template and enables reasoning by default. Applications must provide the tools; the model download does not include workspace tools.

Repository: localaiLicense: apache-2.0

atomic-lfm2.5-24b-a2b-uncensored
AtomicChat's LFM2.5-24B-A2B derivative reduces refusal behavior in the original weights. This text-only mixture-of-experts model has 24B total parameters and supports multilingual reasoning and tool use. This entry uses the AD-Q4_K_M GGUF build with the edits baked in.

Repository: localaiLicense: other

atomic-lfm2.5-24b-a2b-uncensored-q6
AtomicChat's LFM2.5-24B-A2B derivative reduces refusal behavior in the original weights. This text-only mixture-of-experts model has 24B total parameters and supports multilingual reasoning and tool use. This entry uses the AD-Q6_K GGUF build with the edits baked in.

Repository: localaiLicense: other

atomic-lfm2.5-24b-a2b-uncensored-q8
AtomicChat's LFM2.5-24B-A2B derivative reduces refusal behavior in the original weights. This text-only mixture-of-experts model has 24B total parameters and supports multilingual reasoning and tool use. This entry uses the AD-Q8_0 GGUF build with the edits baked in.

Repository: localaiLicense: other

Page 1