Filter by type:
Filter by tags:
lfm2.5-24b-a2b-turbo-brilliance-iq4-xs
DavidAU's Turbo Brilliance build of LFM2.5-24B-A2B, a text-only reasoning
model with 24B total parameters and 2.45B active parameters. This entry
uses the IQ4_XS GGUF quantization and the embedded Turbo Brilliance
chat template for multilingual chat and tool use.
Repository: localaiLicense: other
lfm2.5-24b-a2b-turbo-brilliance-q8
DavidAU's Turbo Brilliance build of LFM2.5-24B-A2B, a text-only reasoning
model with 24B total parameters and 2.45B active parameters. This entry
uses the Q8_0 MAX GGUF quantization and the embedded Turbo Brilliance
chat template for multilingual chat and tool use.
Repository: localaiLicense: other
tess-4.5-27b-q4
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use.
This Q4_K_M GGUF build includes the F16 vision projector and uses
llama.cpp with the embedded chat template. Speculative decoding is disabled.
Repository: localaiLicense: apache-2.0
tess-4.5-27b-q6
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use.
This Q6_K GGUF build includes the F16 vision projector and uses
llama.cpp with the embedded chat template. Speculative decoding is disabled.
Repository: localaiLicense: apache-2.0
tess-4.5-27b-q8
Tess 4.5 is a 27B Qwen3.8 fine-tune for coding, reasoning, and tool use.
This Q8_0 GGUF build includes the F16 vision projector and uses
llama.cpp with the embedded chat template. Speculative decoding is disabled.
Repository: localaiLicense: apache-2.0
spark-x2.6-4b-q4
Spark-X2.6-4B is XHToken's 4B text model for conversation, reasoning,
coding, and multilingual tasks. This build uses Q4_K_M GGUF weights,
the embedded Jinja chat template, and a 32K-token default context.
Repository: localaiLicense: apache-2.0
spark-x2.6-4b-q8
Spark-X2.6-4B is XHToken's 4B text model for conversation, reasoning,
coding, and multilingual tasks. This build uses Q8_0 GGUF weights,
the embedded Jinja chat template, and a 32K-token default context.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-defiance-iq4
Defiance combines HauhauCS's uncensored Qwen3.8-27B weights with a
customized Turbo Brilliance chat template for reasoning and roleplay.
This IQ4_XS GGUF build uses llama.cpp and the embedded template,
with a 32,768-token context. Text input only; MTP is not enabled.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-defiance-q6
Defiance combines HauhauCS's uncensored Qwen3.8-27B weights with a
customized Turbo Brilliance chat template for reasoning and roleplay.
This Q6_K_P GGUF build uses llama.cpp and the embedded template,
with a 32,768-token context. Text input only; MTP is not enabled.
Repository: localaiLicense: apache-2.0
deepseek-v4.1-flash-1017
# DeepSeek-V4.1-Flash-1017
Technical Report 👁️
## Introduction
**DeepSeek-V4.1-Flash-1017** is a minor update to **DeepSeek-V4.1-Flash**, delivering substantial improvements across reasoning, coding, agentic tasks, and visual benchmarks. Alongside these gains, the model reduces task execution time and output length, enabling users to complete tasks faster and at lower cost and advancing the performance–cost Pareto frontier across multiple agent harnesses.
*† denotes the text-only subset of HLE. We use the Claude Code harness for Terminal-Bench 4.0 and the Mini-SWE-V2 harness for DeepSWE v1.1.*
## Prompt Encoding
This release does not include a Jinja-format chat template. The `encoding` folder contains a self-contained Python reference implementation (`encoding.py`) with test cases for multi-turn conversations, tool calling, thinking mode, numeric reasoning effort, mid-conversation system messages, and interleaved image content.
...
Repository: localaiLicense: mit
lfm2.5-24b-a2b-ud-q4
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total
parameters and 2.45B active parameters for multilingual chat and tool use.
This entry uses Unsloth's dynamic UD-Q4_K_XL GGUF quantization.
Repository: localaiLicense: other
lfm2.5-24b-a2b-ud-q6
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total
parameters and 2.45B active parameters for multilingual chat and tool use.
This entry uses Unsloth's dynamic UD-Q6_K_XL GGUF quantization.
Repository: localaiLicense: other
qwen3.5-0.8b-artemis-q5
TurinTech Artemis Q5_K_M quantization of Qwen3.5 0.8B for text chat,
reasoning, and tool use. This text-only build omits the vision encoder
and MTP layer. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-0.8b-artemis-q4
TurinTech Artemis Q4_K_M quantization of Qwen3.5 0.8B for text chat,
reasoning, and tool use. This text-only build omits the vision encoder
and MTP layer. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
diplodocus-preview-q4
Diplodocus preview 4 is OsaurusAI's K2 Horizon 7B fine-tune for documents,
spreadsheets, and tool-assisted tasks. This Q4_K_M GGUF build uses the
embedded chat template and enables reasoning by default. Applications
must provide the tools; the model download does not include workspace tools.
Repository: localaiLicense: apache-2.0
diplodocus-preview-q6
Diplodocus preview 4 is OsaurusAI's K2 Horizon 7B fine-tune for documents,
spreadsheets, and tool-assisted tasks. This Q6_K GGUF build uses the
embedded chat template and enables reasoning by default. Applications
must provide the tools; the model download does not include workspace tools.
Repository: localaiLicense: apache-2.0
diplodocus-preview-q8
Diplodocus preview 4 is OsaurusAI's K2 Horizon 7B fine-tune for documents,
spreadsheets, and tool-assisted tasks. This Q8_0 GGUF build uses the
embedded chat template and enables reasoning by default. Applications
must provide the tools; the model download does not include workspace tools.
Repository: localaiLicense: apache-2.0
atomic-minicpm-v-4.7-35b-a3b-uncensored-q4
AtomicChat's abliterated MiniCPM-V 4.7 is a 35B mixture-of-experts model
with 3B active parameters for chat and image understanding. This
AD-Q4_K-IQ4_XS build includes all 11 weight shards and the F16 vision
projector, with the embedded chat template and a 32K-token default context.
Repository: localaiLicense: apache-2.0
atomic-minicpm-v-4.7-35b-a3b-uncensored-q6
AtomicChat's abliterated MiniCPM-V 4.7 is a 35B mixture-of-experts model
with 3B active parameters for chat and image understanding. This
AD-Q6_K build includes all 16 weight shards and the F16 vision
projector, with the embedded chat template and a 32K-token default context.
Repository: localaiLicense: apache-2.0
huihui-qwen3.8-flash-next-abliterated-v2-q4
Huihui's second abliterated Qwen3.8-Flash-Next release adjusts the
abliteration without modifying the experts. This vision-language
mixture-of-experts model uses the publisher's UD-Q4_K_XL GGUF
and BF16 projector for text chat and image input through llama.cpp.
The default context is 32,768 tokens. Model weights use the
Qwen Community License 1.0.
Repository: localaiLicense: other
huihui-qwen3.8-flash-next-abliterated-v2-iq4
Huihui's second abliterated Qwen3.8-Flash-Next release adjusts the
abliteration without modifying the experts. This vision-language
mixture-of-experts model uses the publisher's UD-IQ4_XS GGUF
and BF16 projector for text chat and image input through llama.cpp.
The default context is 32,768 tokens. Model weights use the
Qwen Community License 1.0.
Repository: localaiLicense: other
Page 1