Filter by type:
Filter by tags:
ornith-1.5-35b-a3b-q4
Ornith-1.5-35B-A3B is an MIT-licensed Qwen3.5 mixture-of-experts model
from Ornith AI for agentic coding, reasoning, repository-level software
tasks, and tool use. It activates about 3B parameters per token and
supports text and image input with a context window of 262K tokens.
This default entry uses the Q4_K_M GGUF and BF16 vision projector. A
higher-quality Q8_0 model is available as a variant.
Repository: localaiLicense: mit
ornith-1.5-35b-a3b-q8
Ornith-1.5-35B-A3B in the higher-quality Q8_0 GGUF format, with the shared
BF16 vision projector for multimodal prompts.
Repository: localaiLicense: mit
tiel-coder-35b-a3b-q4
Tiel-Coder-35B-A3B is a 35B-parameter mixture-of-experts model for coding,
reasoning, tool use, and vision tasks. This default entry uses the
Q4_K_XL GGUF and BF16 vision projector.
Repository: localaiLicense: mit
tiel-coder-35b-a3b-q4-mtp
Tiel-Coder-35B-A3B in Q4_K_XL format with MTP speculative decoding and a
BF16 vision projector.
Repository: localaiLicense: mit
tiel-coder-35b-a3b-q8
Tiel-Coder-35B-A3B in the higher-quality Q8_K_XL GGUF format, with the
BF16 vision projector for multimodal prompts.
Repository: localaiLicense: mit
nemotron-3.5-lightning-30b-a3b-q4
NVIDIA Nemotron 3.5 Lightning is a text-only hybrid Mamba-2, attention, and
mixture-of-experts model with 30B total parameters and 3B active parameters.
It targets reasoning, coding, tool use, multilingual chat, and long-context
agent workflows, with a context window of up to one million tokens.
This entry uses the official Q4_K_M GGUF. Automatic variant selection can
choose the smaller NVFP4 build or the higher-quality Q8_0 build when it fits.
Repository: localaiLicense: openmdw-1.1
nemotron-3.5-lightning-30b-a3b-nvfp4
NVIDIA Nemotron 3.5 Lightning 30B-A3B in the official NVFP4 GGUF format.
This is the smallest linked build and retains the model's reasoning, coding,
tool-use, multilingual, and long-context capabilities.
Repository: localaiLicense: openmdw-1.1
nemotron-3.5-lightning-30b-a3b-q8
NVIDIA Nemotron 3.5 Lightning 30B-A3B in the official high-quality Q8_0
GGUF format for hosts with enough memory.
Repository: localaiLicense: openmdw-1.1
instella-moe-16b-a3b-think
AMD Instella-MoE-16B-A3B-Think is a reasoning and instruction-following
mixture-of-experts model with 16 billion total parameters and 3 billion
active parameters. It supports long-form reasoning, chat, coding, and tool
use. This entry uses the Q4_K_M GGUF quantization.
Repository: localaiLicense: other
instella-moe-16b-a3b-think-q8
AMD Instella-MoE-16B-A3B-Think is a reasoning and instruction-following
mixture-of-experts model with 16 billion total parameters and 3 billion
active parameters. It supports long-form reasoning, chat, coding, and tool
use. This entry uses the near-lossless Q8_0 GGUF quantization.
Repository: localaiLicense: other
qwen3.6-35b-a3b-uncensored-genesis-hermes-v6
Qwen3.6-35B-A3B Uncensored Genesis Hermes V6 is LuffyTheFox's multimodal,
agentic derivative of HauhauCS's uncensored Qwen3.6-35B-A3B model. It
combines Genesis tensor calibration with Hermes function-calling data while
retaining the 35B mixture-of-experts architecture, roughly 3B active
parameters per token, and the native 262K-token context window.
This entry installs the Q8_0 GGUF together with its F16 multimodal projector
for llama.cpp. The model card recommends Jinja chat templates and at least a
128K context for its thinking behavior. License: Apache-2.0.
Repository: localaiLicense: apache-2.0
qwen3.6-35b-a3b-genesis-hermes-v7
Qwen3.6-35B-A3B Genesis Hermes V7 is LuffyTheFox's Apache-2.0 multimodal,
agentic derivative of HauhauCS's uncensored Qwen3.6-35B-A3B model. It
combines Genesis tensor calibration with Hermes function-calling data while
retaining the 35B mixture-of-experts architecture, roughly 3B active
parameters per token, and the native 262K-token context window.
This entry's own payload uses the model card's recommended APEX GGUF and the
shared F16 multimodal projector. Automatic variant selection may instead
choose Compact APEX, an MTP-enabled APEX build, or Q8_K_P based on serving
features and available memory. The model card recommends Jinja chat
templates and at least a 128K context for its thinking behavior.
Repository: localaiLicense: apache-2.0
qwen3.6-35b-a3b-genesis-hermes-v7-apex-compact
Qwen3.6-35B-A3B Genesis Hermes V7 in the smaller APEX Compact GGUF format,
with the shared F16 multimodal projector. This build preserves the model's
multimodal, reasoning, coding, and agentic capabilities for hosts with less
memory than the recommended full APEX build.
Repository: localaiLicense: apache-2.0
qwen3.6-35b-a3b-genesis-hermes-v7-mtp-apex
Qwen3.6-35B-A3B Genesis Hermes V7 in the full APEX GGUF format with native
multi-token prediction enabled for speculative decoding, plus the shared
F16 multimodal projector.
Repository: localaiLicense: apache-2.0
qwen3.6-35b-a3b-genesis-hermes-v7-mtp-apex-compact
Qwen3.6-35B-A3B Genesis Hermes V7 in the smaller APEX Compact GGUF format
with native multi-token prediction enabled for speculative decoding, plus
the shared F16 multimodal projector.
Repository: localaiLicense: apache-2.0
qwen3.6-35b-a3b-genesis-hermes-v7-q8-k-p
Qwen3.6-35B-A3B Genesis Hermes V7 in the high-quality Q8_K_P GGUF format,
with the shared F16 multimodal projector. This is the largest non-MTP build
in the published V7 set.
Repository: localaiLicense: apache-2.0
qwen3.6-14b-a3b-fablevibes
Qwen3.6-14B-A3B-FableVibes is an Apache-2.0 mixture-of-experts reasoning
model distilled from Fable 5 and Claude Opus traces, with additional tool
calling and coding data. It retains Qwen 3.6 vision support while pruning
the 35B-A3B base to a 14B consumer-oriented footprint. This default entry
uses the recommended Q4_K_M GGUF quantization and its Q8_0 multimodal
projector.
Repository: localaiLicense: apache-2.0
qwen3.6-14b-a3b-fablevibes-q8
Qwen3.6-14B-A3B-FableVibes is an Apache-2.0 mixture-of-experts reasoning
model distilled from Fable 5 and Claude Opus traces, with additional tool
calling and coding data. This entry uses the near-lossless Q8_0 GGUF
quantization and its matching Q8_0 multimodal projector.
Repository: localaiLicense: apache-2.0
qwopus3.6-35b-a3b-coder-mtp
# 🌟 Qwopus3.6-35B-A3B-v1
## 💡 Base Model Overview
**Qwen3.6-35B-A3B** is an advanced hybrid sparse MoE (Mixture-of-Experts) model developed by Alibaba Cloud. It features 35B total parameters with only 3B active parameters per token, ensuring high inference efficiency. Architecturally, it combines Gated DeltaNet linear attention with standard gated attention layers, routing tokens across **256 experts**. It natively supports a massive **262k context window** and is specifically designed for high-performance agentic coding, deep reasoning, and multimodal tasks.
## 🚀 Model Refinement & Logic Tuning （Qwopus3.6-35B-A3B-v1）
🪐**Qwopus3.6-35B-A3B-v1** is a reasoning-enhanced MoE (Mixture of Experts) model fine-tuned on top of **Qwen3.6-35B-A3B**.
### 🛠 Training Strategy
The fine-tuning process for this model is structured into **three distinct stages of distributed SFT (Supervised Fine-Tuning)**, progressively scaling reasoning complexity and data diversity. This systematic approach ensures the model inherits the base MoE capabilities while sharpening its logic-handling depth.
...
Repository: localaiLicense: apache-2.0
qwen-agentworld-35b-a3b
# Qwen-AgentWorld-35B-A3B
📑 Technical Report |
📖 Blog |
🤗 Hugging Face |
🤖 ModelScope |
💻 GitHub |
🖥️ Demo
> [!Note]
> This repository contains the model weights and configuration files for **Qwen-AgentWorld-35B-A3B**, a native language world model trained for agentic environment simulation.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, etc.
**Qwen-AgentWorld** is the first language world model to cover seven agent interaction domains within a single model. It simulates agentic environments via long chain-of-thought reasoning, predicting the next environment state given an agent's action and interaction history. Trained through a three-stage pipeline — CPT injects environment knowledge, SFT activates next-state-prediction reasoning, RL sharpens simulation fidelity — Qwen-AgentWorld is a **native world model**: environment modeling is the training objective from the CPT stage onward, not a post-hoc add-on.
## Highlights
...
Repository: localaiLicense: apache-2.0
qwen3.6-35b-a3b-dflash
Qwen3.6-35B-A3B (Mixture-of-Experts, ~3B active per token) paired with its DFlash block-diffusion drafter for speculative decoding on the llama.cpp backend. DFlash speedups on MoE targets are smaller than on dense models, but still useful.
DFlash produces a whole block of draft tokens in a single forward pass and injects the target model's hidden states into the drafter's attention, which keeps the drafter tiny while making drafting GPU-friendly. The UD-Q4_K_M file carries the full Qwen3.6-35B-A3B target; the ~0.4 GB Q8_0 drafter (`draft-dflash`) accelerates generation without changing the target's outputs. The drafter is not a standalone chat model: it only runs paired with the target, which is why both are bundled here.
Flash attention is required for DFlash and is enabled in this config. A GPU is recommended.
License: Apache 2.0.
Repository: localaiLicense: apache-2.0
Page 1