Model Gallery

103 models from 1 repositories

Filter by type:

Filter by tags:

granite-4.2-3b-q8
IBM Granite 4.2 3B in the higher-fidelity Q8_0 GGUF format. It is a compact multilingual reasoning model for chat, coding, and tool use.

Repository: localaiLicense: apache-2.0

granite-4.2-8b-q8
IBM Granite 4.2 8B in the higher-fidelity Q8_0 GGUF format. It is a multilingual reasoning model for chat, coding, and tool use.

Repository: localaiLicense: apache-2.0

granite-4.2-30b-q8
IBM Granite 4.2 30B in the higher-fidelity Q8_0 GGUF format. It is the family's flagship multilingual reasoning model for chat, coding, and tool use.

Repository: localaiLicense: apache-2.0

hy-mt2-1.8b-q8
Hy-MT2-1.8B in the higher-quality 1.9 GB Q8_0 GGUF format. This variant preserves more model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

carbon-3b-q8
Carbon-3B in the higher-quality Q8_0 GGUF format for genomic sequence generation and analysis.

Repository: localaiLicense: apache-2.0

carbon-8b-q8
Carbon-8B in the higher-quality Q8_0 GGUF format for genomic sequence generation and analysis.

Repository: localaiLicense: apache-2.0

ornith-1.0-9b-q8
Ornith-1.0-9B in the higher-quality Q8_0 GGUF format, with the shared F16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-9b-q8
Ornith-1.5-9B in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-35b-a3b-q8
Ornith-1.5-35B-A3B in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

tiel-coder-35b-a3b-q8
Tiel-Coder-35B-A3B in the higher-quality Q8_K_XL GGUF format, with the BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-397b-q8
Ornith-1.5-397B in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

qwen3.8-27b-obliterated-q8
Qwen3.8-27B OBLITERATED in the higher-quality Q8_0 GGUF format. This model is modified for refusal-removal and red-team research, and its safety guardrails have been removed.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-q8
Qwen3.8-27B in the official Q8_0 GGUF format. This variant provides higher model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

qwen3.8-9b-q8
Qwen3.8-9B in the higher-quality Q8_0 GGUF format. This variant preserves more model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

qwen3.8-4b-q8
Qwen3.8-4B in the higher-quality Q8_0 GGUF format. This variant preserves more model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

qwen3.8-2b-q8
Qwen3.8-2B in the higher-quality Q8_0 GGUF format. This variant preserves more model fidelity while remaining suitable for compact hosts.

Repository: localaiLicense: apache-2.0

twil-lm3-q8
TwIL-LM3 in the publisher's near-lossless Q8_0 GGUF format for quality-sensitive use on hosts with enough memory.

Repository: localaiLicense: webai-non-commercial-license-ver.-1.0

nemotron-3.5-lightning-30b-a3b-q8
NVIDIA Nemotron 3.5 Lightning 30B-A3B in the official high-quality Q8_0 GGUF format for hosts with enough memory.

Repository: localaiLicense: openmdw-1.1

qwen3.8-2b-distill-q8
Qwen3.8 2B Distill in the higher-fidelity Q8_0 GGUF format. This text-only Qwen3.5 2B fine-tune targets reasoning, coding, instruction following, and function calling with a 262K native context window.

Repository: localaiLicense: apache-2.0

qwen3.8-4b-distill-q8
Qwen3.8 4B Distill in the higher-fidelity Q8_0 GGUF format. This text-only Qwen3.5 4B fine-tune targets reasoning, coding, instruction following, and function calling with a 262K native context window.

Repository: localaiLicense: apache-2.0

grug-27b-q8
Grug 27B Q8 is the higher-precision Q8_0 GGUF build for multimodal chat, reasoning, vision, and tool use.

Repository: localaiLicense: apache-2.0

Page 1