Filter by type:
Filter by tags:
lfm2.5-24b-a2b-turbo-brilliance-iq4-xs
DavidAU's Turbo Brilliance build of LFM2.5-24B-A2B, a text-only reasoning
model with 24B total parameters and 2.45B active parameters. This entry
uses the IQ4_XS GGUF quantization and the embedded Turbo Brilliance
chat template for multilingual chat and tool use.
Repository: localaiLicense: other
lfm2.5-24b-a2b-turbo-brilliance-q8
DavidAU's Turbo Brilliance build of LFM2.5-24B-A2B, a text-only reasoning
model with 24B total parameters and 2.45B active parameters. This entry
uses the Q8_0 MAX GGUF quantization and the embedded Turbo Brilliance
chat template for multilingual chat and tool use.
Repository: localaiLicense: other
lfm2.5-24b-a2b-ud-q4
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total
parameters and 2.45B active parameters for multilingual chat and tool use.
This entry uses Unsloth's dynamic UD-Q4_K_XL GGUF quantization.
Repository: localaiLicense: other
lfm2.5-24b-a2b-ud-q6
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total
parameters and 2.45B active parameters for multilingual chat and tool use.
This entry uses Unsloth's dynamic UD-Q6_K_XL GGUF quantization.
Repository: localaiLicense: other
atomic-lfm2.5-24b-a2b-uncensored
AtomicChat's LFM2.5-24B-A2B derivative reduces refusal behavior in the
original weights. This text-only mixture-of-experts model has 24B total
parameters and supports multilingual reasoning and tool use.
This entry uses the AD-Q4_K_M GGUF build with the edits baked in.
Repository: localaiLicense: other
atomic-lfm2.5-24b-a2b-uncensored-q6
AtomicChat's LFM2.5-24B-A2B derivative reduces refusal behavior in the
original weights. This text-only mixture-of-experts model has 24B total
parameters and supports multilingual reasoning and tool use.
This entry uses the AD-Q6_K GGUF build with the edits baked in.
Repository: localaiLicense: other
atomic-lfm2.5-24b-a2b-uncensored-q8
AtomicChat's LFM2.5-24B-A2B derivative reduces refusal behavior in the
original weights. This text-only mixture-of-experts model has 24B total
parameters and supports multilingual reasoning and tool use.
This entry uses the AD-Q8_0 GGUF build with the edits baked in.
Repository: localaiLicense: other
lfm2.5-1.2b-instruct
Try LFM • Docs • LEAP • Discord
# LFM2.5-1.2B-Instruct
LFM2.5 is a new family of hybrid models designed for **on-device deployment**. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.
- **Best-in-class performance**: A 1.2B model rivaling much larger models, bringing high-quality AI to your pocket.
- **Fast edge inference**: 239 tok/s decode on AMD CPU, 82 tok/s on mobile NPU. Runs under 1GB of memory with day-one support for llama.cpp, MLX, and vLLM.
- **Scaled training**: Extended pre-training from 10T to 28T tokens and large-scale multi-stage reinforcement learning.
Find more information about LFM2.5 in our blog post.
## 🗒️ Model Details
LFM2.5-1.2B-Instruct is a general-purpose text-only model with the following features:
...
Repository: localaiLicense: other
lfm2.5-230m
LFM2.5-230M is LiquidAI's compact text model for edge and on-device use.
It has 230M parameters, a 128K-token context window, and support for ten
languages. This entry uses the recommended Q4_K_M GGUF quantization from
LiquidAI's official repository.
Repository: localaiLicense: other
lfm2.5-230m-q8
LFM2.5-230M is LiquidAI's compact text model for edge and on-device use.
It has 230M parameters, a 128K-token context window, and support for ten
languages. This entry uses the higher-quality Q8_0 GGUF quantization from
LiquidAI's official repository.
Repository: localaiLicense: other
lfm2.5-2.6b
LFM2.5-2.6B is LiquidAI's compact, text-only reasoning model for on-device
agentic workloads. It has 2.69B parameters, a 128K-token context window,
multilingual support, and post-training for tool use, instruction following,
data extraction, RAG, and multi-step agents. This entry uses the recommended
Q4_K_M GGUF quantization from LiquidAI's official repository.
Repository: localaiLicense: other
lfm2.5-2.6b-q8
LFM2.5-2.6B is LiquidAI's compact, text-only reasoning model for on-device
agentic workloads. It has 2.69B parameters, a 128K-token context window,
multilingual support, and post-training for tool use, instruction following,
data extraction, RAG, and multi-step agents. This entry uses the higher-quality
Q8_0 GGUF quantization from LiquidAI's official repository.
Repository: localaiLicense: other
lfm2.5-2.6b-dspark
LFM2.5-2.6B with LiquidAI's DSpark speculative drafter. This build pairs
the Q4_K_M target with the compact Q4_K_M draft sidecar for lower-memory
hosts. DSpark proposes blocks of tokens that the target model verifies,
which preserves the target model's output while accelerating generation.
Repository: localaiLicense: other
lfm2.5-2.6b-q8-dspark
LFM2.5-2.6B with LiquidAI's DSpark speculative drafter. This build pairs
the higher-quality Q8_0 target with the recommended F16 draft sidecar for
the best acceptance length. DSpark proposes blocks of tokens that the
target model verifies, which preserves the target model's output while
accelerating generation.
Repository: localaiLicense: other
lfm2.5-24b-a2b
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total
parameters and 2.45B active parameters for multilingual chat and tool use.
This entry uses the official Q4_K_M GGUF quantization.
Repository: localaiLicense: other
lfm2.5-24b-a2b-q5
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total
parameters and 2.45B active parameters for multilingual chat and tool use.
This entry uses the official Q5_K_M GGUF quantization.
Repository: localaiLicense: other
lfm2.5-24b-a2b-q6
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total
parameters and 2.45B active parameters for multilingual chat and tool use.
This entry uses the official Q6_K GGUF quantization.
Repository: localaiLicense: other
lfm2.5-24b-a2b-q8
LiquidAI LFM2.5-24B-A2B is a text-only reasoning model with 24B total
parameters and 2.45B active parameters for multilingual chat and tool use.
This entry uses the official Q8_0 GGUF quantization.
Repository: localaiLicense: other
lfm2.5-8b-a1b
Try LFM •
Docs •
LEAP •
Discord
# LFM2.5-8B-A1B
LFM2.5 is a new family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.
- **On-device personal assistant**: Designed to power real-life applications, chaining tool calls, and following complex instructions on all devices.
- **Compressed performance**: Competitive with much larger dense and MoE models on instruction following and agentic tasks.
- **Unmatched throughput**: Fastest in its size class on both CPU and GPU inference, with day-one support for llama.cpp, MLX, vLLM, and SGLang.
Find more information about LFM2.5-8B-A1B in our blog post.
**AA-Omniscience Index (higher is better) rewards correct answers and penalizes hallucinations. Scores range from -100 to 100. See more results on Artificial Analysis.*
## 🗒️ Model Details
LFM2.5-8B-A1B is a general-purpose text-only model with the following features:
...
Repository: localaiLicense: other
lfm2.5-8b-a1b-dspark
LFM2.5-8B-A1B with LiquidAI's DSpark speculative drafter. This build pairs
the Q4_K_M target with the compact Q4_K_M draft sidecar for lower-memory
hosts. DSpark proposes blocks of tokens that the target model verifies,
which preserves the target model's output while accelerating generation.
Repository: localaiLicense: other
lfm2.5-8b-a1b-q8-dspark
LFM2.5-8B-A1B with LiquidAI's DSpark speculative drafter. This build pairs
the higher-quality Q8_0 target with the recommended F16 draft sidecar for
the best acceptance length. DSpark proposes blocks of tokens that the
target model verifies, which preserves the target model's output while
accelerating generation.
Repository: localaiLicense: other
Page 1