Filter by type:
Filter by tags:
bge-large-en-v1.5-f16
BGE-large-en-v1.5 is a 335M English embedding model for semantic search
and retrieval. This F16 GGUF build produces 1024-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-large-en-v1.5-q8-0
BGE-large-en-v1.5 is a 335M English embedding model for semantic search
and retrieval. This Q8_0 GGUF build produces 1024-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-large-en-v1.5-q4-k-m
BGE-large-en-v1.5 is a 335M English embedding model for semantic search
and retrieval. This Q4_K_M GGUF build produces 1024-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-large-en-v1.5-transformers
BGE-large-en-v1.5 is a 335M English embedding model for semantic search
and retrieval. This safetensors build uses the Transformers backend's
SentenceTransformer loader, producing 1024-dimensional embeddings with
a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-base-en-v1.5-f16
BGE-base-en-v1.5 is a 109M English embedding model for semantic search
and retrieval. This F16 GGUF build produces 768-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-base-en-v1.5-q8-0
BGE-base-en-v1.5 is a 109M English embedding model for semantic search
and retrieval. This Q8_0 GGUF build produces 768-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-base-en-v1.5-q4-k-m
BGE-base-en-v1.5 is a 109M English embedding model for semantic search
and retrieval. This Q4_K_M GGUF build produces 768-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-small-en-v1.5-f16
BGE-small-en-v1.5 is a 33M English embedding model for semantic search
and retrieval. This F16 GGUF build produces 384-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-small-en-v1.5-q8-0
BGE-small-en-v1.5 is a 33M English embedding model for semantic search
and retrieval. This Q8_0 GGUF build produces 384-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
bge-small-en-v1.5-q4-k-m
BGE-small-en-v1.5 is a 33M English embedding model for semantic search
and retrieval. This Q4_K_M GGUF build produces 384-dimensional embeddings
with a 512-token context. For retrieval, prefix queries with
"Represent this sentence for searching relevant passages: "; leave passages unprefixed.
Repository: localaiLicense: mit
qwen3.8-flash-next-gsq-rco-q2-0
Qwen3.8 Flash Next with ISTA DASLab's GSQ-RCO Q2_0 mixed quantization.
Includes both GGUF shards (transformer weights and n-gram embeddings)
and the BF16 vision projector for text chat and image input.
Uses llama.cpp with the embedded chat template and a 32K context.
Repository: localaiLicense: other
qwen3.8-flash-next-gsq-rco-iq2-xs
Qwen3.8 Flash Next with ISTA DASLab's GSQ-RCO IQ2_XS mixed quantization.
Includes both GGUF shards (transformer weights and n-gram embeddings)
and the BF16 vision projector for text chat and image input.
Uses llama.cpp with the embedded chat template and a 32K context.
Repository: localaiLicense: other
qwen3.8-flash-next-gsq-rco-iq3-xxs
Qwen3.8 Flash Next with ISTA DASLab's GSQ-RCO IQ3_XXS mixed quantization.
Includes both GGUF shards (transformer weights and n-gram embeddings)
and the BF16 vision projector for text chat and image input.
Uses llama.cpp with the embedded chat template and a 32K context.
Repository: localaiLicense: other
Attention: Trust Remote Code is required for this model
wemm-embedding-2b
WeMM-Embedding-2B is Tencent's Apache-2.0 multilingual embedding model
built on Qwen3.5. This entry serves the original bfloat16 safetensors with
LocalAI's Transformers backend and produces 2,048-dimensional normalized
embeddings for text retrieval, semantic search, and RAG.
The upstream model can also embed images and videos. LocalAI currently
exposes text input through its embeddings API for this backend.
Repository: localaiLicense: apache-2.0
Attention: Trust Remote Code is required for this model
wemm-embedding-4b
WeMM-Embedding-4B is Tencent's mid-sized Apache-2.0 multilingual embedding
model built on Qwen3.5. This entry serves the original bfloat16 safetensors
with LocalAI's Transformers backend and produces 2,560-dimensional
normalized embeddings for text retrieval, semantic search, and RAG.
The upstream model can also embed images and videos. LocalAI currently
exposes text input through its embeddings API for this backend.
Repository: localaiLicense: apache-2.0
Attention: Trust Remote Code is required for this model
wemm-embedding-9b
WeMM-Embedding-9B is Tencent's largest Apache-2.0 multilingual embedding
model built on Qwen3.5. This entry serves the original bfloat16 safetensors
with LocalAI's Transformers backend and produces 4,096-dimensional
normalized embeddings for text retrieval, semantic search, and RAG.
The upstream model can also embed images and videos. LocalAI currently
exposes text input through its embeddings API for this backend.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-nvfp4-mtp
Qwen3.8-27B in a compact NVFP4 GGUF format with its MTP draft head
embedded in the model file. This entry uses the medium tier, which keeps
the NVFP4 backbone while using higher-precision output and embedding
tensors. MTP speculative decoding proposes multiple tokens for the target
model to verify.
Repository: localaiLicense: apache-2.0
mxbai-embed-large-v1-q4
Mixedbread's mxbai-embed-large-v1 is a 335M-parameter English BERT
embedding model for retrieval, semantic search, and RAG. It produces
1,024-dimensional embeddings and supports sequences up to 512 tokens.
Prefix retrieval queries with `Represent this sentence for searching
relevant passages: `. This entry uses the balanced Q4_K_M GGUF.
Repository: localaiLicense: apache-2.0
mxbai-embed-large-v1-q8
Mixedbread's mxbai-embed-large-v1 in the higher-fidelity Q8_0 GGUF
format. This 335M-parameter English BERT model produces
1,024-dimensional embeddings for retrieval, semantic search, and RAG.
Repository: localaiLicense: apache-2.0
mxbai-embed-large-v1-f16
Mixedbread's mxbai-embed-large-v1 in the official full-precision F16
GGUF format. This 335M-parameter English BERT model produces
1,024-dimensional embeddings for retrieval, semantic search, and RAG.
Repository: localaiLicense: apache-2.0
nemotron-3-embed-1b-q4
Nemotron-3-Embed-1B is NVIDIA's multilingual text embedding model for
retrieval, semantic search, and RAG. This compact Q4_K_M GGUF produces
2,048-dimensional normalized embeddings and supports 36 languages. Prefix
retrieval queries with `query: ` and documents with `passage: `.
Repository: localaiLicense: openmdw-1.1
Page 1