Model family
Bidirectional Llama / LLM2Vec embedder
Embedding
Listed checkpoints
Notes
Checkpoints listed here identify models in this family. Check each recipe for inference verification, hardware measurements, and requirements before running it.
Feature matrix
| Runtimes | embed |
|---|---|
| Backends | CUDA:supportedMetal:supportedROCm:partially supported |
| Tensor parallel | no |
| Pipeline parallel | no |
| Drafters | none |
| KV modes | fp16 |
| Input modalities | text |
| Output | embeddings |
| Model types | llamallama_bidirec |
Recipes in this family
Choose hardware to estimate fit.