Model family
Qwen 2 / 2.5
Dense
Listed checkpoints
Notes
Checkpoints listed here identify models in this family. Check each recipe for inference verification, hardware measurements, and requirements before running it.
Feature matrix
| Runtimes | generateserve |
|---|---|
| Backends | CUDA:supportedMetal:supportedROCm:partially supported |
| Tensor parallel | yes |
| Pipeline parallel | no |
| Drafters | none |
| KV modes | fp16int8turbo4 |
| Input modalities | text |
| Output | tokens |
| Model types | qwen2 |
Recipes in this family
Choose hardware to estimate fit.