Model family
ERNIE 4.5
Dense
Listed checkpoints
- pending
Notes
Checkpoints listed here identify models in this family. Check each recipe for inference verification, hardware measurements, and requirements before running it.
Feature matrix
| Runtimes | generateserve |
|---|---|
| Backends | CUDA:supportedMetal:supportedROCm:partially supported |
| Tensor parallel | yes |
| Pipeline parallel | no |
| Drafters | none |
| KV modes | fp16int8turbo4 |
| Input modalities | text |
| Output | tokens |
| Model types | ernie4_5ernie4.5 |
Recipes in this family
pending