Tarea: back · Mistral AI
Mistral 7B Instruct v0.3
chatMistralApache-2.0
parámetros
7,240,000,000
Context
32,768
Muestras
1
Benchmarks
RealMediana (tok/s)
34
Promedio (tok/s)
34
P25
34
P75
34
Explorador de benchmarks
| Cuantización | Runtime | GPU | Mediana (tok/s) | Muestras |
|---|---|---|---|---|
| Q4_K_M | llama.cpp | RTX 3060 | 34 | 1 |