RTX 3060
NVIDIARTX 30Ampere
VRAM
12 GB
Bandwidth
360 GB/s
Muestras
5
Benchmarks en esta GPU
| Modelo | Cuantización | Runtime | Mediana (tok/s) | Muestras | Tipo |
|---|---|---|---|---|---|
| Qwen2.5 7B Instruct | Q4_K_M | Ollama | 32 | 1 | Real |
| Gemma 2 9B | Q4_K_M | Ollama | 28 | 1 | Real |
| Llama 3.1 8B Instruct | Q4_K_M | llama.cpp | 35.2 | 1 | Real |
| DeepSeek R1 Distill Qwen 7B | Q4_K_M | Ollama | 30 | 1 | Real |
| Mistral 7B Instruct v0.3 | Q4_K_M | llama.cpp | 34 | 1 | Real |