差分
このページの2つのバージョン間の差分を表示します。
| 両方とも前のリビジョン前のリビジョン次のリビジョン | 前のリビジョン |
| ai:localllm:nemotron3super_120b [2026/03/13 16:49] – [Nemotron 3 Super 120B-A12B を Local PC で動かす] oga | ai:localllm:nemotron3super_120b [2026/03/15 14:12] (現在) – [Nemotron 3 Super 120B-A12B を Local PC で動かす] oga |
|---|
| |
| * PC Spec 1 | * PC Spec 1 |
| * CPU: Ryzen 7 9700X | * CPU: Ryzen 7 9700X (65W Default) |
| * RAM: DDR5-5600 128GB | * RAM: DDR5-5600 128GB |
| * GPU: GeForce RTX 5060Ti 16GB | * GPU: GeForce RTX 5060Ti 16GB |
| * RAM: DDR4-3200 128GB | * RAM: DDR4-3200 128GB |
| * GPU: GeForce RTX 4060Ti 16GB | * GPU: GeForce RTX 4060Ti 16GB |
| | * PC Spec 3 |
| | * CPU: Core i7-13700 |
| | * RAM: DDR5-5600 96GB |
| | * GPU: GeForce RTX 4060Ti 16GB |
| |
| |
| ^ 量子化 ^ Size ^ OS ^ CPU ^ RAM ^ RAM ^ GPU ^ Window ^ token/s ^ software ^ ^ | ^ 量子化 ^ Size ^ OS ^ CPU ^ RAM ^ RAM ^ GPU ^ Window ^ token/s ^ software ^ ^ |
| | UD_Q4_K_XL | 77 GB | Ubuntu 24.04 | Ryzen 9 3950X (65W) | DDR4-3200 | 128GB | GeForce RTX 4060Ti 16GB | 4096 | **8.3 tps** | llama.cpp b8319 | | | | UD_Q4_K_XL | 78 GB | Ubuntu 24.04 | Ryzen 9 3950X (65W) | DDR4-3200 | 128GB | GeForce RTX 4060Ti 16GB | 4096 | **8.3 tps** | llama.cpp b8319 | | |
| | Q4_K_M | 80 GB | Ubuntu 24.04 | Ryzen 9 3950X (65W) | DDR4-3200 | 128GB | GeForce RTX 4060Ti 16GB | 4096 | ** 9.22 tps** | llama.cpp b8319 | | | | Q4_K_M | 80 GB | Ubuntu 24.04 | Ryzen 9 3950X (65W) | DDR4-3200 | 128GB | GeForce RTX 4060Ti 16GB | 4096 | ** 9.22 tps** | llama.cpp b8319 | | |
| | Q4_K_M | 80 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 11.18 tps** | LMStudio 0.4.6 CUDA 12 v2.7.0 | | | | Q4_K_M | 80 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 11.18 tps** | LMStudio 0.4.6 CUDA 12 v2.7.0 | cpu=82 | |
| | | Q4_K_M | 80 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 11.43 tps** | llama.cpp CUDA12 b8303 | | |
| | | UD_Q4_K_XL | 78 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 10.89 tps** | llama.cpp CUDA12 b8303 | | |
| | | UD_Q6_K_XL | 109 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 7.92 tps** | llama.cpp CUDA12 b8303 | | |
| |
| ---- | ---- |
| |