差分
このページの2つのバージョン間の差分を表示します。
| 両方とも前のリビジョン前のリビジョン次のリビジョン | 前のリビジョン |
| ai:localllm:mistralsmall4_119b [2026/03/19 08:49] – [Mistral Small 4 119B 2603 を Local PC で動かす] oga | ai:localllm:mistralsmall4_119b [2026/03/19 22:21] (現在) – [Mistral Small 4 2603 (119b)] oga |
|---|
| ====== Mistral Small 4 119B 2603 (119b) ====== | ====== Mistral Small 4 119B-2603 (119b) ====== |
| |
| * [[https://mistral.ai/news/mistral-small-4]] | * [[https://mistral.ai/news/mistral-small-4]] |
| |
| |
| ===== Mistral Small 4 119B 2603 を Local PC で動かす ===== | ===== Mistral Small 4 119B-2603 を Local PC で動かす ===== |
| |
| |
| | Q4_K_M | 67 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 12.89 tps** | LMStudio 0.4.6 CUDA 12 v2.7.1 | PC1 gpu=5 | | | Q4_K_M | 67 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 12.89 tps** | LMStudio 0.4.6 CUDA 12 v2.7.1 | PC1 gpu=5 | |
| | Q4_K_M | 67 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 13.77 tps** | llama.cpp b8407 CUDA 12 | PC1 | | | Q4_K_M | 67 GB | Windows11 | Ryzen 7 9700X | DDR5-5600 | 128GB | GeForce RTX 5060Ti 16GB | 4096 | ** 13.77 tps** | llama.cpp b8407 CUDA 12 | PC1 | |
| | Q4_K_M | 67 GB | Ubuntu 24.04 | Ryzen 9 3950X (65W) | DDR4-3200 | 128GB | GeForce RTX 4060Ti 16GB | 4096 | ** 11.92 tps** | llama.cpp b8416 CUDA | PC2 | | | Q4_K_M | 67 GB | Ubuntu 24.04 | Ryzen 9 3950X (65W) | DDR4-3200 | 128GB | GeForce RTX 4060Ti 16GB | 4096 | ** 10.70 tps** | llama.cpp b8416 CUDA | PC2 | |
| | Q4_K_M | 67 GB | Ubuntu 24.04 | Core i7-13700 | DDR5-5600 | 96GB | GeForce RTX 4060Ti 16GB | 4096 | ** 13.14 tps** | llama.cpp b8411 CUDA | PC3 | | | Q4_K_M | 67 GB | Ubuntu 24.04 | Core i7-13700 | DDR5-5600 | 96GB | GeForce RTX 4060Ti 16GB | 4096 | ** 13.14 tps** | llama.cpp b8411 CUDA | PC3 | |
| | Q4_K_M | 67 GB | Windows11 | Ryzen AI Max+ 395 | LPDDR5-8000 | 128GB | Radeon 8060S | 4096 | ** 32.53 tps** | LMStudio 0.4.6 Vulkan v2.7.1 | PC4 EVO-X2 | | | Q4_K_M | 67 GB | Windows11 | Ryzen AI Max+ 395 | LPDDR5-8000 | 128GB | Radeon 8060S | 4096 | ** 32.53 tps** | LMStudio 0.4.6 Vulkan v2.7.1 | PC4 EVO-X2 | |