hnrss.org

Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5, 6.43 tok/s (eval 11.68 tok/s)

Article URL: https://github.com/b4rtaz/distributed-llama/discussions/162 Comments URL: https://news.ycombinator.com/item?id=43059579 Points: 84 # Comments: 17

Fév 15, 2025 - 18:12
 0
Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5, 6.43 tok/s (eval 11.68 tok/s)

Article URL: https://github.com/b4rtaz/distributed-llama/discussions/162

Comments URL: https://news.ycombinator.com/item?id=43059579

Points: 84

# Comments: 17

Lire plus

Tags :

Article précédent

IA : Quels sont les meilleurs smartphones pour les utiliser ?

Article suivant

Nintendo Obtains New Anti-Palworld Patent and Seeks Even More

Articles similaires

DeepSeek Open Source Optimized Parallelism Strategies, 3 repos

DeepSeek Open Source Optimized Parallelism Strategies, ...

Fév 27, 2025  0

Run structured extraction on documents/images locally with Ollama and Pydantic

Run structured extraction on documents/images locally w...

Fév 20, 2025  0

Delta Chat – Email Based PGP Encrypted Chat

Mar 5, 2025  0