[v0.12.2] Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5 8GB · b4rtaz/distributed-llama · Discu...

https://github.com/b4rtaz/distributed-llama/discussions/162 Model: deepseek_r1_distill_llama_8b_q40 Version: 0.12.2 Evaluation Prediction 2 x Raspberry Pi 5 8GB 7.70 tok/s 3.54 tok/s 4 x Raspberry Pi 5 8GB 11.68 tok/s 6.43 tok/s 2 x Raspberry Pi 5 8GB ... 🔶...

Om Podcasten

GitHub trends to you daily. This podcast features popular GitHub repositories in an audio format, presented in a radio style. Stay updated on the latest trending technologies with ease. This is an unofficial channel, and we are not affiliated with the original media sources. The content is curated and produced independently by a Japanese software engineer. Powered by VoiceFeed. https://voicefeed.web.app