show video detail
OpenAI's nightmare: Deepseek R1 on a Raspberry Pi
1.8M 54K 3.4K 04:18
OpenAI's nightmare: Deepseek R1 on a Raspberry Pi
  • Published_at:2025-01-28
  • Category:Science & Technology
  • Channel:Jeff Geerling
  • tags: deepseek r1 ai llm chatgpt o1 claude sonnet openai google microsoft apple npu gpu egpu raspberry pi pi 5 pci pci express intel arc amd nvidia h100 h800 china chinese american america investment energy efficiency model new tested test testing performance faster slower ampereone 671b 14b qwen huggingface llama.cpp ollama
  • description: DeepSeek R1 runs on a Pi 5, but don't believe every headline you read. Resources referenced in this video: - DeepSeek R1: https://github.com/deepseek-ai/DeepSeek-R1 - Ollama and llama.cpp benchmarks on Pi 5: https://github.com/geerlingguy/ollama-benchmark/issues/9 - Reuters article on DeepSeek: https://www.reuters.com/technology/artificial-intelligence/what-is-deepseek-why-is-it-disrupting-ai-sector-2025-01-27/ - DeepSeek FAQ from Stratchery: https://stratechery.com/2025/deepseek-faq/ Support me on Patreon: https://www.patreon.com/geerlingguy Sponsor me on GitHub: https://github.com/sponsors/geerlingguy Merch: https://www.redshirtjeff.com 2nd Channel: https://www.youtube.com/@GeerlingEngineering 3rd Channel: https://www.youtube.com/@Level2Jeff Contents: 00:00 - OpenAI's Nightmare 01:00 - What can a Pi 5 do, really? 01:39 - 671b on AmpereOne 02:00 - Pi 5 14b - CPU inference 02:20 - Pi 5 14b - GPU inference 03:05 - GPUs on Pi (and year of the Arm PC) 03:37 - Still in an AI bubble
ranked in date views likes Comments ranked in country (#position)
2025-01-30 1,193,561 38,825 2,624 (all,#23)  (Australia,#12)  (Canada,#11)  (United Kingdom,#13)  (USA,#23) 
2025-01-31 1,611,916 48,655 3,142 (all,#36)  (Australia,#14)  (Canada,#18)  (United Kingdom,#22)  (USA,#36) 
2025-02-01 1,766,441 51,874 3,306 (all,#67)  (Australia,#33)  (USA,#67) 
2025-02-02 1,827,388 54,151 3,370 (all,#82)  (Australia,#53)  (Canada,#64)  (United Kingdom,#68)  (USA,#82)