A private AI mini rack with four Framework Desktops
Jeff Geerling
Aug 9, 2025 04:05
Create an account to hide videos, mark them watched, or save them to Don't Miss.
Create an account to hide videos, mark them watched, or save them to Don't Miss.
Create an account to hide videos, mark them watched, or save them to Don't Miss.
This mini AI cluster has 512 GB of RAM and four Framework Desktop Mainboards!
Video with more details: https://www.youtube.com/watch?v=N5xhOqlvRh4
Blog post with build details and test results: https://www.jeffgeerling.com/blog/2025/i-clustered-four-framework-mainboards-test-huge-llms
Thanks to Framework for sending over the nodes for testing, and DeskPi for sending the prototype mini rack trays!
Support me on Patreon: https://www.patreon.com/geerlingguy
Sponsor me on GitHub: https://github.com/sponsors/geerlingguy
Merch: https://www.redshirtjeff.com
2nd Channel: https://www.youtube.com/@GeerlingEngineering
3rd Channel: https://www.youtube.com/@Level2Jeff
Science & Technology
#framework
#mainboard
#mini rack
#desktop
#amd
#strix
#halo
#ryzen
#ai
#max
#plus
#395
#artificial
#intelligence
#llm
#large
#language
#model
#inference
#tensor
#layers
#llama
#cpp
#deepseek
#qwen
#code
#cluster
#beowulf
#rpc
#home assistant
#rackmount
#tray
#itx
#mini
#system
#computer
#monitor
#monitoring
#homelab
#server
#enterprise
#exo