Apple didn't have to go this hard...
Jeff Geerling
Dec 18, 2025 14:01
Create an account to hide videos, mark them watched, or save them to Don't Miss.
Create an account to hide videos, mark them watched, or save them to Don't Miss.
Create an account to hide videos, mark them watched, or save them to Don't Miss.
Chapters
RDMA over Thunderbolt support landed in macOS 26.2.
Is it good for HPC? For Exo and LLMs? Find out in this video.
Resources (some links are affiliate links):
- Mac Studio: https://www.apple.com/mac-studio/
- Exo 1.0: https://exolabs.net
- Apple MLX PR for Thunderbolt RDMA: https://github.com/ml-explore/mlx/pull/2808
- M5 Neural Accelerator speedup: https://machinelearning.apple.com/research/exploring-llms-mlx-m5
- DeskPi Rackmate TL1: https://amzn.to/4p5ek94
- Tupavco mini-rack PDU: https://amzn.to/4j0DpAq
Disclaimer: The Mac Studios used in this cluster are on loan from Apple for testing. They are not sponsoring this video, nor had any say in the contents. DeskPi sent the Rackmate TL1 used in the video for my testing, but they also had no say in the video contents. I always add the "sponsored" flag on my videos if I did not purchase the equipment being shown.
Support me on Patreon: https://www.patreon.com/geerlingguy
Sponsor me on GitHub: https://github.com/sponsors/geerlingguy
Merch: https://www.redshirtjeff.com
2nd Channel: https://www.youtube.com/@GeerlingEngineering
3rd Channel: https://www.youtube.com/@Level2Jeff
Contents:
Science & Technology
#apple
#mac
#studio
#mini
#rack
#tl1
#deskpi
#rackmate
#ai
#llm
#exo
#labs
#deepseek
#r1
#kimi
#k2
#code
#qwen3
#llama
#llama.cpp
#cluster
#clustering
#ansible
#automation
#remote
#management
#screen
#sharing
#experience
#rackmount
#thunderbolt
#cabling
#rdma
#direct
#memory
#access
#speedup
#smb
#hpc
#high
#performance
#computing
#infiniband
#nvidia
#gb10
#amd
#strix halo
#395
#plus
#max
#pro
#qsfp
#networking ring
#mlx
#mpich
#mpirun
#hpl
#benchmark
#benchmarks