Interesting video of M5 Max, on impact of Low, Automatic and High power modes on inference.
- No external monitor attached
- Model not relevant, but it's DS4 Flash Q2.
Results:
- Low ~25W ~12 toks/s
- High ~120W ~ 32 toks/s
- Automatic varies from 40W ~14 to 90W ~29 in relation to the fan speed and temperature of the Mac.
If you really want to push your MacBook to the max, High Power mode and no external monitors, with them I see a very strange behavior that I'm investigating 🧐
Video