Salastil/odysseus
1
0
Fork 0
mirror of https://github.com/pewdiepie-archdaemon/odysseus.git synced 2026-06-17 10:15:27 -04:00
Code Issues Packages Projects Releases Wiki Activity
9 Commits 10 Branches 0 Tags
8dc9a3578a1726f070ed9f75c0958ae291a6d966
Commit Graph

2 Commits

Author SHA1 Message Date
yunggilja 32ac81dbc6 Add Apple Silicon (Metal) GPU detection and unified-memory fit tuning 
hardware.py detects Apple Silicon locally and over SSH, reporting
backend=metal, the chip name, and a RAM-scaled fraction of unified
memory as the usable GPU budget. fit.py gains an M1-M4 memory-bandwidth
table for realistic tok/s and drops vLLM-only formats (AWQ/GPTQ/FP8)
that can't be served on Metal.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
 2026-05-31 20:24:38 -05:00
pewdiepie-archdaemon e5c99a5eee Odysseus v1.0 2026-05-31 23:58:26 +09:00