mirror of
https://github.com/pewdiepie-archdaemon/odysseus.git
synced 2026-06-17 10:15:27 -04:00
Document self-host system requirements (#945)
This commit is contained in:
@@ -77,8 +77,10 @@ python setup.py
|
|||||||
python -m uvicorn app:app --host 127.0.0.1 --port 7000
|
python -m uvicorn app:app --host 127.0.0.1 --port 7000
|
||||||
```
|
```
|
||||||
Requirements: Python 3.11+. Cookbook also needs `tmux` for background model
|
Requirements: Python 3.11+. Cookbook also needs `tmux` for background model
|
||||||
downloads and serves. Use `--host 0.0.0.0` only when you intentionally want
|
downloads and serves. The app itself is lightweight; local model serving is the
|
||||||
LAN/reverse-proxy access.
|
heavy part and depends on the model, runtime, GPU, and VRAM, so small hosts can
|
||||||
|
connect to API or remote model servers instead. Use `--host 0.0.0.0` only when
|
||||||
|
you intentionally want LAN/reverse-proxy access.
|
||||||
|
|
||||||
### Apple Silicon
|
### Apple Silicon
|
||||||
Docker on macOS cannot use the Metal GPU. For GPU-accelerated Cookbook on an
|
Docker on macOS cannot use the Metal GPU. For GPU-accelerated Cookbook on an
|
||||||
|
|||||||
Reference in New Issue
Block a user