LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar https://t.co/ekUuDIqPEI

{} [+]