Run LLMs and other machine learning models locally. Wants to be a complete drop-in replacement for OpenAI so it also has the same REST API bindings - theoretically allowing you to replace any software that uses OpenAI models with this one (e.g. through redirecting DNS resolution in hosts).

Supports GPU acceleration but also runs without CPU. Usable for text, audio, video, image, voice generation.