GitHub - go-skynet/LocalAI: :robot: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. Free Open Source OpenAI alternative. No GPU required. LocalAI is an API to run ggml compatible models: llama, gpt4all, rwkv, whisper, vicuna, koala, gpt4all-j, cerebras, falcon, dolly, starcoder, and many other

2485 shaares
83 private links

2485 shaares · 83 private links

Filters

Links per page

20 50 100

GitHub - go-skynet/LocalAI: :robot: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. Free Open Source OpenAI alternative. No GPU required. LocalAI is an API to run ggml compatible models: llama, gpt4all, rwkv, whisper, vicuna, koala, gpt4all-j, cerebras, falcon, dolly, starcoder, and many other

Host your own ChatGPT-like AI API. With this you could plug your self-hosted version into any application (that allows plugging custom API URLs) and off you go with whatever model you chose!

I have no idea about the performance with/without GPU.

June 20, 2023 at 18:22:37 GMT+2 * · permalink

https://github.com/go-skynet/LocalAI

Filters

Links per page

20 50 100