Home

An easy-to-use, high-performance(?) backend for serving LLMs and other AI models, built on FastAPI.

Roadmap

• Retrieval
• Agent
• Asynio
• MultiModal