Xinference

Open-source platform for running inference with LLMs, embedding models, multimodal models, and more on cloud or on-premises. Supports a wide array of model types including text, image, audio, video, and reranking with a unified API. Best suited for developers building AI applications who need flexible self-hosted model serving.