Açık modelleri barındırma için API'ler, MCP sunucuları ve modeller
Katalogda bunu yapan 9 araç var, ada göre sıralı.
Amazon BedrockSağlayıcıAWS service for calling 100+ foundation models through one API
falModelHosted API for 1,000+ open-source and commercial image, video and audio models
Fireworks AISağlayıcıInference, fine-tuning and dedicated GPU deployments for open models
GroqSağlayıcıLow-latency inference API for open LLMs and Whisper
LocalAIPaketRun LLM, image and audio models on your own hardware behind OpenAI-style APIs
ModalPlatformServerless cloud for running Python on GPUs, billed per second
ReplicateModelCloud API for running and fine-tuning AI models
Together AISağlayıcıServerless and dedicated inference, fine-tuning and GPUs for open models
vLLMPaketOpen-source engine for serving LLMs with high throughput on GPUs