Skip to content

ML & infrastructure

LiteLLM

An open-source proxy and SDK that gives one OpenAI-compatible interface to 100+ LLM providers, with routing, fallbacks, budgets and logging.

What’s good

  • One API for many models
  • Cost and rate controls
  • Open source

Where it falls down

  • Self-hosting overhead
  • Developer-focused

Runs on

apiself hosted

Built for

developersai teams

Alternatives

Others doing the same job

All ML & infrastructure tools →

Hugging Face · ML & infrastructure

Hugging Face hosts open models, datasets, and Spaces, with inference and training tools.

Pricing

Free - $9/month

Trust 88

Visit

Coefficient · ML & infrastructure

Connects Google Sheets and Excel to live data from Salesforce, databases and SaaS tools, with AI for analysis, formulas and automated reports.

Pricing

Free - $49/month

Trust 87

Visit

Seldon · ML & infrastructure

Seldon provides a model deployment and serving platform on Kubernetes with the Seldon Core and Core 2 inference frameworks.

Pricing

Free (open source)

Trust 87

Visit

Slidebean · ML & infrastructure

An AI presentation tool that auto-designs slides from your content, with pitch-deck templates and financial-model tools for startups.

Pricing

$29-$149/month

Trust 87

Visit

Some links on this page are affiliate links, including links that pass through Skimlinks. If you buy through them we may earn a commission, at no extra cost to you. It never affects a tool's placement or score: see our methodology and affiliate disclosure. We currently earn nothing from this particular link.