The best AI infrastructure

Hugging Face · ML & infrastructure

Hugging Face hosts open models, datasets, and Spaces, with inference and training tools.

Coefficient · ML & infrastructure

Connects Google Sheets and Excel to live data from Salesforce, databases and SaaS tools, with AI for analysis, formulas and automated reports.

Seldon · ML & infrastructure

Seldon provides a model deployment and serving platform on Kubernetes with the Seldon Core and Core 2 inference frameworks.

Slidebean · ML & infrastructure

An AI presentation tool that auto-designs slides from your content, with pitch-deck templates and financial-model tools for startups.

Fiscal AI · ML & infrastructure

FinChat (by Fiscal AI) provides AI-driven analysis of company fundamentals, KPIs, and earnings transcripts for investors and equity researchers.

MLflow (Linux Foundation) · ML & infrastructure

MLflow is an open-source platform for managing the machine learning lifecycle, including experiment tracking, model registry, and deployment.

Weights & Biases · ML & infrastructure

Weights & Biases is an MLOps platform for experiment tracking, model management, evaluations, and LLM monitoring.

deepset · ML & infrastructure

Haystack is deepset's open-source framework for building production RAG pipelines, search systems, and AI agents.

BerriAI · ML & infrastructure

An open-source proxy and SDK that gives one OpenAI-compatible interface to 100+ LLM providers, with routing, fallbacks, budgets and logging.

LlamaIndex · ML & infrastructure

LlamaIndex is an open-source data framework for connecting custom data sources to LLMs for retrieval-augmented generation and agents.

Arize AI · ML & infrastructure

An open-source observability tool for LLM and ML applications offering tracing, evaluation and troubleshooting for agents and RAG pipelines.

Glasp · ML & infrastructure

A web highlighter and social knowledge tool that lets you save quotes, summarize articles and videos with AI, and build a personal knowledge base.

Groq · ML & infrastructure

GroqCloud runs open LLMs at very high speed on custom LPU hardware, via API.

Ajelix · ML & infrastructure

A toolkit of AI helpers that generate and explain spreadsheet formulas, write scripts, translate sheets and build BI reports.

Equals · ML & infrastructure

A modern spreadsheet that connects directly to databases and SaaS tools, with AI assistance for analysis, reporting and recurring dashboards.

Fiddler AI · ML & infrastructure

Fiddler AI is an AI observability platform for monitoring, explaining, and analyzing ML models and LLM applications in production.

Glass Health · ML & infrastructure

An AI platform for clinicians that suggests differential diagnoses and evidence-based clinical plans from a patient summary to support decisions.

Google · ML & infrastructure

Google Cloud offers compute, storage, databases, Kubernetes, and AI services.

PromptLayer · ML & infrastructure

A platform for versioning, testing and monitoring LLM prompts, with logging, evaluation and a visual prompt registry for AI product teams.

Basedash · ML & infrastructure

Basedash connects to your database and uses AI to generate dashboards, charts, and admin panels from natural-language prompts.

Formula Bot · ML & infrastructure

Formula Bot generates spreadsheet formulas from plain English and offers an AI data analyst for Excel and Google Sheets workflows.

Numerous · ML & infrastructure

An add-on that brings AI functions to Google Sheets and Excel for bulk text generation, classification, extraction and formula help at scale.

Coveo · ML & infrastructure

An enterprise platform delivering AI search, recommendations and generative answering across commerce, service and workplace experiences.

Vald (Yahoo Japan) · ML & infrastructure

Vald is a highly scalable, distributed open-source vector search engine built on Kubernetes for fast approximate nearest neighbor search.

Braintrust · ML & infrastructure

Braintrust is an end-to-end platform for evaluating, testing, and monitoring AI and LLM applications throughout development.

Helicone · ML & infrastructure

Helicone is an open-source observability platform that helps developers log, monitor, and debug LLM application usage and costs.

Hex · ML & infrastructure

Hex is a collaborative data workspace blending notebooks, SQL, and AI.

MagicSlides · ML & infrastructure

A Google Slides add-on and web app that generates presentations from text, topics, YouTube links or PDFs in seconds across many languages.

Portkey · ML & infrastructure

Portkey is an AI gateway that provides unified LLM routing, observability, caching, and guardrails for production AI applications.

PromptLoop · ML & infrastructure

Runs AI research and enrichment across spreadsheet rows, scraping web data and structuring it into columns for sales and market research.

Replicate · ML & infrastructure

Replicate lets you run and deploy thousands of open-source AI models with one API call.

SheetAI · ML & infrastructure

A Google Sheets add-on with custom AI functions to generate, summarize, classify and extract text directly in cells without leaving the sheet.

SlidesGPT · ML & infrastructure

Generates editable PowerPoint and Google Slides presentations from a prompt or document, with an API for programmatic slide generation.

Wonderslide · ML & infrastructure

Turns rough slides or text into professionally designed presentations automatically, choosing layouts, fonts and visuals to match your style.

Athina · ML & infrastructure

Helps teams evaluate, monitor and debug LLM applications with automated evals, datasets and experiments to ship reliable AI features.

Bricks · ML & infrastructure

An AI-native spreadsheet that turns data into charts, dashboards and documents from natural-language prompts, blending docs and sheets.

Comet ML · ML & infrastructure

Comet is an MLOps platform for experiment tracking, model production monitoring, and LLM evaluation across the ML lifecycle.

GPTExcel · ML & infrastructure

Creates and explains Excel, Google Sheets and Airtable formulas, plus SQL and scripts, from plain-language descriptions of what you need.

Mem0 · ML & infrastructure

Mem0 is an open-source memory layer that gives AI agents and assistants persistent, personalized long-term memory.

Powerdrill AI · ML & infrastructure

Powerdrill turns datasets and documents into conversational insights, generating reports, visualizations, and answers from your uploaded data.

Zilliz · ML & infrastructure

Milvus is an open-source, cloud-native vector database for similarity search and AI applications at billion-scale.

Modal Labs · ML & infrastructure

Modal runs Python functions, ML models, and batch jobs in the cloud with serverless GPUs.

neptune.ai · ML & infrastructure

neptune.ai is an experiment tracker built for teams training large-scale and foundation models, with fast logging and scalable metadata.

Pinecone · ML & infrastructure

Pinecone is a fully managed vector database for semantic search and RAG at scale.

Anyscale · ML & infrastructure

Ray is an open-source unified framework for scaling AI and Python applications, covering training, tuning, serving, and data processing.

Roboflow · ML & infrastructure

Roboflow is a computer vision platform for annotating, training, and deploying object detection and image models with minimal code.

Weaviate · ML & infrastructure

Weaviate is an open-source vector database with built-in vectorization and hybrid search.

Labelbox · ML & infrastructure

Labelbox is a data-centric AI platform for labeling, curating, and evaluating data to train and improve machine learning models.

Qdrant · ML & infrastructure

Qdrant is a high-performance, open-source vector database written in Rust.

SuperAnnotate · ML & infrastructure

SuperAnnotate is an end-to-end platform for annotating, managing, and curating training data for computer vision, NLP, and LLMs.

V7 Labs · ML & infrastructure

V7 is an AI data engine for labeling images, video, and documents and automating data workflows for computer vision and agents.

Aporia · ML & infrastructure

Aporia provides ML observability and real-time guardrails for monitoring models and securing generative AI applications.

BentoML · ML & infrastructure

BentoML is an open-source framework for packaging, serving, and deploying machine learning models and AI inference pipelines.

ClearML · ML & infrastructure

ClearML is an open-source MLOps platform combining experiment tracking, orchestration, pipelines, and data management in one suite.

Dataloop · ML & infrastructure

Dataloop is a platform for data annotation, management, and pipeline orchestration to build and operate production AI and computer vision.

Iterative · ML & infrastructure

DVC is an open-source tool for data and model versioning, experiment management, and reproducible ML pipelines built on top of Git.

Hopsworks · ML & infrastructure

Hopsworks is a data and AI platform built around a feature store, supporting feature engineering, training, and serving for ML and LLMs.

HumanSignal · ML & infrastructure

Label Studio is an open-source data labeling tool from HumanSignal that supports text, image, audio, and multimodal annotation.

Langfuse · ML & infrastructure

Langfuse is an open-source platform for tracing, evals, and analytics of LLM applications.

Outerbounds · ML & infrastructure

Metaflow is an open-source framework, originally from Netflix, for building and managing real-life data science and ML pipelines.

Polyaxon · ML & infrastructure

Polyaxon is a platform for reproducible and scalable machine learning, orchestrating experiments and pipelines on Kubernetes.

Sama · ML & infrastructure

Sama provides managed data annotation and validation services for computer vision and generative AI with an ethical sourcing model.

Vespa.ai · ML & infrastructure

Vespa is an open-source big-data serving engine for low-latency vector, text, and structured search at scale.

Arize AI · ML & infrastructure

Arize AI is an ML observability platform for monitoring, troubleshooting, and evaluating models and LLM applications in production.

CVAT.ai · ML & infrastructure

CVAT is an open-source annotation tool for labeling images and videos for computer vision, with a hosted cloud option.

Activeloop · ML & infrastructure

Deep Lake by Activeloop is a database for AI that stores vectors, datasets, and multimedia in a format optimized for deep learning.

Encord · ML & infrastructure

Encord is a data development platform for annotating, curating, and managing visual and multimodal data to build computer vision models.

Evidently AI · ML & infrastructure

Evidently AI is an open-source library and platform for evaluating, testing, and monitoring ML models and LLM applications.

Kili Technology · ML & infrastructure

Kili Technology is a data labeling and quality platform for building high-quality training datasets for computer vision and LLMs.

AimStack · ML & infrastructure

Aim is an open-source experiment tracker for AI metadata, offering a fast UI to compare thousands of training runs.

Anyscale · ML & infrastructure

Anyscale is a managed platform built by the creators of Ray for scaling AI and Python workloads from training to serving.

Deepchecks · ML & infrastructure

Deepchecks is an open-source platform for continuously validating, testing, and monitoring machine learning models and LLM applications.

Feast (LF AI & Data) · ML & infrastructure

Feast is an open-source feature store that lets teams define, store, and serve features for training and online inference.

Union.ai · ML & infrastructure

Flyte is an open-source workflow orchestration platform for building scalable, reproducible data and machine learning pipelines on Kubernetes.

HockeyStack · ML & infrastructure

HockeyStack unifies marketing and sales data with AI to deliver multi-touch attribution, account journeys, and pipeline analytics for B2B teams.

LangChain · ML & infrastructure

LangSmith provides tracing, evaluation, and monitoring for LLM and agent applications.

Mutiny · ML & infrastructure

Mutiny uses AI to personalize websites and landing pages for target accounts, helping B2B marketers convert more pipeline from anonymous traffic.

Observe.AI · ML & infrastructure

Analyzes 100% of contact-center calls and chats with AI to score quality, coach agents and surface insights, with AI agents and assist tools.

Galileo · ML & infrastructure

Galileo is an evaluation and observability platform for AI agents and LLM applications, with automated metrics and guardrails.

Marqo · ML & infrastructure

Marqo is an open-source vector search engine that handles embedding generation and retrieval in a single API for text and images.

Baseten · ML & infrastructure

Baseten deploys, serves, and scales machine-learning models in production with autoscaling.

LanceDB · ML & infrastructure

LanceDB is an open-source, embedded vector database built on the Lance columnar format for multimodal AI and retrieval workloads.

Martian · ML & infrastructure

An LLM router that automatically sends each request to the best-performing, lowest-cost model, optimizing quality and spend across providers.

OpenRouter · ML & infrastructure

OpenRouter routes a single API to hundreds of models from many providers, with unified billing.

RunPod · ML & infrastructure

RunPod offers on-demand and serverless GPUs for training and running AI workloads.

Scale AI · ML & infrastructure

Scale AI provides data labeling, RLHF, and a data engine for training and evaluating machine learning and foundation models.

Valohai · ML & infrastructure

Valohai is an MLOps platform that automates ML pipelines, version control, and infrastructure orchestration across cloud and on-prem.

Fireworks AI · ML & infrastructure

Fireworks AI serves open-source LLMs and image models with very fast, low-cost inference.

Robust Intelligence (Cisco) · ML & infrastructure

Robust Intelligence provides AI validation and security, stress-testing models and protecting AI applications against failures and attacks.

Snorkel AI · ML & infrastructure

Snorkel AI is a data development platform for programmatic labeling, curation, and fine-tuning to build and align AI models.

Together · ML & infrastructure

Together AI offers fast inference, fine-tuning, and GPU compute for open-source LLMs.

Cohere · ML & infrastructure

Cohere provides enterprise-grade language models, embeddings, and RAG tooling via API.

Vellum AI · ML & infrastructure

Vellum is a development platform for building, evaluating, and deploying LLM-powered features with prompt engineering, testing, and workflow tools.

Beam Cloud · ML & infrastructure

Beam is a serverless cloud for running AI workloads and GPU functions, letting developers deploy inference and training jobs from Python.

Cerebrium · ML & infrastructure

Cerebrium is a serverless GPU platform for deploying machine learning models and AI applications with low-latency autoscaling.

Mystic.ai · ML & infrastructure

Mystic.ai is a platform for deploying and scaling machine learning models, running inference cost-effectively in your own cloud account.

turbopuffer · ML & infrastructure

turbopuffer is a serverless vector and full-text search database built on object storage for low-cost, large-scale retrieval.