AI infrastructure AI tools

GitHubDiscordPyTorchTensorFlow

AI infrastructure

The GitHub of AI — host, share, and run models with 500K+ models, datasets, and Spaces.

Team & Enterprise starting at $20/user/month; GPU compute starting at $0.60/hour for Inference Endpoints

Community (various)162k10M+ users

Together AI

GPU ClustersModel LibraryInference APIsFine-tuning+1

AI infrastructure

The AI Native Cloud — full-stack platform for inference, compute, and model shaping

Usage-based pricing for serverless inference (per token), batch inference, provisioned throughput (token-based capacity with SLAs), dedicated model inference, and dedicated container inference. GPU compute clusters also available.

Open-source models (e.g., DeepSeek, Gemma, Llama, Qwen, GLM, MiniMax, Kimi)Popular

Groq

AI infrastructure

Fast, low-cost AI inference powered by custom LPU silicon

Free API key available; see pricing page for details

OpenAIDiscordDocs API

Groq (third-party models hosted on LPU infrastructure)Popular

Replicate

Multi-provider (Black Forest Labs, OpenAI, Google, Anthropic, ByteDance, xAI, Alibaba, Recraft, Minimax, and community models)Popular

AI infrastructure

Run open-source AI models in the cloud via a simple API — images, video, audio, and LLMs.

Pay-per-use: public models billed by time (e.g. CPU $0.000100/sec, Nvidia T4 $0.000225/sec, Nvidia L40S $0.000975/sec, Nvidia A100 80GB $0.001400/sec) or by input/output (e.g. flux-1.1-pro $0.04/image, deepseek-r1 $0.01/1K output tokens). Private models billed for all online time including idle.

Node.jsPythonHTTP

Free tierDevAPIOSS

Weights & Biases

LangChainLlamaIndexPyTorchHugging Face+1

AI infrastructure

ML experiment tracking, model evaluation, and LLMOps platform used by leading AI teams

Free tierDevAPISelf-host

Vercel AI SDK

Multi-provider (100+ models via Vercel AI Gateway)27k10M+ users

AI infrastructure

TypeScript toolkit for building streaming AI chat apps with React and multiple LLM providers

Free · AI Gateway available

ReactNext.jsVueSvelte+1

FreeDevAPIOSSSelf-host

Anyscale

PyTorchvLLMSGLangXGBoost+8

AI infrastructure

Production-scale AI infrastructure powered by Ray — built for foundation model workloads

Pay-as-you-go with $100 free credit to start. Hosted and BYOC options. Compute billed per hour (e.g. CPU-only AC $0.0135/hr, NVIDIA T4 AC $0.5682/hr, NVIDIA L4 AC $0.9542/hr, NVIDIA A10G AC $1.3635/hr, NVIDIA A100 AC $4.9591/hr). Committed contracts available for volume discounts.

Free tierDevAPISelf-host

AWS Bedrock

AI infrastructure

Fully managed LLM APIs on AWS — access Claude, Llama, Mistral, and others in your AWS infrastructure.

OpenAIAWS

Anthropic / Meta / Mistral / Amazon10M+ users

Banana

AI infrastructure

GPU inference hosting for AI teams who ship fast and scale faster

$1200/mo Team + at-cost compute, Enterprise custom pricing

GitHubCLI

Growing

Baseten

AI infrastructure

The fastest AI model inference platform for production-grade deployments

Basic plan is $0/month pay-as-you-go; Pro plan requires a quote with volume discounts; Enterprise plan requires a quote. Compute billed per minute (e.g. H100 80 GiB at $0.10833/min). Model APIs priced per 1M tokens.

CursorNotionDescript

PaidDevAPISelf-host

BentoML

AI infrastructure

Run AI inference at scale — deploy any model anywhere with full control and no complexity.

Open-source free tier · Bento Cloud & enterprise plans (contact for pricing)

8.9kGrowing

Browser Use

PlaywrightPuppeteerClaude CodeCodex+1

AI infrastructure

Agents that use the browser.

Cloud browsers at $0.02/hour plus proxy traffic; Web agents at model cost +20% plus browser time and traffic. $1 free credit for eligible signups, no card required. Minimum top-up $5. Credits never expire.

Multiple (OpenAI, Anthropic, DeepSeek, xAI, MiniMax, Z.ai, Google)119k

Browserbase

AI infrastructure

Give your agents access to the whole web. Browserbase makes the web as reliable and programmable as APIs

Free ($0/mo): 3 concurrent browsers, 1 browser hour, 1,000 Search & Fetch calls; Developer ($20/mo): 25 concurrent browsers, 100 browser hours then $0.12/hr, 15 Agent runs; Startup ($99/mo): 100 concurrent browsers, 500 browser hours then $0.10/hr, 50 Agent runs; Scale: Custom pricing, 250+ concurrent browsers

CloudflareStagehandMCP

Model-agnostic (any model via Model Gateway)

Cerebras

AWS MarketplaceOpenRouterHuggingFaceVercel+1

AI infrastructure

Fast AI inference on wafer-scale chips

Free trial available; $5 promotional credit (one-time, expires 30 days after activation) for new users; PayGo credits available; Enterprise plans available by agreement. Partners include AWS Marketplace, OpenRouter, HuggingFace, and Vercel.

Cerebras (own hardware/inference); supports models including Qwen, GPT-5.6 Sol, Kimi K2.6, Codex-Spark, Meta Scout, and others

Cerebrium

TwilioPipecatLiveKitvLLM+7

AI infrastructure

Serverless GPU infrastructure for real-time AI with sub-second cold starts and instant autoscaling

Pay-per-second compute pricing. Hobby plan is free (+ compute costs). Standard plan is $100/month + compute. Enterprise is custom. GPU rates range from $0.000164/s (T4) to $0.00167/s (B200). Memory at $0.00000222/GB/s, storage at $0.05/GB/mo (first 100GB free).

Growing

DeepInfra

AI infrastructure

FAST SIMPLE RELIABLE LOW-COST AI Inference

Pay-as-you-go per-token pricing for language models (e.g. from $0.06/1M input tokens) and per-execution-time for other models; no long-term contracts or upfront costs.

Multi-provider (DeepSeek, Anthropic/Claude, Qwen, Llama, Mistral, Gemini, Kimi, Flux, Nemotron, and others)

E2B

OpenAI Agents SDKClaude CodeCodexCursor+9

AI infrastructure

The agent cloud — Every agent gets a machine

Free Hobby tier with $100 one-time usage credit (up to 1 hr sessions, 20 concurrent sandboxes). Pro at $150/month + usage billed by the second (up to 24 hr sessions, 100 concurrent sandboxes). Enterprise at custom pricing with committed usage, multi-day sessions, tens of thousands of concurrent sandboxes, and BYOC deployment.

15k

fal.ai

AI infrastructure

Generative media platform for developers — run 1,000+ image, video, audio & 3D models at lightning speed.

Serverless: pay-per-output · Compute: from $1.89/hr for H100s

PythonJavaScriptAPI

Multiple (FLUX, Kling, Seedance, Veo, Ideogram, and 1,000+ others)10M+ users

Fireworks AI

AI infrastructure

The fastest inference platform for generative AI — train, tune, and deploy open models at production scale.

Serverless inference billed per token (input/output/cached); embeddings from $0.008/1M tokens; training from $0.50/1M tokens (LoRA SFT, models up to 16B); on-demand GPU from $8.00/hr (H100) to $20.00/hr (GB300).

AzureVercel

Multiple open-source models (DeepSeek, Llama, Mistral, Qwen, GLM, Kimi, Gemma, etc.) plus closed-model API compatibility (OpenAI, Anthropic)Popular

Hedra

AI infrastructure

Inference, fine-tuning and GPU runtime for frontier visual AI models

Free plan available (no credit card). Paid plans: Basic $20/mo (2,000 credits), Pro $50/mo (7,200 credits), Ultra $100/mo (18,000 credits, up to 57,600 credits/month), Teams $75/mo (14,400 credits). Enterprise: custom pricing with dedicated support, private deployments, SSO, and more.

Hedra (proprietary frontier visual models) plus 100+ third-party models

Helicone

OpenAIAnthropicAzureLiteLLM+3

AI infrastructure

AI Gateway & LLM Observability for building reliable AI applications

Free Hobby tier (10,000 requests/mo, 1 GB storage, 1 seat); Pro at $79/mo (unlimited seats, alerts, HQL, usage-based pricing, 7-day free trial); Team at $799/mo (5 orgs, SOC-2 & HIPAA, dedicated Slack, 7-day free trial); Enterprise at custom pricing (on-prem, SAML SSO, custom MSA).

LLMRAGEnterprise Data Systems

6.2kPopular

Iris.ai

AI infrastructure

AI knowledge foundation for regulated enterprises — turning complex data into AI you can trust

EnterpriseDevAPI

Growing

Kortix

SlackMicrosoft TeamsGitHubApollo+6

AI infrastructure

The AI Command Center for Your Company

Free tier: $0/month with 500 credits/month, 1 project, no credit card required. Credits tier: $200/month for 20,000 credits (~1,830 agent-computer hours), unlimited members, unused credits roll over one month. Enterprise: custom pricing with SAML SSO, RBAC, VPC/on-prem, SLA. 1 credit = $0.01; 11 credits = 1 hour of agent compute (2 vCPU / 4 GB / 20 GB).

Model-agnostic: supports Anthropic Claude, OpenAI, Google Gemini, DeepSeek, GLM, and any OpenAI-compatible endpoint; bring your own API key or ChatGPT subscription

LiveKit

AI infrastructure

The open source framework and cloud platform for voice, video, and physical AI agents

Free tier ($0/mo, 1,000 free agent session minutes/month); Ship plan starting at $50/mo; Scale plan starting at $500/mo; Enterprise with custom pricing. Usage-based pricing per minute for agent sessions, telephony, LLM, STT, TTS, and observability.

GitHubSlack

15kGrowing

LM Studio

JavaScript SDKPython SDKCLIOpenAI API

AI infrastructure

Run AI models locally and privately on your own hardware

Free plan ($0) includes local LLMs, Bionic Agent, offline voice transcription, LM Link for up to 5 devices, and limited web search. Bionic+ is $20/month with US-hosted open source models and web search. Pro is $100/month with 5× usage limits and early access to new features. Team/organization billing available.

Local open models (llama.cpp, MLX) and US-hosted open source models (Kimi K3, GLM 5.3, DeepSeek V4 Flash/Pro, GLM 5.2)Growing

Modal

DatadogOpenTelemetryAWS MarketplaceGCP Marketplace+1

AI infrastructure

High-performance AI infrastructure with sub-second cold starts and instant autoscaling

Starter plan is $0 + compute/month (includes $30/month free credits, 3 seats, 100 containers, 10 GPU concurrency). Team plan is $250 + compute/month (includes $100/month free credits, unlimited seats, 5000 containers, 50 GPU concurrency). Enterprise is custom pricing. Compute billed per second: e.g. H100 SXM5 at $0.001097/sec, CPU at $0.0000131/core/sec, Memory at $0.00000222/GiB/sec.

NVIDIA Run:aiHuggingFaceCUDA-XNVIDIA AI Enterprise+1

NVIDIA DGX Cloud Lepton

AI infrastructure

Connect developers to a global network of GPU compute for building and deploying AI

Enterprise pricing; contact NVIDIA for details

NVIDIA10M+ users

Ollama

AI infrastructure

The easiest way to build and run open-source AI models locally

Free tier · Pro $20/mo or $200/yr · Max $100/mo

OpenClawClaude

Open-source models (Llama, Mistral, Gemma, etc.)Popular

OpenAI API

AI infrastructure

The most widely used AI API — access GPT-4o, DALL·E, Whisper, and Embeddings from OpenAI.

JavaScriptCookies

OpenAI

OpenRouter

Vercel AI SDKReplitClineElevenLabs

AI infrastructure

The Unified Interface For Every Model

Free tier (50 req/day, 25+ free models, 4 free providers); Standard plan: pay-as-you-go with 5.5% fee on credit purchases; Business plan: pay-as-you-go with 8% fee on credit purchases; Enterprise: contract-based with invoicing. Inference billed at provider list price.

Multi-provider (Anthropic, OpenAI, Google, and 80+ providers including ElevenLabs)

Plus AI

AI infrastructure

Transforming transportation with Physical AI-powered autonomous trucking

Enterprise only — contact for pricing

TRATON GROUP (Scania, MAN, International)HyundaiIVECONVIDIA

EnterpriseDev

NVIDIANiche

Portkey

GitHubAzureMongoDBDocker+3

AI infrastructure

Production stack for Gen AI builders — AI Gateway, Observability, Guardrails & more

Free tier (10k logs/month, 3-day retention); Production at $49/month (100k logs/month, 30-day retention, +$9 per additional 100k requests); Enterprise at custom pricing (10M+ logs/month, custom retention, private cloud, SSO, HIPAA, etc.)

Multi-provider (1,600+ LLMs supported via unified API)Popular

RunPod

AI infrastructure

The AI Developer Cloud — experiment, train, fine-tune, deploy, and scale on one platform

Pay-as-you-go GPU compute; Serverless has zero idle cost. See runpod.io/pricing.

Claude CodeCursor

SambaNova

OpenAI-compatible APISambaOrchestratorSambaStackSambaCloud+1

AI infrastructure

The Fastest AI Inference Platform

SambaNova (own RDU hardware; runs frontier open-weight models)

Typesense

AI infrastructure

Lightning Fast, Open Source Search

Dedicated clusters priced by memory (0.5 GB to 1024 GB), vCPUs, high availability, and Search Delivery Network options. A free cluster option is available.

JavaScriptPHPRubyGo+13