Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · Target audience: Developers & Engineering Teams

315 products
Products and research metrics
ProductVisits · OctActions
LangfuseMCPOSSOpen Source Agent Evals &Observability722.9K
Pydantic LogfirePydantic Build agents you’ll actually ship to production454.4K
Shannon AIShannon AI Expert-Level Uncensored AI390K
Hume AIIntroducing the first audio-native decision model220.7K
LM SpeedQuery model scores and test AI APIs before you choose201.5K
SwanLabOSSAI experiment platform that provides experiment management, training visualization, deep learning, machine learning, hyper parameter tracking, metric recording, and AI team collaboration tools to improve the efficiency of AI model development.177.1K
PrompTessorMCPGet Better Results Without Paying for a More Expensive AI Model174.4K
TERMINAL-BENCHOSSTERMINAL-BENCH 5 4 3 . 1 0162.2K
PromptfooOSSShip agents, not vulnerabilities136.2K
SessionWatcherNever Lose a Coding Session to Rate Limits96.5K
Confident AIMCPShip better AI as a team. Not as individuals.83.4K
HeliconeOSSBuild Reliable AI Apps76.4K
MintiveGive every team agents they can trust75K
World of AI BenchWhich AI model should you build with?74K
CekuraMCPTest, Monitor and Self Improve voice agents73.2K
OpenlayerOSSEvery AI system in your company.51.7K
Claude TunerOSSKnow when your AI limit hits — and when it's back46.5K
AgentaOSSAI coworkers that learn how you work.45.8K
Extra HeadroomOSSHeadroom cuts your Claude Code & ChatGPT Codex token costs ~50%45.2K
WardstoneGuard your AI, end to end42.9K
ArcjetMCPOSSAgents can act. Arcjet decides whether they should.39K
Oso CloudOSSVisibility and controls to secure agents.37.2K
LangWatchOSSTrace, test, route and govern every LLM call in your company, from your own agents to the coding assistants your engineers use.30.1K
PinchBenchOSSThe best models for your OpenClaw agent.25.9K
Hashgraph OnlineMCPOSSSecurity for AI agents, built in the open.24.1K
AI Security GuardUsing AI agents? Protect yourself at all times.20.9K
Big Prompt HubTravel Visual Prompts & Skills20K
DrivingBenchMCPOSSCan frontier models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes, then evaluate them on a fixed cone course.19.5K
Audn.AIOSSProtecting Open-ended Interfaces to Intelligent Systems18.5K
OpikMCPThe Fastest Path to Agents That Work17.9K
Free LLM PlaygroundFree instant access to 50+ models from top LLM providers. No signup, no API keys. Side-by-side compare, share links, transparent daily limits.16.4K
BenchgenOSSThe Benchmarking Infrastructure for AI Agents11.6K
TokenCostCount tokens for GPT-5, Claude, Gemini, Llama & 147+ models. Compare API costs instantly.9.5K
BotGaugeStop agent failures before they ship.7.6K
AgentmemoryleaderboardOSSMeasure what your agents remember. Compare what truly matters.7.3K
SuperCompressMCPOSSCut your API Costs by 65%.7.2K
FoglampOSSKnow what your agents are doing7.2K
SpanTurn eng time and tokens into better outcomes7.1K
PapayaContinuously improve your agents.6.9K
Athina AIMonitor LLMs and automatically detect hallucinations in prod6.9K
RelyableBulletproof AI voice agents.6.3K
TokenMaxxerSee where all your tokens actually go5.8K
LockLLMAll-in-One AI Proxy<5K
omiumYour agent said it worked.Did it?<5K
ClawMetryOSSEvery agent. Every machine. Under control.<5K
TracklyFind what's wrong with your AI — and fix it.<5K
ClyroOSSDeploy Autonomous AI with Confidence.<5K
TokenomyMCPThe Economic Runtime for AI — make every AI dollar accountable.<5K
MoyaiYou have observability. You don't have reliability.<5K
PromptToolsFree AI prompt tools + 21 dev utilities. No signup, ever.<5K
Page 1 of 7 · Showing 1–50 of 315 products