Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · AI role: AI-Native Core

AI is the primary way the product delivers its core job

550 products
Products and research metrics
ProductVisits · OctActions
LMSYS Chatbot ArenaGiantExperience the frontier35.8M
Prompt CowboyTurn lazy prompts into great ones1.1M
Shannon AIShannon AI Expert-Level Uncensored AI390K
ArenaExperience the frontier344.1K
PrompTessorMCPGet Better Results Without Paying for a More Expensive AI Model321.3K
Generate Prompt AIAI Prompt Generator284.3K
PortkeyProduction Stack for Gen AI Builders195.7K
Energent.aiCatch AI hallucinations before they cost you195.3K
CollibraThe enterprise standard for AI context and control188.3K
Hume AIIntroducing the first audio-native decision model188K
G0DM0DEG0DM0D3 is an open-source research tool for studying LLM output steering and safety evaluation.128.2K
Evidently AIOpen-source AI evaluation and observability116.5K
Prompt BuilderCraft perfect prompts in seconds113.1K
PromptfooOSSShip agents, not vulnerabilities107.8K
HarborOSSharbor: evaluate agents in sandboxed environments97.9K
Confident AIMCPShip better AI as a team. Not as individuals.83.4K
CekuraMCPTest, Monitor and Self Improve voice agents73.2K
Orq.aiMCPControl AI. Ship software.71.8K
Prompt GenieStop burning tokens on bad prompts67.7K
CoarenaWatch two computer-use agents work on your research .59K
Prompt PerfectGet Better Results From AI Faster51.5K
LatitudeMCPOSSMake your AI agents self-healing48.2K
Extra HeadroomOSSHeadroom cuts your Claude Code & ChatGPT Codex token costs ~50%47.9K
AgentaOSSAI coworkers that learn how you work.45.8K
RaindropMCPOSSDetect agent issues. Prevent them from happening.42.8K
RunlayerThe operating layer for AI40.6K
KindoPut AI to work. Keep the enterprise in control.31.3K
Find Your FrontierFind your frontier30.5K
WardstoneGuard your AI, end to end25.1K
Iguazio AI PlatformOSSBringing AI to Life23.9K
LabgenExtract prompts from any image, collect Prompts from any website, manage and reuse them efficiently19K
OpikMCPThe Fastest Path to Agents That Work17.9K
PROMPTMETHEUSPrompt Engineering IDE17.1K
OpenMarkMCPOSSFind the cheapest AI model that actually works on your task16.1K
BenchgenOSSThe Benchmarking Infrastructure for AI Agents11.6K
Questa AIThe privacy firewall between your sensitive data and any AI.11.1K
WaldAI is everywhere. Is your business data protected?8.6K
Constellation Gate AIOSSGet your under control.8.5K
BotGaugeStop agent failures before they ship.7.6K
AgentmemoryleaderboardOSSMeasure what your agents remember. Compare what truly matters.7.3K
Weave.AIOSSDecision Intelligence for Enterprise Risk7.2K
PromptaaAI Prompt Management6.9K
Tiny AI ArenaOSSDid you ever click on an “AI Arena” expecting glorious battle and instead get a boring benchmark?6.4K
ScorecardThe simulation platform for agent self-improvement6.3K
PrivaroThe AI Governance Platform for enterprise privacy5.9K
VelatirThe system for everything AI5.5K
Olam LabsScaling Simulated Worlds5.2K
Overseer AIMaking AI safer.<5K
ClyroOSSDeploy Autonomous AI with Confidence.<5K
Prediction GuardScale your fleet of agents. Never lose control.<5K
Page 1 of 11 · Showing 1–50 of 550 products