Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · Product form: Web App

Name: Prompts, Evals & LLM Observability SaaS & AI Software Market Benchmark Dataset
Creator: EarlyLore

Product formWeb App607 API175 CLI Tool106 SDK104 MCP Server68 Chrome Extension51 macOS App30 Windows App22

607 products

Products and research metrics
Product	Tagline	Visits · Oct	MoM	Domain reg.	Revenue
LMSYS Chatbot ArenaGiantarena.aiExperience the frontier	Experience the frontier	35.8M	Up19.4%	2017-12	Undisclosed
Prompt Cowboypromptcowboy.aiTurn lazy prompts into great ones	Turn lazy prompts into great ones	1.1M	Down22.4%	2025-02	Undisclosed
LiveBench 2.0livebench.aiA challenging, contamination-free long-horizon AI benchmark.	A challenging, contamination-free long-horizon AI benchmark.	824.6K	—	2024-05	Undisclosed
LangfuseMCPOSSlangfuse.comOpen Source Agent Evals &Observability	Open Source Agent Evals &Observability	722.9K	Down12.8%	2023-04	Undisclosed
Codex雷达站codexradar.com查看雷达站正在改什么：工单分组内全部工单的阶段、进展与最近变化。	查看雷达站正在改什么：工单分组内全部工单的阶段、进展与最近变化。	605.1K	Down31.5%	2026-06	Undisclosed
Pydantic Logfirepydantic.devPydantic Build agents you’ll actually ship to production	Pydantic Build agents you’ll actually ship to production	454.4K	—	2022-04	Undisclosed
Shannon AIshannon-ai.comShannon AI Expert-Level Uncensored AI	Shannon AI Expert-Level Uncensored AI	390K	Up12.5%	2025-10	$4,185
Arenalmarena.aiExperience the frontier	Experience the frontier	385.7K	Up15.4%	2024-06	Undisclosed
禾维 AIhvoy.aiAI大模型检测与对比	AI大模型检测与对比	235.1K	—	2025-05	Undisclosed
Portkeyportkey.aiProduction Stack for Gen AI Builders	Production Stack for Gen AI Builders	216.1K	Down4.5%	2022-12	Undisclosed
LM Speedlmspeed.netQuery model scores and test AI APIs before you choose	Query model scores and test AI APIs before you choose	201.5K	Down13.5%	2025-02	Undisclosed
MLflowOSSmlflow.orgDeliver High-Quality AI, Fast	Deliver High-Quality AI, Fast	196.6K	Up5.6%	2018-04	Undisclosed
Energent.aienergent.aiCatch AI hallucinations before they cost you	Catch AI hallucinations before they cost you	195.3K	Down7.3%	2025-02	Undisclosed
Yuppyupp.aiThe Yupp Story	The Yupp Story	191.1K	Up7.0%	2024-06	Undisclosed
G0DM0DEgodmod3.aiG0DM0D3 is an open-source research tool for studying LLM output steering and safety evaluation.	G0DM0D3 is an open-source research tool for studying LLM output steering and safety evaluation.	189.2K	—	2024-06	Undisclosed
Collibracollibra.comThe enterprise standard for AI context and control	The enterprise standard for AI context and control	188.3K	Down22.7%	2007-06	$100M/yrClaimed
SwanLabOSSswanlab.cnAI experiment platform that provides experiment management, training visualization, deep learning, machine learning, hyper parameter tracking	AI experiment platform that provides experiment management, training visualization, deep learning, machine learning, hyper parameter tracking	177.1K	—	2023-11	Undisclosed
PrompTessorMCPpromptessor.comGet Better Results Without Paying for a More Expensive AI Model	Get Better Results Without Paying for a More Expensive AI Model	174.4K	Up322%	2025-05	Undisclosed
BridgeBenchbridgebench.aiBridgeBench: the official AI benchmark of the vibe coding movement	BridgeBench: the official AI benchmark of the vibe coding movement	143.8K	Up43.6%	2026-03	Undisclosed
Future AGIMCPOSSfutureagi.comBuild self-improving agents. Catch what breaks. Know why. Fix it. Ship smarter every time.	Build self-improving agents. Catch what breaks. Know why. Fix it. Ship smarter every time.	121.7K	Down7.8%	2022-12	Undisclosed
Prompt Genieprompt-genie.comStop burning tokens on bad prompts	Stop burning tokens on bad prompts	100.1K	Up0.7%	2023-03	Undisclosed
SuperCLUEsuperclueai.comSuperCLUE Intelligence Index	SuperCLUE Intelligence Index	93.7K	—	2023-05	Undisclosed
Prompt Builderpromptbuilder.ccCraft perfect prompts in seconds	Craft perfect prompts in seconds	92.5K	Up0.8%	2025-06	Undisclosed
PromptLayerpromptlayer.comThe collaboration layer for AI engineering teams	The collaboration layer for AI engineering teams	90.1K	Down24.5%	2022-12	Undisclosed
Prompt OptimizerMCPalways200.comReal outputs first Prompt optimization	Real outputs first Prompt optimization	84K	Down0.1%	2023-10	Undisclosed
Confident AIMCPconfident-ai.comShip better AI as a team. Not as individuals.	Ship better AI as a team. Not as individuals.	83.4K	Down3.3%	2023-08	Undisclosed
HeliconeOSShelicone.aiBuild Reliable AI Apps	Build Reliable AI Apps	76.4K	Down10.3%	2022-11	Undisclosed
Mintivemintmcp.comGive every team agents they can trust	Give every team agents they can trust	75K	—	2025-07	Undisclosed
CekuraMCPcekura.aiTest, Monitor and Self Improve voice agents	Test, Monitor and Self Improve voice agents	73.2K	Down18.9%	2025-02	Undisclosed
Orq.aiMCPorq.aiControl AI. Ship software.	Control AI. Ship software.	70K	—	2024-02	Undisclosed
BenchmarkListbenchmarklist.comTrack AI progress with the largest database of benchmarks.	Track AI progress with the largest database of benchmarks.	65.7K	Down9.7%	2025-02	Undisclosed
Coarenacoarena.aiWatch two computer-use agents work on your research .	Watch two computer-use agents work on your research .	59K	Down33.5%	2026-08	Undisclosed
World of AI Benchwoaibench.aiWhich AI model should you build with?	Which AI model should you build with?	58.7K	Down20.6%	2026-05	Undisclosed
MathArenaOSSmatharena.aiUncontaminated math benchmarks for LLMs.	Uncontaminated math benchmarks for LLMs.	52.6K	—	2025-02	Undisclosed
OpenlayerOSSopenlayer.comEvery AI system in your company.	Every AI system in your company.	51.7K	Up10.8%	2006-04	Undisclosed
NeuralTrustneuraltrust.aiOpen your enterprise to AI agents. Safely.	Open your enterprise to AI agents. Safely.	51K	Up26.9%	2024-02	Undisclosed
SpacePromptsspaceprompts.comSave, organize, and reuse every prompt that works.	Save, organize, and reuse every prompt that works.	47.1K	Down18.8%	2025-05	Undisclosed
Claude TunerOSSclaudetuner.comKnow when your AI limit hits — and when it's back	Know when your AI limit hits — and when it's back	46.5K	Up2.5%	2026-02	Undisclosed
AgentaOSSagenta.aiAI coworkers that learn how you work.	AI coworkers that learn how you work.	45.8K	Up29.5%	2023-03	Undisclosed
Alationalation.comLet's Get Your AI Right	Let's Get Your AI Right	43.6K	Down19.2%	1998-07	Undisclosed
Wardstonewardstone.aiGuard your AI, end to end	Guard your AI, end to end	42.9K	Down19.0%	2026-01	Undisclosed
ArcjetMCPOSSarcjet.comAgents can act. Arcjet decides whether they should.	Agents can act. Arcjet decides whether they should.	39K	Down29.2%	2011-09	Undisclosed
Oso CloudOSSosohq.comVisibility and controls to secure agents.	Visibility and controls to secure agents.	37.2K	Down23.3%	2019-01	Undisclosed
NeuronpediaOSSneuronpedia.orgExplore, visualize, and steer the internals of AI models.	Explore, visualize, and steer the internals of AI models.	36.9K	Down11.0%	2023-06	Undisclosed
AgnostMCPagnost.aiYour Agents, Self-Improving.	Your Agents, Self-Improving.	30.3K	Down7.3%	2025-08	Undisclosed
LangWatchOSSlangwatch.aiTrace, test, route and govern every LLM call in your company, from your own agents to the coding assistants your engineers use.	Trace, test, route and govern every LLM call in your company, from your own agents to the coding assistants your engineers use.	30.1K	Up9.4%	2023-09	Undisclosed
DrivingBenchMCPOSSdrivingbench.comCan frontier models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes	Can frontier models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes	29.8K	Up52.9%	2026-09	Undisclosed
Prompt SecurityOSSprompt.securityOne Place for Every AI Security Resource.	One Place for Every AI Security Resource.	27.6K	Up53.4%	2023-07	Undisclosed
PromptFolderpromptfolder.comThe Ultimate AI Prompt Manager 🤖	The Ultimate AI Prompt Manager 🤖	27.5K	—	2023-07	Undisclosed
SharePromptshareprompt.netNền tảng chia sẻ Prompt AI song ngữ	Nền tảng chia sẻ Prompt AI song ngữ	26.7K	Prev <5K	2025-04	Undisclosed

Page 1 of 13 · Showing 1–50 of 607 products