Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · Domain Registered 2–5 Years Ago

225 products
Products and research metrics
ProductVisits · OctActions
LiveBench 2.0A challenging, contamination-free long-horizon AI benchmark.688.3K
LangfuseMCPOSSOpen Source Agent Evals &Observability586K
Vals AIVals AI independently tests AI models on real-world work. Explore benchmark results, model comparisons and research across coding, finance454K
Pydantic LogfirePydantic Build agents you’ll actually ship to production356.6K
ArenaExperience the frontier344.1K
PortkeyProduction Stack for Gen AI Builders195.7K
LMSYS OrgLarge Model Systems Organization - developing large models and systems that are open, accessible, and scalable.193.8K
SwanLabOSSAI experiment platform that provides experiment management, training visualization, deep learning, machine learning, hyper parameter tracking185.6K
G0DM0DEG0DM0D3 is an open-source research tool for studying LLM output steering and safety evaluation.128.2K
Future AGIMCPOSSBuild self-improving agents. Catch what breaks. Know why. Fix it. Ship smarter every time.121.7K
PromptfooOSSShip agents, not vulnerabilities107.8K
YuppThe Yupp Story103.6K
PromptLayerThe collaboration layer for AI engineering teams85.9K
Prompt OptimizerMCPReal outputs first Prompt optimization84K
Confident AIMCPShip better AI as a team. Not as individuals.83.4K
NeuralTrustOpen your enterprise to AI agents. Safely.74.5K
SuperCLUESuperCLUE Intelligence Index73.9K
Orq.aiMCPControl AI. Ship software.71.8K
Prompt GenieStop burning tokens on bad prompts67.7K
PromptomaniaMaster AI Prompts62.2K
EQ-Bench 4 LeaderboardEQ-Bench 4 Leaderboard58.4K
HeliconeOSSBuild Reliable AI Apps57.2K
RagasOSSOpen source framework for testing and evaluating LLM applications.52.9K
LangWatchOSSTrace, test, route and govern every LLM call in your company, from your own agents to the coding assistants your engineers use.52.1K
Prompt PerfectGet Better Results From AI Faster51.5K
Judgment LabsThe continuous-improvement stack for agents. Monitor and improve your agent's behavior at scale.47.4K
AgentaOSSAI coworkers that learn how you work.45.8K
KindoPut AI to work. Keep the enterprise in control.31.3K
NeuronpediaOSSExplore, visualize, and steer the internals of AI models.28.6K
PromptFolderThe Ultimate AI Prompt Manager 🤖25.9K
PromptAITools that help AI users write and refine prompts.24.3K
OpikMCPThe Fastest Path to Agents That Work17.9K
Prompt SecurityOSSOne Place for Every AI Security Resource.12.6K
promptpandaConsistent AI Marketing, Powered by Team Prompt Management7.9K
SystemPromptOSSGovern your AI. Build on infrastructure you control.7.7K
BotGaugeStop agent failures before they ship.7.6K
Athina AIMonitor LLMs and automatically detect hallucinations in prod6.9K
PromptDrivePrompt collaboration: ChatGPT, Claude, and Gemini in one place5.3K
TokenomyMCPThe Economic Runtime for AI — make every AI dollar accountable.5.3K
LangtailOSSPrompt management for product teams<5K
OneAIWorldOne Prompt. Every AI Model.<5K
PromptWise.aiAI prompt enhancer for ChatGPT<5K
ComposoMCPOSSTeaching machines the human definition of quality.<5K
PromptOwlMCPEvery AI your team uses should already know your business — and you should be able to prove what it knows.<5K
RESKOpen-Source LLM Security, Enforced at the Token Level<5K
NeoPromptSearch 150,000+ quality AI prompts and get ready for the AI Era! Produce better outputs, save on time & API costs.<5K
ThisorthisWhich AI is the best?<5K
Adeptiv AIGovern Every AI Agent Application<5K
llmlab.ioEntry point to large language model experiments and reference materials.<5K
Avon AIBook a live demo of AvonAI — AI agent governance, monitoring, and observability giving enterprises full control over GenAI in production.<5K
Page 1 of 5 · Showing 1–50 of 225 products