Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · AI role: Traditional Software & Services

Website does not emphasize AI capabilities

700 products
Products and research metrics
ProductVisits · OctActions
LiveBench 2.0A challenging, contamination-free long-horizon AI benchmark.688.3K
Codex雷达站Observes Codex model tiers, speed, and real subscriber capability changes.605.1K
LMSYS OrgLarge Model Systems Organization - developing large models and systems that are open, accessible, and scalable.193.8K
SwanLabOSSAI experiment platform that provides experiment management, training visualization, deep learning, machine learning, hyper parameter tracking185.6K
TERMINAL-BENCHOSSTERMINAL-BENCH 5 4 3 . 1 0157.7K
PromptUpOrganize, Discover & Share AI Prompts That Work127.6K
LM SpeedQuery model scores and test AI APIs before you choose121.1K
YuppThe Yupp Story103.6K
ccusageOSSccusage Coding (Agent) CLI Usage Analysis92.1K
MintiveGive every team agents they can trust85K
Prompt OptimizerMCPReal outputs first Prompt optimization84K
MathArenaOSSUncontaminated math benchmarks for LLMs.81.4K
SessionWatcherNever Lose a Coding Session to Rate Limits75.8K
SuperCLUESuperCLUE Intelligence Index73.9K
BenchmarkListTrack AI progress with the largest database of benchmarks.65.7K
PromptomaniaMaster AI Prompts62.2K
EQ-Bench 4 LeaderboardEQ-Bench 4 Leaderboard58.4K
First Proof ProjectFirst Proof provides independent, transparent, and rigorous evaluation of AI capabilities in research mathematics.50.8K
TokenmaxxingOSSThe best place to track token usage34.1K
Hashgraph OnlineMCPOSSSecurity for AI agents, built in the open.33.9K
SharePromptNền tảng chia sẻ Prompt AI song ngữ29.9K
DrivingBenchMCPOSSCan frontier models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes29.8K
PromptFolderThe Ultimate AI Prompt Manager 🤖25.9K
RayTraceOSSYour AI says it did what you asked!! Do you trust it?23.4K
LocalScoreOSSLocalScore - Local AI Benchmark21.4K
Big Prompt HubTravel Visual Prompts & Skills20K
PinchBenchOSSThe best models for your OpenClaw agent.13.3K
ValohaiYour AI product needs a context pipeline, specialized models, and a way to know if it's giving the right answers.12.8K
Prompt SecurityOSSOne Place for Every AI Security Resource.12.6K
Warden AISafeguarding AI Transformation in HR10.6K
ProgramBenchOSS./ Program Bench10.2K
RivalOSSEvery answer every model gave to the same questions, kept after the models are gone.9.2K
SystemPromptOSSGovern your AI. Build on infrastructure you control.7.7K
EEBenchElectrical engineering agent benchmark7.4K
AI BenchySearch AI BENCHY5.5K
SWE-sweepOSSSWE- sweep5.4K
TokenomyMCPThe Economic Runtime for AI — make every AI dollar accountable.5.3K
OmniShieldStop leaking secrets into AI chat5.2K
TokonomicsStop Guessing Your AI API Costs5K
ClawMetryOSSEvery agent. Every machine. Under control.<5K
PipeLabMCPOSSOpen-source agent firewall for MCP and AI agent egress<5K
CordumMCPOSSStop AI agents before they take risky actions.<5K
FireTail//// The Complete AI Security & Governance Platform<5K
Agentic Control PlaneMCPPermissions, approvals, and cost for the coding agents you run.<5K
OpenPipeOSSThe OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.<5K
AgentLintOSSThe linter for your agent harness.<5K
FruggrGouvernance IA: suivez tous vos usages, maîtrisez vos risques, prouvez votre ROI.<5K
Prompt CannonCompare responses from multiple AI models including GPT-4, Claude, Gemini, and more.<5K
TrojControl the Chaos of Agentic AI<5K
NiyoosStop AI agents from running up your bill.<5K
Page 1 of 14 · Showing 1–50 of 700 products