← back to paper

Review history

arxiv: 2607.28545 · 2 revisions

ORCA-bench: How Ready Are Language Model Agents for Oncall?

1. 2026-08-06 CONDITIONAL MODERATE v1.4.0-alltime-deepseek-medium novelty 6.0
   192480 ms 34794 in 19505 out 2026-08-06T04:13:08.555214+00:00
2. 2026-07-31 CONDITIONAL HIGH v1.2.0-daily-grok45 novelty 7.0
   86849 ms 37966 in 4126 out 2026-07-31T04:04:23.687433+00:00