AI & Intelligent Systems

AI evaluation

Measurement frameworks, benchmarks and auditing methods for the capability, reliability, safety and social effects of AI systems.

Suggested Research Directions

For author inspiration

These prompts illustrate questions within scope. They are not published papers, reserved titles or guarantees of acceptance; submissions must present original evidence and methods.

  1. 01Reproducible evaluation under model updates
  2. 02Task-valid benchmarks for deployed AI
  3. 03Inter-rater agreement in human evaluation
  4. 04Stress-testing for rare but consequential failures
  5. 05Cost and energy per successful outcome

Published Research

0 closely matched

No published article is currently classified specifically under this topic. Relevant original submissions are welcome for human-supervised peer review.