ScholarCatalyst evaluates whether AI systems can identify prior papers whose ideas could meaningfully advance an early-stage research project. Unlike conventional scientific retrieval benchmarks, ScholarCatalyst focuses on literature inspiration retrieval: identifying papers that may not be topically similar to a query, but offer the insight needed to formulate or advance a new research direction.
ScholarCatalyst/ScholarCatalyst: benchmark instances and annotations