Study Details — Assessing the Quality of Human- and AI-Generated Peer Reviews at AAAI 2026

Last updated: <08/20/2025> • IRB Protocol #: STUDY00007931

This research study has been reviewed by The University of Texas at Austin Institutional Review Board, and determined that this protocol meets the criteria for exemption from IRB review under 45 CFR 46.104 (2)(i) Tests, surveys, interviews, or observation (non-identifiable).

What is this study about?

We are comparing the usefulness and factual accuracy of peer-review reports written by humans versus those drafted with large-language-model (AI) assistance. Findings will help AAAI and other AI conferences refine future reviewing practices.

What will I do if I participate?

Will my responses be anonymous?

Yes. We do not collect any identifiable information — names, email addresses, IPs, or other direct identifiers. De-identified data are stored on password-protected IRB-approved servers accessible only to the research team.

What are the risks?

The study poses no more than minimal risk — similar to completing any short, anonymous online questionnaire. You may skip any question or stop at any time without penalty. Participation in the survey will have no bearing on the paper decisions.

Are there any benefits or compensation?

There is no direct compensation. Your feedback may improve the fairness and quality of future peer-review processes.

Do I have to participate?

No. Participation is optional, and choosing not to participate will not affect the outcomes of the review process in any way. You may withdraw at any point by closing the survey window.

Who can I contact with questions?