Privacy Policy

Agents' Last Exam is a research project by UC Berkeley's Center for Responsible, Decentralized Intelligence (RDI). This policy covers the website at agents-last-exam.org, account access, workflow submissions, and related research services.

Account information: your authentication identifier, email address, and name. If you choose to provide them, we also collect your affiliation, job title, and professional profile link.

Contribution information: workflow descriptions, uploaded files, reference outputs, evaluation rubrics, review feedback, and other material you submit. We also receive messages you send to our team.

Technical information: website requests, browser and device details, IP-related information, page views, and interactions used to operate, secure, and understand the website. Cookies and similar technologies support authentication and analytics.

Google sign-in is optional and is handled by our authentication provider, Clerk. When you choose it, we request openid, userinfo.email, and userinfo.profile permissions. These provide your Google account identifier, email address and verification status, and basic profile information such as your name and profile picture when available. Clerk manages authentication, and our application receives the account information needed to identify you.

These sign-in permissions do not authorize access to your Gmail messages, Google Drive files, contacts, or calendars. We do not receive your Google password.

We use Google sign-in information to authenticate you, maintain your account, associate submissions with your account, manage access, and communicate with you about your account and contributions. We do not sell Google user data, use it for advertising, or use it to train generalized artificial intelligence or machine learning models.

We use information to provide account access, save and review submissions, evaluate workflows, administer contributor recognition and applicable awards, respond to questions, prevent abuse, and improve the website and benchmark.

If you use AI-assisted drafting, evaluation, or review features, the prompts and task content needed for those features are processed by the model and service providers that power them. Google sign-in profile data is not an input to those features. Do not submit confidential material or personal data that you are not authorized to share.

We use Clerk for authentication, Vercel for website hosting, Google Cloud for backend and file storage services, and database and AI service providers for application operations. These providers process the information needed for their roles. Authorized project staff and reviewers access account or contribution information as needed to administer and review contributions.

The website uses Google Analytics and Microsoft Clarity to understand usage and improve usability. They can process page views, browser and device information, approximate location, and interaction or session information using cookies and similar technologies, subject to your browser settings.

Accepted workflow content may be released as part of the public research benchmark under the Contributor Terms. Public contributions and contributor credits are distinct from private authentication records; submitting a workflow does not itself publish your Google sign-in credentials or authentication tokens.

We may disclose information when required by law or as necessary to protect the security, rights, or safety of the project and its users. We do not sell personal information.

Account and application data are stored with our authentication, hosting, database, and storage providers and may be processed outside your country. We use HTTPS for website connections and access controls to limit private account and submission data to authorized users and administrators. No transmission or storage system can guarantee absolute security.

We retain account and private submission information while it is needed to provide the service, administer contributions, support research operations, or meet security and legal obligations. You can contact us to request access, correction, or deletion of your account information and private data. We may need to verify your identity before acting on a request.

Some information may need to be retained for legal obligations, security records, or research integrity. Content already released in the benchmark, publications, or third-party copies may remain available under the contribution license. Removing Google access does not automatically delete your existing project account or published contributions.

You can review or update the profile information available in your account, request help with account data by email, and revoke Google sign-in access through your Google Account connections settings. After revocation, Google sign-in may require you to authorize access again.

Your browser lets you manage cookies and other site storage. Blocking authentication cookies can prevent sign-in; limiting analytics cookies can affect usage measurement. Your privacy rights depend on your location, and you can contact us to exercise applicable rights.

We will update this page and its date when our privacy practices change. Please review it before providing new information or using new features.