About the Role
Prolific is building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.
We’re looking for US participants to help train and evaluate cutting-edge AI models using real accounting expertise. If you're a qualified CPA, we’ll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models.
Researchers looking for your skills tend to pay up to $75/hr per AI task completed. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.
Responsibilities
- Completing AI training tasks such as analyzing, editing, and writing annotations, grounded in accounting standards and real-world practice
- Judging the performance of AI in performing accounting-related tasks (e.g., ledger logic, reconciliation reasoning, financial statement interpretation, tax scenario analysis)
- Improving cutting-edge AI models by providing expert feedback on accuracy, compliance, and professional judgement
Requirements
- Verifiable professional experience as a fully qualified Accountant (CPA) and skilled in financial reporting, audit, tax, and management accounting
- A willingness to take a skills verification test to assess your suitability for our participant pool
- Strong attention to detail and the ability to concentrate on complex tasks for up to one hour at a time
- A reliable and fast internet connection and access to a computer
- A willingness to self-declare your earnings, as our participants are self-employed
- A Paypal account to receive payment from our clients
Nice to have experience
- Any general AI Training experience
- Accounting Domain Annotation (e.g., IFRS/UK GAAP/US GAAP concepts, audit evidence, tax rules, bookkeeping logic) skills
- Trust and Safety experience
- An understanding of Evals
- Red Teaming experience
- An understanding of quality analytics