Qualitative Coding Assistant

Northeastern

0 - 3 years

Massachusetts

Posted: 16/07/2026

Job Description

About the Opportunity

Job Summary

You will serve as the ground truth for AI validation by manually coding student simulation transcripts using detailed rubrics. This role requires meticulous attention to detail, strong qualitative analysis skills, and the ability to apply complex coding schemes consistently. Your ratings establish the validity benchmark against which AI scoring will be evaluated.

Key Responsibilities & Accountabilities

Study and internalize 18-indicator rubrics across 3 skill domains
Code 50–80 student simulation transcripts using detailed rubric criteria
Participate in calibration sessions to establish inter-rater reliability
Document edge cases and ambiguous scenarios requiring rubric clarification
Provide systematic feedback on rubric usability and clarity
Identify indicators with low inter-rater agreement requiring revision
Calculate inter-rater reliability metrics, including Cohen's kappa and intraclass correlation coefficient (ICC)
Compare human versus AI ratings to identify systematic differences
Contribute to validation methodology documentation
Support qualitative findings write-up for research reports

Minimum Qualifications

Required

Master’s degree or Doctor of Education (EdD) in Education, Economics, Public Policy, Psychology, Sociology, Communication, or related social science
Demonstrated experience with qualitative coding using established frameworks such as thematic analysis, content analysis, or discourse analysis
Familiarity with inter-rater reliability concepts and procedures
Strong writing skills for documentation and analytical memos
Ability to work independently while maintaining consistency across coding sessions
Comfort with ambiguity during iterative rubric refinement

Preferred

Experience with education assessment or program evaluation
Background in adolescent development or youth workforce development
Training in qualitative analysis software such as MAXQDA, NVivo, or ATLAS.ti
Understanding of psychometric concepts, including validity, reliability, and construct definition

Position Type

Temporary

Additional Information

Northeastern University considers factors such as candidate work experience, education and skills when extending an offer.

Northeastern has a comprehensive benefits package for benefit eligible employees. This includes medical, vision, dental, paid time off, tuition assistance, wellness & life, retirement- as well as commuting & transportation. Visit https://hr.northeastern.edu/benefits/ for more information.

All qualified applicants are encouraged to apply and will receive consideration for employment without regard to race, religion, color, national origin, age, sex, sexual orientation, disability status, or any other characteristic protected by applicable law.

This job is for a current or anticipated job vacancy.

Pay Rate:

$25/hour

About Company

Founded in 1898, Northeastern University is a globally recognized research university and a leader in experiential lifelong learning, combining academic excellence with real-world experience through its renowned cooperative education (co-op) programs. With 14 campuses across the United States, the United Kingdom, and Canada, a network of over 300,000 alumni, and more than 3,000 industry, academic, and government partners worldwide, the university fosters innovation, research, and global collaboration. Northeastern offers undergraduate, graduate, and doctoral programs across a wide range of disciplines, emphasizing the integration of data, technology, and human-centered learning to prepare students for the careers of the future. As an R1 Carnegie-classified research institution, it is committed to addressing complex global challenges through interdisciplinary research and impactful partnerships.