Description review
Quantitative Researcher, Evidence Synthesis & Meta-Analysis
American Institutes for Research · US-Remote | US-VA-Arlington | US-NC-Chapel Hill | US-IL-Chicago | US-CA-Sacramento | US-TX-Austin · back to the listing
HR standards
64/100
needs work
Title ↔ description
78/100
solid
Reads as
Unclear
no confident match
What this role officially is
data scientist — ESCO, the EU occupation classification
Data scientists find and interpret rich data sources, manage large amounts of data, merge data sources, ensure consistency of data-sets, and create visualisations to aid in understanding data. They build mathematical models using data, present and communicate data insights and findings to specialists and scientists in their team and if required, to a non-expert audience, and recommend ways to apply the data.
Also known as: data scientists, data engineer, research data scientist, data expert, data research scientist
How others title the same work
Large employers
- Data Scientist - Algorithms, Community Support Airbnb
- Data Scientist - Inference, Community Support Airbnb
- Senior Data Scientist, Guest & Host Airbnb
- Senior Data Scientist, Trust (Inference) Airbnb
- Data Scientist, Analytics (Technical Leadership) Meta
Startups
- Amplify Renewables | Quantitative Researcher | SF / Seattle / US | Hybrid (Remote Possible) | Full-Time | $200k - $375k (all cash) Amplify Renewables
- Senior Data Scientist BoldVoice
- Senior Research Neuroscientist ANORIA
- Quantitative Associate Corgi Insurance
- Senior Data Scientist Coulomb AI
What the listing never says
- 24 bullet points. Long requirement lists deter qualified candidates, who read them as hard gates. Scope clarity
- No pay range published. Candidates cannot tell whether applying is worth their time. Pay transparency
The listing, marked up
Nothing in the wording of this listing tripped a check. The scores above still judge how complete and coherent it is.
AIR is seeking a Quantitative Researcher to contribute to rigorous evidence synthesis and quantitative research across a range of education projects. The Quantitative Researcher will design and conduct systematic reviews and meta-analyses, evaluate the quality and strength of research evidence, and apply advanced quantitative methods to impact evaluations. The role will collaborate with researchers, subject matter experts, and clients to translate complex evidence into clear, actionable insights that inform education policy, programs, and practice.
This position has the flexibility to work remotely within the United States (U.S.) or from one of our U.S. office locations. This does not include U.S. territories.
About AIR:
Founded in 1946 and headquartered in Arlington, Virginia, the American Institutes for Research (AIR) is a nonpartisan, not-for-profit organization that conducts behavioral and social science research and delivers technical assistance to address some of the most pressing challenges in the United States and globally. We generate evidence and apply data-driven solutions that expand opportunities and improve lives for all.
Responsibilities:
• Develop research designs and study protocols for evidence synthesis across education, workforce, and health programs and topic areas.
• Design and implement transparent, reproducible evidence synthesis workflows, including literature screening, data extraction, quality assessment, effect-size calculation, and meta-analysis.
• Apply appropriate methods to extract and synthesize evidence from diverse research designs, including randomized controlled trials, quasi-experimental studies (e.g., regression discontinuity designs), single-case designs, and other quantitative research approaches.
• Conduct meta-analyses using advanced statistical methods and software, including methods for assessing heterogeneity, exploring variation in effects, and evaluating selective reporting bias.
• Develop and apply evidence review frameworks, study quality standards, and evidence-rating criteria for evidence clearinghouses, research syntheses, and related initiatives.
• Contribute to the design and implementation of impact evaluations, including randomized controlled trials and quasi-experimental studies, using appropriate quantitative methods to estimate program impacts.
• Collaborate with clients and subject matter experts to develop and refine evidence review criteria and processes that align with project goals and policy needs.
• Contribute to the design, testing, and improvement of tools and software that support evidence synthesis workflows and methods.
• Develop and deliver training and other professional learning activities related to evidence synthesis methods and tools.
• Prepare written materials (e.g., technical reports and policy briefs) that communicate findings in ways that are accessible and useful to policymakers and other decision makers.
• Present findings to clients, professional associations, and the public.
• Manage or lead projects and tasks, assuming greater responsibility for project management over time.
• Participate in, and where appropriate lead, efforts to develop research proposals that generate external funding for evidence synthesis and impact evaluation studies.
• Mentor and support junior staff by providing methodological guidance, sharing approaches to solving problems, and providing feedback on their work.
Qualifications:
Education, Knowledge, and Experience
• A Master’s degree with at least 4 years of relevant experience, or a Ph.D., in education, statistics, research methods, or a related field, with demonstrated experience conducting systematic reviews and meta-analyses.
• Experience conducting key components of systematic reviews and meta-analyses, including literature screening, study coding, data extraction, effect-size calculation, and quantitative synthesis.
• Knowledge of diverse quantitative research designs, including randomized controlled trials and quasi-experimental designs, and demonstrated ability to assess study quality and apply quantitative methods in impact evaluation and evidence synthesis.
• Experience applying evidence standards, review criteria, or evidence-rating frameworks in research syntheses, evidence clearinghouses, or related initiatives.
• Demonstrated ability to communicate complex methodological concepts and research findings clearly, both orally and in writing, to technical and non-technical audiences.
Skills
• Expertise in advanced evidence synthesis methods, including meta-analytic modeling, assessment of heterogeneity and variation in effects, and evaluation of selective reporting bias.
• Ability to assess methodological rigor across a range of study designs and translate research evidence into transparent, defensible evidence ratings or recommendations.
• Ability to apply appropriate quantitative methods to the design and analysis of impact evaluations, including experimental and quasi-experimental studies.
• Experience with or interest in applying AI-enabled tools to support literature screening, coding, data extraction, or other components of evidence synthesis.
• Proficiency in a statistical programming language or software (e.g., R) and ability to learn and apply new statistical and methodological tools as needed across projects.
Disclosures: Applicants must be currently authorized to work in the U.S. on a full-time basis. Employment-based visa sponsorship (including H-1B sponsorship) is not available for this position. Depending on project work, qualified candidates may need to meet certain residency requirements.
American Institutes for Research is an equal employment opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without discrimination on the basis of any characteristic protected by applicable federal, state, or local law, including, but not limited to, actual or perceived race (including traits historically associated with race, such as hair texture, hair type, and protective hairstyles such as braids, locs, and twists), creed, color, religion, alienage or national origin, ancestry, citizenship status, age, physical or mental disability, medical condition (e.g., cancer), sex, gender, gender identity or expression (including transgender status), sexual orientation, marital status, civil union status, pregnancy, childbirth or related medical conditions, genetic information, or military or veteran status. AIR adheres to strict child safeguarding principles. All selected candidates will be expected to adhere to these standards and principles and will therefore undergo reference and background checks. AIR maintains a drug-free work environment.
ACCESSIBILITY NOTICE: If you need a reasonable accommodation for any part of the employment process due to a physical or mental disability, please send an email to [email protected] or call 202.403.5000.
Fraudulent Job Scams Warning & Disclaimer: AIR is aware of individuals falsely presenting themselves as AIR representatives. Fraudulent job scams seek to extract sensitive information or money from victims. To protect yourself, please be aware that AIR recruitment will only email you from an "@air.org" domain. Please take extra caution while examining the email address. For example, [email protected] is correct, while [email protected] is not a legitimate AIR email address. If you are unsure of the legitimacy of a communication you have received, please reach out to [email protected].
If you see a job scam, or lose money to one, report it to the Federal Trade Commission (FTC) at ReportFraud.ftc.gov. You can also report it to your state attorney general. Learn more about how to avoid scams at ftc.gov/scams.
#LI-DP1 #LI-REMOTE
AIR’s Total Rewards Program, is designed to reward our staff competitively and motivate them to achieve our critical mission. This position offers the anticipated annual salary as listed. Salary offers are made based on internal equity within the institution and external equity with competitive markets. Please note this is the annual salary range for candidates that are based in the United States.
Anticipated Annual Salary Range
$87,000—$110,000 USD
This position has the flexibility to work remotely within the United States (U.S.) or from one of our U.S. office locations. This does not include U.S. territories.
About AIR:
Founded in 1946 and headquartered in Arlington, Virginia, the American Institutes for Research (AIR) is a nonpartisan, not-for-profit organization that conducts behavioral and social science research and delivers technical assistance to address some of the most pressing challenges in the United States and globally. We generate evidence and apply data-driven solutions that expand opportunities and improve lives for all.
Responsibilities:
• Develop research designs and study protocols for evidence synthesis across education, workforce, and health programs and topic areas.
• Design and implement transparent, reproducible evidence synthesis workflows, including literature screening, data extraction, quality assessment, effect-size calculation, and meta-analysis.
• Apply appropriate methods to extract and synthesize evidence from diverse research designs, including randomized controlled trials, quasi-experimental studies (e.g., regression discontinuity designs), single-case designs, and other quantitative research approaches.
• Conduct meta-analyses using advanced statistical methods and software, including methods for assessing heterogeneity, exploring variation in effects, and evaluating selective reporting bias.
• Develop and apply evidence review frameworks, study quality standards, and evidence-rating criteria for evidence clearinghouses, research syntheses, and related initiatives.
• Contribute to the design and implementation of impact evaluations, including randomized controlled trials and quasi-experimental studies, using appropriate quantitative methods to estimate program impacts.
• Collaborate with clients and subject matter experts to develop and refine evidence review criteria and processes that align with project goals and policy needs.
• Contribute to the design, testing, and improvement of tools and software that support evidence synthesis workflows and methods.
• Develop and deliver training and other professional learning activities related to evidence synthesis methods and tools.
• Prepare written materials (e.g., technical reports and policy briefs) that communicate findings in ways that are accessible and useful to policymakers and other decision makers.
• Present findings to clients, professional associations, and the public.
• Manage or lead projects and tasks, assuming greater responsibility for project management over time.
• Participate in, and where appropriate lead, efforts to develop research proposals that generate external funding for evidence synthesis and impact evaluation studies.
• Mentor and support junior staff by providing methodological guidance, sharing approaches to solving problems, and providing feedback on their work.
Qualifications:
Education, Knowledge, and Experience
• A Master’s degree with at least 4 years of relevant experience, or a Ph.D., in education, statistics, research methods, or a related field, with demonstrated experience conducting systematic reviews and meta-analyses.
• Experience conducting key components of systematic reviews and meta-analyses, including literature screening, study coding, data extraction, effect-size calculation, and quantitative synthesis.
• Knowledge of diverse quantitative research designs, including randomized controlled trials and quasi-experimental designs, and demonstrated ability to assess study quality and apply quantitative methods in impact evaluation and evidence synthesis.
• Experience applying evidence standards, review criteria, or evidence-rating frameworks in research syntheses, evidence clearinghouses, or related initiatives.
• Demonstrated ability to communicate complex methodological concepts and research findings clearly, both orally and in writing, to technical and non-technical audiences.
Skills
• Expertise in advanced evidence synthesis methods, including meta-analytic modeling, assessment of heterogeneity and variation in effects, and evaluation of selective reporting bias.
• Ability to assess methodological rigor across a range of study designs and translate research evidence into transparent, defensible evidence ratings or recommendations.
• Ability to apply appropriate quantitative methods to the design and analysis of impact evaluations, including experimental and quasi-experimental studies.
• Experience with or interest in applying AI-enabled tools to support literature screening, coding, data extraction, or other components of evidence synthesis.
• Proficiency in a statistical programming language or software (e.g., R) and ability to learn and apply new statistical and methodological tools as needed across projects.
Disclosures: Applicants must be currently authorized to work in the U.S. on a full-time basis. Employment-based visa sponsorship (including H-1B sponsorship) is not available for this position. Depending on project work, qualified candidates may need to meet certain residency requirements.
American Institutes for Research is an equal employment opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without discrimination on the basis of any characteristic protected by applicable federal, state, or local law, including, but not limited to, actual or perceived race (including traits historically associated with race, such as hair texture, hair type, and protective hairstyles such as braids, locs, and twists), creed, color, religion, alienage or national origin, ancestry, citizenship status, age, physical or mental disability, medical condition (e.g., cancer), sex, gender, gender identity or expression (including transgender status), sexual orientation, marital status, civil union status, pregnancy, childbirth or related medical conditions, genetic information, or military or veteran status. AIR adheres to strict child safeguarding principles. All selected candidates will be expected to adhere to these standards and principles and will therefore undergo reference and background checks. AIR maintains a drug-free work environment.
ACCESSIBILITY NOTICE: If you need a reasonable accommodation for any part of the employment process due to a physical or mental disability, please send an email to [email protected] or call 202.403.5000.
Fraudulent Job Scams Warning & Disclaimer: AIR is aware of individuals falsely presenting themselves as AIR representatives. Fraudulent job scams seek to extract sensitive information or money from victims. To protect yourself, please be aware that AIR recruitment will only email you from an "@air.org" domain. Please take extra caution while examining the email address. For example, [email protected] is correct, while [email protected] is not a legitimate AIR email address. If you are unsure of the legitimacy of a communication you have received, please reach out to [email protected].
If you see a job scam, or lose money to one, report it to the Federal Trade Commission (FTC) at ReportFraud.ftc.gov. You can also report it to your state attorney general. Learn more about how to avoid scams at ftc.gov/scams.
#LI-DP1 #LI-REMOTE
AIR’s Total Rewards Program, is designed to reward our staff competitively and motivate them to achieve our critical mission. This position offers the anticipated annual salary as listed. Salary offers are made based on internal equity within the institution and external equity with competitive markets. Please note this is the annual salary range for candidates that are based in the United States.
Anticipated Annual Salary Range
$87,000—$110,000 USD