Data Science Expert – Remote Contractor

About the role

We are partnering with a leading AI research organization to evaluate how well AI systems can perform real‑world data‑science tasks. As a Data Science Expert you will not deliver analyses yourself; instead you will define rigorous grading criteria and score AI‑generated and human work samples, providing clear written justifications.

Key responsibilities

• Design precise, task‑specific grading rubrics for deliverables such as analyses, models, dashboards, experiment readouts and written recommendations.
• Score AI‑generated and human work samples against those rubrics, documenting detailed, evidence‑based justifications for each score.
• Apply consistent judgment to ensure scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on grading criteria.

Required profile

• 5+ years of professional data‑science experience, preferably in business operations, product or growth roles at top‑tier technology companies.
• Deep fluency in experiment design, A/B testing, metric definition, and SQL/Python analysis.
• Exceptional written communication and a detail‑oriented mindset.
• Prior experience with AI training, evaluation or human‑data projects is a strong plus.

Required skills

• Python
• SQL
• Experiment design
• A/B testing
• Metric definition
• Data analysis

What we offer

• Independent contractor engagement with full remote flexibility.
• Ability to work on your own schedule.
• Weekly payments via Stripe or Wise based on services rendered.