Materials Writer - Engineering FRQ Job at AuraOne Human Data, Remote

  • AuraOne Human Data
  • Remote

Job Description

Materials Writer - Engineering FRQ is a remote evaluation track for reviewing materials writer engineering frq evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn materials writer engineering frq evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate materials writer engineering frq evaluation model outputs against a versioned rubric and assign severity tags for Materials Writer - Engineering FRQ assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on materials writer engineering frq evaluation or adjacent content for Materials Writer - Engineering FRQ work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two materials writer engineering frq evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • Materials Writer Engineering FRQ evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$85 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Remote job, For contractors, 10 hours per week

Similar Jobs

MCKESSON

Research Pharmacist Job at MCKESSON

 ...foundation of our success. By joining our growing team at Sarah Cannon Research Institute (SCRI), a subsidiary of McKesson, you will have the...  ...redefining cancer care around the world. As the Research Pharmacist you will oversee the investigational pharmacy operations and... 

Urban Health Plan

Medical Assistant - Pediatrics Job at Urban Health Plan

Job DescriptionJob ID#:4598Job Category:Medical Assistant and Phlebotomist PositionsPosition Type:Employee (Full...  ...Medical Assistant (Bilingual English/Spanish) to join our Pediatrics Division at El Nuevo San Juan (ENSJ). Minimum Qualifications... 

URBN

Anthropologie Brand Marketing Intern Job at URBN

 ...passion for expressing brand messaging through a social media lens, and interest in publishing and scheduling across social platforms. About the Summer Internship Program: Each summer URBN Inc. welcomes candidates from across the country to immerse themselves within...

Tropical Smoothie Cafe

Shift Lead Job at Tropical Smoothie Cafe

 ...have the perfect opportunity for you! Tropical Smoothie Caf is a leading brand in the Food & Beverage industry, inspiring a healthier lifestyle with amazing food and delicious smoothies. As a Shift Leader, you will play a key role in delivering on our promise by embodying... 

fira-health

Physical Therapy Assistant (PTA) Job at fira-health

 ...Role: Physical Therapy Assistant (PTA) Schedule: Full-time MondayFriday + occasional weekends (as needed) Location: Field Based Compensation (Productivity Points): $58.00 / point | $75,000-$100,000/year Who We Are: Adaptive Home Health is building a...