AI Safety Reviewer — English and Urdu Job at AuraOne Human Data, Remote

QkJNdWkyTnUvMVAvYk5qaC9HelJ0d21FSlE9PQ==
  • AuraOne Human Data
  • Remote

Job Description

AI Safety Reviewer — English and Urdu is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for AI Safety Reviewer — English and Urdu assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for AI Safety Reviewer — English and Urdu work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Urdu generalist evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$16–$22 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Remote job, For contractors, 10 hours per week

Similar Jobs

Gulfstream

Summer 2027 - IEF - SE&I / Human Factors Collegiate Intern Job at Gulfstream

 ...Engineering Computer Engineering Computer Science Industrial Engineering Industrial & System Engineering Preference: Psychology for MS or PhD will be considered if candidate is pursuing undergrad in engineering. Psychology for BS will be considered if... 

Mercy Health (Ohio and Kentucky)

EKG Technician - Radiology - Clermont Hospital Job at Mercy Health (Ohio and Kentucky)

 ...Support American Heart Association (required) Education High school graduate or GED (required) Work Experience 1 of year of EKG experience (preferred) Training Use and comprehend basic computer applications and diagnose common EKG equipment problems.... 

Houston Methodist

Staff Pharmacist - Central Pharmacy Job at Houston Methodist

Full Time - Days At Houston Methodist, the Staff Pharmacist position is responsible for providing day-to-day comprehensive, patient-oriented, pharmacy services in any or all areas of the department which includes processing orders, therapy review, and education to patients... 

Two Maids - Miami Beach

Professional House Cleaner Job at Two Maids - Miami Beach

 ...family-like work environment where you can thrive. No cleaning experience? No problem! Our five-day training will turn you into a...  ...With Us: ~$550$700/week + tips (avg $16$22/hr) ~ Part-time to Full-time , MonFri daytime hours no nights, weekends, or... 

West Valley-Mission Community College District

Dean, Public Safety, Health & Wellness Job at West Valley-Mission Community College District

 ...Dean, Public Safety, Health & Wellness The School of Public Safety, Health, and Wellness at Mission College seeks a highly competent...  ...of identified programs, faculty, staff, facilities, budget, policies, and procedures. The Dean works closely with faculty, staff...