Solution Architect

About the job

The Solutions Architect is APAJ's technical lead for automated quality judgment. The role partners with Quality Specialists, QOMs, Science and Engineering to move workflows from sampled batch inspection to trustworthy unit-level judgment, and acts as a Technical Bar Raiser for judge builders.

Key job responsibilities - Turn workflow requirements and conventions into judge designs, deterministic checks and transformation logic, and review difficult designs. - Streamline existing judge measurement and onboarding mechanisms — including precision measurement, judge onboarding decisions and the handoff to DCE — so they run consistently and at scale. - Provide technical input to RED certification and data-classification work for critical-data workflows. - Develop and assess judge-builder candidates; contribute reusable components, runbooks and lessons to the network.

Basic qualifications - 2+ years of design, implementation, or consulting in applications and infrastructures experience - 4+ years of specific technology domain areas (e.g. software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics) experience - 5+ years of IT development or implementation/consulting in the software or Internet industries experience - Experience using a current programming language, such as Python, to build scripts, prototypes or reusable components - Experience with large language models, prompt design or automated evaluation

Preferred qualifications - Experience working within software development or Internet-related industries - Experience working with AWS technologies from a dev/ops perspective - Experience building or evaluating ML- or LLM-based quality or evaluation systems in production - Experience interpreting precision, recall, calibration, agreement or error-analysis results - Experience with data annotation, labelling or content-quality workflows - Familiarity with data-classification, access-control or security review requirements

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.