Senior Director, Testing & Quality Engineering - Evinova

AstraZeneca

US - Boston - MAReposted Oct 30, 2026Discovered via the company's careers siteMatch locked

Full time3+ years exp

About the role

Are you ready to be part of the future of healthcare? Can you think big, be bold, and harness the power of digital and AI to tackle one of the most stubborn problems in regulated software engineering - knowing, with confidence, that what you shipped works? Then Evinova, a health tech business part of the AstraZeneca Group, might be for you. We are building software that transforms clinical trials. Evinova delivers market-leading digital health solutions that are science-based, evidence-led, and human experience-driven. Quality is not a gate at the end of our process - it is embedded in everything we build.

About Our Engineering Organization

Our Product Engineering organization consists of cross-functional squads with the people and skills needed to deliver innovative digital products to patients and healthcare providers in clinical trials worldwide. We are proud to have one of the strongest software development teams in the health tech space. This is a place where you build real things, solve hard problems, and grow alongside engineers who care deeply about their craft and its impact on patients.

About the Role

This is not a steady-state management role. We are looking for a hands-on testing leader who can consolidate a distributed testing function that has not succeeded as a distributed model, build it into a coherent high-performing organization, and run it - all at the same time. You will bring together testing teams currently embedded across squads and products into a single function with unified leadership, standards, tooling, and automation maturity. You will own the quality engineering capability across Evinova's full product portfolio - driving speed, alignment with delivery teams, and a step-change in automation coverage and AI-assisted testing. You will establish the leadership layer beneath you - Director-Level testing leads who own delivery accountability and validation processes within each product area. You will define what GA-readiness means across the portfolio and hold the line on it. If it hasn't passed your function's bar, it doesn't ship. We expect you to be the strongest quality engineering voice in the room - someone who can challenge a release decision, close a coverage gap before it becomes a customer issue, and build the testing function the organization does not yet have. You will support multiple products with competing priorities and be effective at managing the complexity that creates. This is not a role for someone who has studied multi-product quality leadership - it is a role for someone who has done it, made hard calls under pressure, and has the experience and judgment that only comes from having done it at scale. Key Responsibilities Building and Leading the Testing Function: Consolidate testing teams currently distributed across squads and products into a unified function. Establish the leadership layer beneath you - Director-Level testing leads who own delivery accountability and validation processes within each product area. Define the org structure, set the standard, and build it while running it.

Defining What “Done” Means

Own the standards that define GA-readiness across Evinova's product portfolio. Drive alignment with engineering, product, and quality on what testable and shippable actually means - and hold the line on it across all products.

Driving Test Automation

Own the shift from manual to automated functional testing across the portfolio. Set the automation roadmap. Make framework and tooling decisions. Work directly in test pipelines, CI/CD configurations, and coverage metrics. Progress across coverage, automation maturity, quality of testing, and quality of release are the primary measures of success in this role.

Owning Traceability and Audit Readiness

Establish and maintain the requirements-to-test traceability infrastructure required under GxP frameworks. Traceability is not a compliance checkbox - it is the evidence that our products actually do what they say they will do.

Building the AI Evaluation Practice

Define how AI capabilities embedded in Evinova products are tested at release and monitored in production. Build the eval frameworks, model regression testing and output validation approaches, and documentation standards that allow AI features to meet the same audit bar as everything else we ship. Our desired outcome is evaluation frameworks that include human review checkpoints - not just automated scoring.

Embedding AI Into the Testing Workflow

Use AI tooling to make your function faster and smarter - automated test generation, intelligent coverage analysis, AI-assisted QA workflows. Model the standard you expect from the org.

Defining and Owning Quality Metrics

Establish the metrics framework that makes quality visible across engineering, product, and leadership. Define what we measure, track progress over time, and use data to drive decisions - on automation coverage, defect trends, release quality, and AI evaluation outcomes.

Partnering Across Engineering, Product, Quality, and Delivery

Work across squads and functions to embed quality earlier in the delivery process. Reduce rework. Improve release confidence. Position quality engineering as an accelerant, not a bottleneck.

Minimum Qualifications

8+ years in quality engineering, software engineering, or product engineering, with at least 3 years leading a quality or testing function at senior level
Proven track record building test automation programs from low maturity - not inheriting finished ones
Demonstrated ability to consolidate fragmented testing functions across multiple teams, supporting multiple products with competing priorities
Knowledge of GxP and requirements traceability in a regulated software environment
Hands-on experience with modern test automation frameworks and CI/CD integration - you have done this, not just overseen it
Experience defining or operating evaluation frameworks for AI/ML features in production, or a demonstrable track record of building new technical practices from scratch
Bachelor's Degree in Engineering, Computer Science, or equivalent demonstrated through professional experience

Desired Qualifications

Experience with electronic Clinical Outcome Assessments (eCOA), patient-facing clinical trial software, or similar regulated healthtech
Hands-on experience with LLM evaluation frameworks, model monitoring, or agentic AI quality practices
Familiarity with ALCOA+ data integrity principles in a regulated software environment
Clinical research domain knowledge

What This Role Is Not

A pure people-management position where quality engineering runs itself and you attend the meetings. If you haven't been in the detail of a test architecture or automation pipeline in the past quarter, this role is not the right fit.
A compliance function that writes documentation after engineering has finished. You are a builder, embedded in delivery, not an auditor reviewing the output.
A tools and test automation specialist who optimises frameworks in isolation from delivery. This role requires someone who understands what is in flight across the full portfolio, balances the theoretical best tool with the reality on the ground, and has led complicated quality engineering organisations across multiple products simultaneously - not just described how they would.
A checkbox exercise in AI adoption. We need someone who has genuinely transformed their own quality engineering workflow with AI tools and can credibly lead the organization to do the same.

When we put unexpected teams in the same room, we unleash bold thinking with the power to encourage life-changing medicines. In-person working gives us the platform we need to connect, work at pace and challenge perceptions. That's why we work, on average, a minimum of three days per week from the office. But that doesn't mean we're not flexible. We balance the expectation of being in the office while respecting individual flexibility. Join us in our unique and ambitious world.

The annual base pay for this position ranges from $ 203,213.60 - $304,820.40 USD Annual. Hourly and salaried non-exempt employees will also be paid overtime pay when working qualifying overtime hours. Base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. In addition, our positions offer a short-term incentive bonus opportunity; eligibility to participate in our equity-based long-term incentive program (salaried roles), to receive a retirement contribution (hourly roles), and commission payment eligibility (sales roles). Benefits offered included a qualified retirement program [401(k) plan]; paid vacation and holidays; paid leaves; and, health benefits including medical, prescription drug, dental, and vision coverage in accordance with the terms and conditions of the applicable plans. Additional details of participation in these benefit plans will be provided if an employee receives an offer of employment. If hired, employee will be in an "at-will position" and the Company reserves the right to modify base pay (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.

Are you ready to bring new insights and fresh thinking to the table? Fantastic! We have one seat available, and we hope it's yours. Apply today.

Why Evinova (AstraZeneca)?

Evinova draws on AstraZeneca's deep experience developing novel therapeutics, informed by insights from thousands of patients and clinical researchers. Together, we accelerate the delivery of life-changing medicines and improve the design and delivery of clinical trials. By bringing our solutions to the wider healthcare community, we help build unified approaches to digital technology in life sciences. Join us on our journey of building a new kind of health tech business to reset expectations of what a bio-pharmaceutical company can be.

Date Posted

28-Oct-2026

Closing Date

10-Nov-2026 Our mission is to build an inclusive environment where equal employment opportunities are available to all applicants and employees. In furtherance of that mission, we welcome and consider applications from all qualified candidates, regardless of their protected characteristics. If you have a disability or special need that requires accommodation, please complete the corresponding section in the application form.

Not included in the source posting: benefits.

Skills

artificial-intelligenceci-cdllmmachine-learningqa

Who can apply

The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.

Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.