Quality Analyst

IrthUnited States only

Apply now

Opens the original posting on Himalayas.

Apply now Source: Himalayas

Apply on the original site

Companies in this catalog do not charge applicants. Never send money to apply.

QA Engineer – Insights (AI/ML)
Location: Remote (US)
Department: Insights (AI/ML)
Reports to: Engineering Manager

About the Role

Irth is building a new AI-driven threat and risk management platform for pipeline asset integrity. The platform brings together three capabilities that have historically been separate at Irth :

A governed, cross-product data platform built on Databricks and Azure
An AI-powered ingestion layer that normalizes, repairs, and enriches customer data without services-heavy onboarding

Loading job…

Quality Analyst at Irth · ApplyPick

Validate model outputs against expected results, known baselines, and golden datasets, including verification that identical inputs produce consistent and reproducible outputs.
Test edge cases throughout the risk-calculation path, including missing attributes, boundary values, unusual segment geometry, and conflicting source records.
Validate geospatial correctness, including alignment of results to pipeline centerline geometry and consequence-area assignment.
Verify AI-assisted extraction and gap-filling workflows, ensuring low-confidence outputs are routed for human review rather than silently accepted.
CI/CD & Test Automation Infrastructure
Integrate automated test suites into CI/CD pipelines with appropriate quality gates at each environment promotion.
Own test-environment configuration, data seeding, and teardown, including infrastructure-as-code contributions where appropriate.
Build and maintain the test automation framework, keeping suites fast, stable, maintainable, and trustworthy. Treat flaky tests as defects.
Report quality signals to the team, including coverage, pass rates, defect escape rate, and quality trends over time.
Release Readiness & Non-Functional Testing
Coordinate release testing and sign-off, including assessing what changed and what functionality could plausibly be affected.
Support performance and load testing of APIs and analytical workloads ahead of release milestones.
Support security testing activities, including access-control verification and tenant-isolation testing.
Verify upgrade and migration paths, including data migrations from legacy formats and systems.
Audit-Defensible Test Evidence
Produce and retain test evidence sufficient to support regulatory and audit review of risk-model outputs.
Maintain traceability from requirements through test cases and execution results.
Document validation approaches, test results, and known limitations for each model release.
Collaboration & Quality Culture
Work with Product to translate requirements into clear, concrete, and testable acceptance criteria before development begins.
Partner with engineers on testability, unit and integration coverage, and defect triage.
Advocate for quality during design reviews and identify risks early rather than waiting until the end of a sprint.
Maintain clear defect-management practices, including reproducible steps, severity assessment, impact analysis, and verification of fixes.

Quality Analyst

Apply now

About the Role

Quality Analyst

Apply now

About the Role

Key Responsibilities

Requirements

Qualifications

Required Qualifications

Preferred Qualifications

Nice to Have

Success Metrics

Success in this role will be measured by:

Apply now