Job Summary
As part of the Apple’s Power and Performance Validation team, this role will lead QA, test automation, and device lab operations supporting AI/ML workloads on advanced silicon platforms.
The position is responsible for managing test labs, automation infrastructure, performance validation, data analysis, and a team of QA and lab engineers to ensure reliable, scalable, and high-quality testing operations.
Key Responsibilities
QA, Automation, Performance Validation & Lab Operations
Scope of Responsibilities
1. Lab & Device Management
• Lead setup and maintenance of prototype and production devices for testing and validation.
• Oversee installation of test builds, device diagnostics, and validation across multiple hardware and software revisions.
• Ensure uptime, stability, and operational readiness of lab infrastructure, hosts, and test fixtures.
• Manage device inventory, hardware logistics, pick-up/return activities, and day-to-day lab operations.
• Drive documentation of lab processes, test procedures, and validation findings.
2. Automation Infrastructure Development
• Lead development and enhancement of internal Python-based automation frameworks.
• Manage automation strategy for regression, integration, performance, and system-level testing.
• Oversee CI/CD infrastructure and test integration using Jenkins, GitHub, and Ansible.
• Review and improve automation architecture for scalability, reliability, and reusability.
• Mentor engineers on automation best practices and coding standards.
3. Telemetry, Logging & Data Analysis• Oversee collection and analysis of logs, telemetry, performance traces, power metrics, and test data.
• Drive root-cause analysis of failures, regressions, and performance bottlenecks.
• Develop dashboards, reports, and quality metrics using Tableau, Metabase, PostgreSQL, and internal tools.
• Identify trends and provide actionable insights to engineering teams.
4. Test Execution (Manual & Automated)
• Manage execution of A/B, sanity, regression, integration, performance, and power test suites.
• Ensure development of comprehensive test plans, reproducible test cases, and validation procedures.
• Drive automation coverage and execution efficiency across testing programs.
• Monitor test results, track defects, and ensure traceability of validation activities.
5. Performance Bottleneck Identification
• Lead identification and debugging of performance and power regressions.
• Drive cross-functional investigations involving Software, Hardware, QA, and AI/ML teams.
• Analyze software and hardware interactions impacting system performance.
• Recommend corrective actions and process improvements to enhance product quality and performance.
Skill Requirements
Technical Skills / Tools
• Python
• Bash / Shell Scripting
• Git & GitHub
• Jenkins
• Ansible
• Linux / Unix
• CI/CD Automation
• Test Automation Frameworks• Telemetry & Log Analysis
• Performance & Power Validation
• PostgreSQL
• Tableau
• Metabase
• Confluence
• Slack
• Agile / Kanban Tools
Experience Required
• 3+ years of experience in QA, Validation Engineering, System Testing, or Test Automation.
• 1+ years of experience leading QA, Validation, or Lab Engineering teams.
• Strong experience managing hardware test labs and device validation environments.
• Expertise in Python automation, test framework development, and CI/CD processes.
• Experience with performance and power validation of complex hardware/software systems.
• Strong debugging, failure analysis, and stakeholder management skills.
• Excellent written and verbal communication skills.
Other Requirements
Preferred Qualifications
• Experience validating AI/ML workloads and machine learning systems.
• Familiarity with Apple Neural Engine (ANE) or similar AI acceleration platforms.
• Knowledge of CNN, Transformer, and Diffusion Model architectures.
• Experience with iOS/macOS environments.
• Experience supporting prototype hardware development and silicon validation programs.