Job Summary

.FG 2929

Scope of Work

As a Data Engineer in the CoDev Data Team, you’ll deliver privacy-compliant data products, maintain pipelines for driver feedback and car signals, and ensure data quality and uptime. These data products may include attributes such as software version, distance driven, drive cycle duration, and common identifiers for each driving cycle. Owner with communication and leadership tasks.
More specifically, you will design and develop data pipelines to create business-aligned data products that meet company standards and governance, using the time series source-aligned data product. These data products may include attributes such as software version, distance driven, driver duration, and common identifiers for each driving cycle. You will also implement monitoring metrics to ensure data quality and track usage and costs, document the implementation per team guidelines, and prepare for handover. 
In this role it is important that you would bring experience with containerization (Docker) and building modern, scalable data pipelines using tools such as Databricks, Snowflake or Airflow. Furthermore, this role also requires hands on experience working with times series data and vehicle signals. 

Assignment and Scope

•    Deliver CoDev Data Products: 
Provide quality-assured, privacy-compliant data in raw and refined formats for internal users.
•    Maintain Data Pipelines 
Ingest driver feedback and car signal/diagnostic data.
Ensure uptime and data quality for reports and dashboards.
•    Automation & Platform Reliability
Design, implement, and maintain CI/CD pipelines for data products and platform components.
Automate testing, deployment, monitoring, and operational workflows to improve reliability and reduce manual work.
•    Production ownership and lifecycle management
Own and maintain production-grade data products and pipelines.
Monitor, troubleshoot, and resolve production issues.
Continuously improve reliability, performance, observability, and operational efficiency.
•    Continuous improvement of ways of working
Identify and introduce improvements in engineering practices, tooling, architecture, and team ways of working.
Drive standardization, knowledge sharing, and best practices across the team.
•    Data Documentation 
Create descriptive overviews of datasets for stakeholder clarity.
•    Collaboration 
Work closely with data engineers, software teams, architects, and stakeholders.
•    Support Leadership 
Assist Product Owner and Engineering Manager with communication and stakeholder needs.
•    Technical Development 
Design scalable solutions, improve datasets, and explore new tools.

Key Responsibilities

The assignment implies following Data Engineer responsibilities:

•    Deliver privacy-compliant CoDev data products in raw and refined formats. 
•    Maintain and improve data pipelines for driver feedback and car signal/diagnostic data. 
•    Ensure data quality, uptime, and reliability of reports and dashboards. 
•    Document datasets and provide clear overviews for stakeholders. 
•    Collaborate with data engineers, software teams, architects, and product users. 
•    Support the Product Owner with stakeholder communication and leadership tasks. 
•    Design scalable solutions and continuously improve datasets and tools.
•    Independently investigate open questions, validate assumptions, and propose technical solutions.
•    Drive topics from problem identification through implementation with limited supervision.

Skill Requirements

Required skills:

•    Strong expertise in Python, version control (Git/Gerrit), and CI/CD pipelines using tools such as Jenkins and GitHub Actions.
•    Experience with containerization (Docker) and building modern, scalable data pipelines using tools such as Databricks or Airflow. 
•    Solid background in system design, programming, and database interfacing, with autonomy to design solutions and improve datasets. 
•    Proficient in data visualization (Power BI), API management, and SQL; skilled in handling large datasets and developing robust workflows. 
•    Hands-on experience with Azure cloud services, Snowflake, and test program development. 
•    Analytical mindset with a passion for exploring new tools and methods to deliver stakeholder value. 
•    MSc degree in Data Science, Computer Science, Data Engineering, Mathematics, or equivalent; fluent in English. 
•    Familiarity with UDS diagnostic communication protocol (automotive industry).

Other Requirements

Mapped to VCC FG 2029