Senior Technical Specialist
Senior Technical Specialist
Job Summary
- 10+ years overall/relevant experience, with substantial Data Engineering experience as we look for Engineer IV
- Strong hands-on Azure Data Engineering
- Strong Azure Data Factory
- Python
- PySpark/Spark
- Advanced SQL
- Data modelling
- ETL/ELT and data pipeline engineering
- Strong database engineering experience
- Evidence of handling senior/complex engineering responsibilities, not just executing predefined development tasks
Key Responsibilities
Strongly preferred
- PostgreSQL
- Azure-native data services beyond ADF
- Designing scalable data pipelines and data platforms
- Performance optimisation
- CI/CD and engineering practices for data workloads
- Architecture/design ownership
Skill Requirements
|
Area |
What the evaluator appears to expect |
Importance |
|
Experience |
10+ years relevant Data Engineering experience |
Critical |
|
Cloud |
Strong Microsoft Azure Data Engineering background |
Critical |
|
Data integration |
Azure Data Factory (ADF) |
Critical |
|
Big-data engineering |
PySpark / Spark |
High |
|
Programming |
Strong Python |
High |
|
Database |
PostgreSQL / relational database engineering / SQL |
High |
|
Data modelling |
Strong data modelling and database design fundamentals |
High |
|
ETL/ELT |
Hands-on building and designing enterprise-grade data pipelines |
High |
|
Azure ecosystem |
Broader Azure services around data engineering, not just exposure to ADF |
High |
|
Architecture / seniority |
Ability to demonstrate technical depth appropriate to Engineer IV |
Critical |
|
Snowflake / dbt |
Useful, but not sufficient as the core skill set |
Secondary |
|
AWS / S3 |
Useful additional experience, but does not compensate for lack of Azure |
Secondary |
Other Requirements
- Design and implement normalized/dimensional data models (3NF, star/snowflake schemas) on PostgreSQL for transactional and analytical workloads
- Write and optimize complex SQL (queries, stored procedures, indexing strategies, partitioning) for performance at scale
- Build and maintain CI/CD pipelines for database schema changes, migrations, and deployments (e.g., using Git, Jenkins/GitHub Actions, Flyway/Liquibase)
- Containerize and manage database and data-pipeline services using Docker/Kubernetes; support infrastructure-as-code (Terraform/Ansible) for environment provisioning
- Monitor database health, automate backups/recovery, and manage environment promotion (dev → QA → prod)
-
- data modeling and PostgreSQL administration/development
- Strong SQL and schema design skills (normalization, indexing, query optimization)
Hands-on DevOps experience: CI/CD, containerization (Docker), version control (Git), scripting (Bash/Python
- Working knowledge of cloud platforms (Azure/AWS/GCP) for hosting and pipeline automation
- Exposure to Power BI (data modeling, DAX basics, Power Query) is a strong plus ( Nice to Have)