Senior Design Lead
India
Job Description
Senior Design Lead
Bangalore, Karnataka
Job Summary
We are looking for an experienced ETL Architect to design, build, and govern large-scale data processing platforms on AWS. The ideal candidate will have deep expertise in Amazon EC2, Amazon EMR, Apache Spark, data lake architectures, and enterprise ETL frameworks. The role requires strong hands-on experience with Parquet and Avro data formats, schema management, data versioning, and high-performance data pipelines supporting analytics and business-critical workloads.
AWS Technologies
- Amazon EC2
- Amazon EMR
- Amazon S3
- AWS IAM
- CloudWatch
- AWS Glue (preferred)
Big Data Technologies
- Apache Spark
- Spark SQL
- PySpark / Scala Spark
- Hadoop ecosystem fundamentals
Data Formats
- Strong hands-on experience with:
- Parquet
- Avro
- Schema evolution and optimization techniques
ETL & Data Integration
- Enterprise ETL Architecture
- Data Ingestion Frameworks
- Batch & Streaming Processing
- Data Quality Frameworks
Data Governance & Versioning
- Data Lineage
- Data Cataloging
- Dataset Versioning
- Metadata Management
- Audit & Compliance Controls
Programming & Databases
- Python
- Scala (preferred)
- SQL
- Data Warehouse Concepts
Key Responsibilities
We are looking for an experienced ETL Architect to design, build, and govern large-scale data processing platforms on AWS. The ideal candidate will have deep expertise in Amazon EC2, Amazon EMR, Apache Spark, data lake architectures, and enterprise ETL frameworks. The role requires strong hands-on experience with Parquet and Avro data formats, schema management, data versioning, and high-performance data pipelines supporting analytics and business-critical workloads.
Skill Requirements
Other Requirements
Information at a Glance