Job Summary
Key Responsibilities
2. Design Scalable Data Pipelines And Advanced Analytics Workflows Utilizing Databricks, Python, And Spark Sql To Support Complex Data Processing And Machine Learning Initiatives.
3. Define And Enforce Architectural Standards, Governance, And Compliance Measures For Databricks-Based Solutions, Ensuring Security And Data Quality.
4. Lead Technical Reviews Of Architecture And Design Deliverables, Providing Expert Guidance On Databricks Platform Optimization And Best Practices.
5. Collaborate With Business Stakeholders To Translate Strategic Objectives Into Technical Requirements And Databricks-Based Solutions.
6. Drive Adoption Of New Features And Emerging Technologies Within The Databricks Ecosystem, Ensuring Continuous Improvement And Innovation.
7. Mentor And Train Technical Teams On Databricks, Spark, And Python, Fostering Skill Development And Ensuring Delivery Excellence.
Skill Requirements
2. Excellent Knowledge Of Apache Spark For Distributed Data Processing And Analytics.
3. Advanced Proficiency In Python For Data Engineering, Etl, And Machine Learning Tasks.
4. Strong Understanding Of Data Governance, Security, And Compliance In CloudBased Data Platforms.
5. Excellent Ability To Design And Optimize LargeScale Data Pipelines And Workflows.
6. Architectural Leadership In Integrating Databricks With Enterprise Data Sources And Bi Tools.
Other Requirements
2. Microsoft Azure Solutions Architect Expert Or Aws Certified Solutions Architect (Optional But Valuable)