Job Summary
Sr. Data EngineerDatabricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQLData ModelingOpen table formats: Delta Lake and IcebergCloud technologies: Azure is preferredData virtualization schemesDatabricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQLConfig driven data pipelinesDatabricks Genie conversational tool for AI driven insights using no code/low-code and code completion options using GitHub CopilotData Modeling: Star Schema and Snowflake SchemaOpen table formats: Delta Lake and IcebergCloud technologies: Azure is preferredData virtualization schemes
Key Responsibilities
2. To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure successful delivery of complex projects.
3. To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
4. To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure & closure of escalations.