Job Summary
Job description:
Designing, building, and maintaining robust ETL (extract, transform, load) pipelines to process large-scale data.
Deploying and monitoring machine learning models in production environments.
Managing data warehouses, data lakes, and storage systems.
Ensuring data integrity, security, and compliance with organizational standards.
Working with data scientists, analysts, and software engineers to turn prototypes into functional products.
High proficiency in Python and SQL.
Experience with Azure
Familiarity with Spark, Hadoop, and distributed systems.
Experience with CI/CD tools, containerization (Docker, Kubernetes), and monitoring tools
Key Responsibilities
2. Design and optimize sql queries for efficient data retrieval and manipulation.
3. Utilize python programming for automation and data processing tasks.
4. Implement devops solutions to streamline development and deployment processes.
5. Manage and optimize snowflake data warehouse for scalability and performance.
Skill Requirements
2. Strong sql skills for database querying and management.
3. Advanced knowledge of python programming for automation and data manipulation.
4. Experience with devops solutions for continuous integration and deployment.
5. Handson experience with snowflake data warehouse for managing and optimizing large datasets.