Job Summary
Job Description: Dataricks AI app developer (Lake Base)
About Epiroc:
Epiroc is a mining and infrastructure equipment company with its global headquarters in Stockholm, Sweden. It is a global productivity partner for mining and infrastructure customers in more than 150 countries. In India it has its corporate head office in Pune with manufacturing centers in Nashik and Hyderabad. It also has an engineering center in Bengaluru catering to all the divisions of Epiroc.
Epiroc’s history began in 1873, by previously being a part of Atlas Copco. Today, it plays a vital role in creating a sustainable society by not only providing innovative and safe equipment, but also solutions for automation, digitalization and electrification in the mining and construction equipment industry.
Mission:
To design, build, and maintain scalable data pipelines and develop secure AI applications on the Databricks platform using Lakehouse architecture and Lake base-backed application data, enabling intelligent, governed, and data-driven enterprise applications.
Key Responsibilities:
- Develop and support AI and analytical applications on Databricks Apps.
- Build analytical applications such as IMC apps, predictive services, and business dashboards.
- Develop applications that interact with Lake base datasets for transactional and operational use cases.
- Design solution architecture for hybrid data platforms combining Unity Catalog (analytical) and Lake base (operational) data.
- Design application logic to read/write data from Lake base and Unity Catalog governed data sources.
- Develop CI/CD pipelines for data engineering and application deployment using Azure DevOps
- Integrate Lakehouse analytical data with Lake base operational data within applications.
- Build and maintain RAG indexes and onboard new data sources.
- Monitor and maintain robust data pipelines and ETL processes to support business and product requirements.
- Ensure data quality, consistency, and compliance with enterprise standards.
- Collaborate with cross-functional teams to align data engineering efforts with project roadmaps and timelines.
Qualification and Experience
- Bachelor’s or Master’s degree in computer science engineering with 6+ years of experience
- Proficiency in programming languages: Python, PySpark, and SQL.
- Experience with data engineering tools, including Azure DataBricks, Azure DevOps, and VS Code.
- Experience working with Lakehouse architecture and hands-on experience with Lake base data or similar transactional data systems.
- Experience building apps using Streamlit, Dash, or Gradio.
- Knowledge of React, Node.js, or Express frameworks.
- Understanding of Databricks Apps deployment concepts.
- Hands-on experience with RAG architecture and vector databases
- Familiarity with cloud-based data platforms and scalable data architecture.
Personality requirement:
Ability to adapt to new working environments and technologies is crucial, as are your outstanding written and verbal communication skills. As a team player, you'll maintain transparent communication, providing daily updates within the team and towards stakeholders. Your customer-focused approach, coupled with an adaptable and flexible mindset, will be key in handling the varied work environment. A collaborative, good-natured, and helpful attitude, along with a transparent mindset in all situations, sets the tone for success. Your ability to handle critical and urgent situations effectively and calmly rounds out the qualities we value
Location:
- Bengaluru /Hyderabad