Senior Apache Spark Technical Lead - Scala, Python
Ireland
Apply now
Job Description
Senior Apache Spark Technical Lead - Scala, Python
Dublin, Leinster

Job Summary

The Senior Technical Lead at HCL will be responsible for leading technical teams and projects related to apache spark, scala, and python. The role involves overseeing the design, development, and implementation of scalable and efficient solutions using these technologies.

Key Responsibilities

As a Sr. Data Engineer, you will:

Lead the scoping, design and implementation of complex features
Lead and push the boundaries of analytics and powerful, scalable applications
Design and implement intuitive, responsive UIs that allow issuers to better understand data and analytics
Build and maintain analytics and data models to enable performant and scalable products
Ensure a high-quality code base by writing and reviewing performant, well-tested code
Mentor junior software engineers and teammates
Drive innovative improvements to team development processes
Partner with Product Managers and Customer Experience Designers to develop a deep understanding of users and use cases and apply that knowledge to scoping and building new modules and features
Collaborate across teams with exceptional peers who are passionate about what they do

Skill Requirements

5+ years of full stack engineering experience in an agile production environment
Experience leading the design and implementation of large, complex features in full-stack applications
Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
Experience leveraging open source tools, predictive analytics, machine learning, Advanced Statistics, and other data techniques to perform analyses
• High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
• Experience with cloud data platforms such as Databricks, and Snowflake
• Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
Experience coaching and mentoring junior teammates
Experience leading a large technical effort that spans multiple people and teams
Proficiency with Java/Spring Boot, .NET/C#, React, Redux, Typescript, and SQL Server or other object-oriented languages, front-end frameworks, and/or relational database technologies
Strong technologist with proven track record of learning new technologies and frameworks
Customer-centric development approach
Passion for analytical / quantitative problem solving
Experience identifying and implementing technical improvements to development processes
Collaboration skills with experience working with people across roles and geographies
Motivation, creativity, self-direction, and desire to thrive on small project teams
Superior academic record with a degree in Computer Science or related technical field
Strong written and verbal English communication skills

Other Requirements

Proficiency with Java/Spring Boot, .NET/C#, React, Redux, Typescript, and SQL Server or other object-oriented languages, front-end frameworks, and/or relational database technologies
Apply now
Information at a Glance

Why HCLTech?

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 226,300 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2025 totaled $14.5 billion.
23 Benefits At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to: https://rmkcdn.successfactors.com/147eb21f/a701dca9-f32d-4fc9-9447-6.svg Industry-benchmarked compensation https://rmkcdn.successfactors.com/147eb21f/b0c54381-ddcc-4a33-9b35-9.svg Best-in-class healthcare benefits https://rmkcdn.successfactors.com/147eb21f/b73027be-7aae-4d36-a090-4.svg Personal time off https://rmkcdn.successfactors.com/147eb21f/d5b4fdfd-2e99-4e26-9878-9.svg Maternity and paternity benefits https://rmkcdn.successfactors.com/147eb21f/3d42b0fc-4652-435a-9ece-c.svg Access to skills / higher education programs/resources https://rmkcdn.successfactors.com/147eb21f/aeddeaf2-9e25-4584-ad11-d.svg Discounts on products and services via Benefit Box https://rmkcdn.successfactors.com/147eb21f/a9609a3b-2700-4b3c-9d90-a.svg Participate in CSR programs and live life with a purpose https://rmkcdn.successfactors.com/147eb21f/c6e33851-710f-4634-bd69-f.svg Opportunities to grow and advance your career Note: The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.