Apache Spark Technical Specialist - Scala, Python
India
Job Description
Apache Spark Technical Specialist - Scala, Python
Job Summary
This role involves working as a Technical Specialist with expertise in apache spark, scala, and python. The primary responsibilities include developing, implementing, and maintaining data pipelines, performing data analysis, and ensuring the scalability and efficiency of data processing tasks using apache spark and related technologies.
Key Responsibilities
1. Develop and implement data processing applications using apache spark, scala, and python.
2. Design and maintain scalable data pipelines to process large volumes of data efficiently.
3. Perform data analysis and optimization to enhance the performance of data processing tasks.
4. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions.
5. Troubleshoot and resolve issues related to data processing and data quality.
6. Stay updated with the latest advancements in apache spark, scala, and python to continuously improve data processing capabilities.
2. Design and maintain scalable data pipelines to process large volumes of data efficiently.
3. Perform data analysis and optimization to enhance the performance of data processing tasks.
4. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions.
5. Troubleshoot and resolve issues related to data processing and data quality.
6. Stay updated with the latest advancements in apache spark, scala, and python to continuously improve data processing capabilities.
Skill Requirements
1. Proficiency in apache spark for big data processing and analytics.
2. Strong programming skills in scala for developing scalable applications.
3. Advanced knowledge of python programming for data manipulation and analysis.
4. Experience with data processing frameworks and tools in the apache spark ecosystem.
5. Understanding of distributed computing principles and parallel data processing.
6. Excellent problem-solving skills and ability to work in a fast paced environment.
7. Strong communication skills and ability to collaborate effectively with team members.
2. Strong programming skills in scala for developing scalable applications.
3. Advanced knowledge of python programming for data manipulation and analysis.
4. Experience with data processing frameworks and tools in the apache spark ecosystem.
5. Understanding of distributed computing principles and parallel data processing.
6. Excellent problem-solving skills and ability to work in a fast paced environment.
7. Strong communication skills and ability to collaborate effectively with team members.
Other Requirements
Information at a Glance
23
Benefits
At HCLTech, we believe in empowering our employees with comprehensive benefits that support their professional growth and enhance their well-being. When you sign up for a career with us, you gain access to:
https://rmkcdn.successfactors.com/147eb21f/a701dca9-f32d-4fc9-9447-6.svg
Industry-benchmarked compensation
https://rmkcdn.successfactors.com/147eb21f/b0c54381-ddcc-4a33-9b35-9.svg
Best-in-class healthcare benefits
https://rmkcdn.successfactors.com/147eb21f/b73027be-7aae-4d36-a090-4.svg
Personal time off
https://rmkcdn.successfactors.com/147eb21f/d5b4fdfd-2e99-4e26-9878-9.svg
Maternity and paternity benefits
https://rmkcdn.successfactors.com/147eb21f/3d42b0fc-4652-435a-9ece-c.svg
Access to skills / higher education programs/resources
https://rmkcdn.successfactors.com/147eb21f/aeddeaf2-9e25-4584-ad11-d.svg
Discounts on products and services via Benefit Box
https://rmkcdn.successfactors.com/147eb21f/a9609a3b-2700-4b3c-9d90-a.svg
Participate in CSR programs and live life with a purpose
https://rmkcdn.successfactors.com/147eb21f/c6e33851-710f-4634-bd69-f.svg
Opportunities to grow and advance your career
Note : The benefits listed above vary depending on the nature of your employment and the country where you work. Some benefits may be available in some countries but not in all.