Apache Spark Developer - Scala, Python
HCLTech
Gautam Buddha Nagar, Uttar Pradesh, IndiaPosted 28 days agoDiscoveredMatch locked
Full-time
Job Summary
The Developer will be responsible for developing and implementing applications using apache spark, scala, and python. The primary focus will be on coding, testing, and debugging software programs for complex data processing and analytics tasks.
Key Responsibilities
- Develop efficient code using apache spark, scala, and python for data processing applications.
- Collaborate within team to gather and understand requirements for software development projects.
- Implement data pipelines and etl processes to extract, transform, and load data from various sources.
- Optimize and tune application performance for largescale data processing workflows.
- Troubleshoot and debug issues to ensure the software meets quality and performance standards.
- Stay updated on emerging technologies and best practices in data engineering and analytics.
Skill Requirements
- Knowledge of apache spark for distributed data processing.
- Programming skills in scala for developing scalable applications.
- In-depth knowledge of python programming language for data manipulation and analytics.
- Familiarity with working with big data technologies and frameworks.
- Understanding of data structures, algorithms, and software design principles.
- Good analytical and problem-solving abilities.
- Good communication and teamwork skills.
Other Requirements
1.Cloudera Certified Developer for Apache Spark (CCD) certification is a plus.
Not included in the source posting: about the role, benefits.
Skills
sparkpythonscalaetl
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.