Senior Consultant - FSI

About this role

Data Technology Lead : Spark

Summary:

This role will be responsible for Leading a team for development, and maintenance of Spark, Hadoop and Hive applications.

The ideal candidate should have:

· Strong technology delivery experience with Spark, Python, Hive, Hadoop, and the Hadoop ecosystem. They will also be familiar with data modeling, data wrangling, and data analysis.

· Experience with both SAS and Python and will be able to work lead a team.

Responsibilities

• · Team Lead, develop, and maintain Pyspark and Hive applications.
• · Work with data scientists and analysts to build data pipelines and data models.
• · Optimize Pyspark and Hive queries for performance.
• · Troubleshoot and debug Pyspark and Hive applications.
• · Migrate SAS code to Python , deliver new Python applications.
• · Document the migrated code.
• · Work with other engineers to ensure the smooth transition to Python

Requirements

Qualifications

• · Bachelor's degree in computer science, data science, or a related field
• · Experience with Spark, Python, SAS, Hive, Hadoop, and the Hadoop ecosystem
• · Experience with data modeling, data wrangling, and data analysis
• · Experience with cloud computing platforms (e.g., AWS, Azure, GCP)

· Strong problem-solving and analytical skills

· Excellent communication and teamwork skills

• · Strong delivery skills, experience with data migration

We offer great opportunities within a dynamically growing consultancy. At Infosys Consulting you will discover a truly global culture, highly dedicated and motivated colleagues, a co-operative work environment and enriching training opportunities