Manager/Senior Data Analyst - Consulting Firm

Manager/Senior Data Analyst

Key Responsibilities :

- Develop, implement, and maintain Spark applications for data processing and analytics.

- Design and optimize Spark jobs for performance and scalability.

- Implement Delta lake solutions for efficient data storage and management.

- Build streaming solutions for Internet of Things (IOT) using Spark streaming.

- Utilize Kafka expertise to design and manage data pipelines.

- Collaborate with cross-functional teams to understand and address data processing requirements.

- Troubleshoot and debug issues in Spark applications and pipelines.

- Stay up-to-date with industry best practices and emerging technologies in Big Data and Spark ecosystem.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Proficiency in Apache Spark 3.X and SCALA programming.

- Hands-on experience with Delta lake implementation.

- Strong knowledge of streaming solutions, especially for IOT, using Spark streaming.

- Expertise in Kafka for building data pipelines.

- Proven track record of designing and optimizing Spark applications.

- Strong problem-solving and debugging skills.

- Excellent communication and collaboration abilities.