Rapido - Senior Data Engineer

Purpose: The position holder should be passionate about technologies, product and operational savvy who believe in solving last mile problems. This position will report to the Head of Data Science and will be a part of Data Engineering team inside the organization responsible for delivering technology-based solutions that can be adopted to efficiently manage key business processes and stakeholder groups.

Responsibilities:

- Creating complex data processing pipelines, as part of diverse, high energy teams

- Designing scalable implementations of the models developed by our Data Scientists

- Hands-on programming based on TDD, usually in a pair programming environment

- Deploying data pipelines in production based on Continuous Delivery practices.

- Able to build and operate Data Pipelines, Build and operate Data Storage, Is familiar with Infrastructure definition and automation in this context. Is aware of adjacent technologies to the ones they have worked on. Good understanding of Data Modelling.

- Involve in building and deploying large scale data processing pipelines in a production environment.

- Experience building data pipelines and data centric applications using distributed storage platforms

Technical Competencies:

- Experience in HDFS, S3, NoSql Databases and distributed platforms like Hadoop, Spark, Hive, Kafka, Oozie, Airflow etc.

- Experience in any of MapR, Cloudera, and Horton Works and/ or cloud based Hadoop Distributions.

- Experience creating and building Big Data Architecture.

Functional / Behavioural Competencies:

- Actively seeking to learn newer tech and curiously experimenting is a trait that would be preferred.

- Excellent understanding of technology landscape

- Learning ability: Applies theoretical knowledge to practice

- Focus on excellence

- Mentoring team mates

Education & Experiences:

- B. Tech, M. Tech/ MBA (preferred)

- Around 3+ years of experience. For transitioned data engineers over all experience of 5+ years in preferred.