Upgrade to Pro Member
Director at Advait Associates
Views:1925 Applications:27 Rec. Actions:Recruiter Actions:10
Assistant Vice President/Vice President - Data Engineering - KPO/Analytics - IIT/NIT/BITS (2-6 yrs)
Job Purpose :
The individual is expected to work on development and management of a Big Data platform which shall be used to handle billions of data points from various sources in real time. The platform serves multiple purposes - it is used for predefined and ad-hoc user generated queries, real-time Machine Learning algorithms and various business metrics and reports. The individual is expected to create the data flow pipeline and setup workflows to handle the various kinds of requirements being served by the platform.
We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analysing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
- Implementing ETL process and building, maintaining, monitoring the data pipeline
- Monitor data quality and enable system owned resolution channels
- Monitoring performance and advising any necessary infrastructure changes
- Ability to rationalnalize data science models through an operationalization platform - version, archive, manage the model deployment
- Defining data retention policies
Skills & Knowledge :
- Experience in Big Data and Machine Learning Technologies/Frameworks
- Hands-on with Scala, Apache Spark, Hadoop, HDFS, MLlib, Airflow
- Ability to work in a container-based environment - docker, kubernetes
- Experience with data science tools - R and python
Education / Qualification : BE / B.Tech from Premier Institute
Relevant Experience (Minimum) : 1 - 5 years
Other Requirements :
- Quick Turnaround
- Proficient communication skills
This job opening was posted long time back. It may not be active. Nor was it removed by the recruiter. Please use your discretion.
2-Step Verification - Action Required
We've updated our security procedures!
Your privacy and security are important to us. We've recently updated our security measures to make iimjobs.com safer and more secure for you. This change requires you to reset your password.
Please reset your password using the link sent to your email. If you did not receive any email, please check your spam folder..
