Experience

- 15+ years of experience in a technical and analytical role

- 5+ years of experience of Data Lake/Hadoop platform, having led at least 2 implementations end to end

- 3+ years of hands-on experience in implementation and performance tuning Hadoop/Spark implementations

- Experience in designing and managing data linkages between different sources/destinations and types of data like json, video, tabular, xml, etc.

- Implemented AWS services in a variety of distributed computing, enterprise environments

- Understanding of database and analytical technologies in the industry including Data Warehouse design, BI reporting, and Dashboard development

- Experience with one or more relevant tools (Sqoop, Flume, Kafka, Oozie, Hue, Zookeeper, HCatalog, Solr, Avro)

- Experience with one or more SQL-on-Hadoop techno logy (Hive, Impala, Spark SQL, Presto)

- Expertise on AWS services such as Athena, Glue, Lambda

- Experience working with Machine Learning Frameworks (Tensorflow, PyTorch, MxNet, kafkaONNX etc) & Data Science toolkits

- Experience in Media Tech/Consumer Tech will be preferred

Role :

- Interface with multiple stakeholders within IT and business to understand the data requirements

- Assemble large, complex data sets that meet functional / non-functional business requirements and fostering data-driven decision making across the organization

- Responsible for design and development of distributed, high volume multi-thread event processing systems

- Implement processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it

- Work with various vendor partners to design data models that will flow to and from Data Lake to various consuming systems

- Work on Environment set-up and default configurations for the Batch File Data Processing, Online serving, Fast Analytics, On-Demand AI/ML Environment

- Work with AI ML COE to understand the requirements of data from various sources and setting up training pipelines as well as bringing models into production

- Take complete responsibility for the successful delivery of all allocated projects on the parameters of Schedule, Quality and Customer Satisfaction

- Prepare monthly sprint plans, prioritize requests from business and partner teams

Education & Certifications :

- Bachelor's degree in Computer Science, IT, Engineering or a related field or equivalent professional

Personal Attributes as mentioned but not limited to :

- Strong communication and articulation skills

- Excellent interpersonal and Leadership skill

- Good Attitude and Team Player

- Strong problem solving and analytical skills

- Self-driven

This job opening was posted long time back. It may not be active. Nor was it removed by the recruiter. Please use your discretion.