Main Purpose :&nbsp; - The board after observing the success of Risk office infrastructure, has given risk team responsibility of data management group to build a robust data infrastructure to create a unified view of all the data, which lies scattered across different teams and use different technologies. The group is in charge of creating a knowledge house for internal data sources, commodity fundamentals data, and alternative data sources, i.e. customized data encyclopedia for the business units. The encyclopedia of data will enable the creation of state of the art advanced models to augment the business. - With a long track record of being able to get complicated things done, the risk team is now looking to hire exceptional data engineers for the data management group to increase its firing power. You will work directly with the Chief Risk Officer at extending our risk and analytic capabilities, written entirely in F#. Department : The data management group works within the Risk office. The risk office is in charge of risk management across different business units. Risk office provides an independent quantitative assessment of the different carried risks of the business. The team also engage with management and commercial teams to ensure that there is a full and accurate awareness of risk and that these risks are professionally analyzed and managed. While developing risk models, the risk team has developed an excellent understanding of different business verticals of the group. Also, The risk team has built a robust data infrastructure through sourcing data from different sources and business units. Using the robust data infrastructure sophisticated risk and machine learning models have been developed, which help different business units to take a critical business decision. Knowledge, Skills and Abilities: - A graduate degree in a quantitative discipline like, computer science, mathematics, physics, and similar disciplines - An industry experience, which demonstrates building robust data engineering infrastructure - Advance level knowledge of ETL concepts and building ETL solutions - Knowledge data warehousing concepts - Knowledge of cluster management concepts - Experience in API design and development Knowledge of Technologies (not limited to): Ingestion: - RabitMQ - Kafka Processing : - Spark, and Spark GraphX - Spark Streaming - Kafka Streams - Flink Data Store : - SQL Databases like MySQL, Oracle - Cassandra, Druid, MongoDB, HBase, Elasticsearch - Neo4j, JanusGraph - Experience building low latency data integration solution is a big plus Significant Plus: - Knowledge of functional programming paradigm - Understanding of functional programming using F# (Fsharp) - Understanding of software product development in .NET framework - Knowledge of code versioning tools - Ability to work in a fast paced high-pressure environment - Detail oriented and efficient problem solver. Ability to synthesize diverse set of information to prototype business solutions. - Should have an excellent verbal and written communication skills - It is imperative thatthe candidate is open to experiment and learn new technologies as per the task requirement. Key Responsibilities - The data engineer will take complete ownership of the data engineering pipeline. - The most critical responsibility of the role will be to employ technology to marry different systems together for one unified view of data - A data engineer will be responsible to develop, construct, test, and maintain architectures for databases and large scale processing systems. - Must ensure that architecture will support the requirements of the business. Find new opportunities for data acquisition - Build data set process for data modelling, acquisition, mining, and production - Design strategies to improve data reliability, efficiency, and quality - Recommend ways to version large files for model provenance - The ideal candidate should be comfortable collaborating with multi-disciplinary teams and open to take leadership when required and follow directions when necessary. Key Internal Relationships Chief Risk Officer (CRO), Deals Desk teams, Physical and Derivative Traders Team, Research Team, Operators, Finance Department, Chartering Department.

Mumbai

Manager/AVP - Data Engineering - Utilities Firm 

Manager/AVP - Data Engineering - Utilities Firm  ,Job Description for Manager/AVP - Data Engineering - Utilities Firm  in Michael Page in  Mumbai for (9-12) years of experience. Apply Now!

Job Description for Manager/AVP - Data Engineering - Utilities Firm  in Michael Page in  Mumbai for (9-12) years of experience. Apply Now!