Lead - Data Engineering - IT

Title - Data Engineering Lead

Job Description: We are looking for a strong Leader with 10+ years of overall IT experience and having at least 5 years of experience in data engineering domain. In this highly visible role, you will serve as the technical expert responsible for design and implementation of the data architecture and stack that ensures timely delivery of analytics to business. You will be responsible for verifying requirements, defining architecture, developing an implementation plan, providing thought leadership, and developing technical solutions that meet and exceed customer expectations.

RESPONSIBILITIES :

- Perform data modeling as per business requirements.

- Develop data transformations and workflows.

- Lead a small team of developers.

- Provide direction to developers, oversee the development, unit testing and documentation for the developed solutions.

- Curate and certify datasets for analytics.

- Maintain data catalog and lineage.

- Define and implement data quality checks.

- Manage production support model including escalation and resolution procedures.

- Ensure single version of metrics and consistent use of master data.

Knowledge and Skills :

- Deep understanding of data modeling, modern data stack, ETL/ELT processes.

- Strong Experience with complicated data transformations.

- Strong experience in data orchestration tools like Azure Data Factory.

- Deep experience in cloud data lakes/warehouses like Azure Data Lake, Databricks, Synapse, etc.

- Strong experience in Python and SQL.

- Good understanding of different data lake architectures like Databricks Medallion Architecture, access controls and different mechanisms for implementing Data level security.

- Ability to tune data loads for efficient performance.

- Strong analytical and troubleshooting skills with attention to detail.

- Excellent communication skills, verbal and written.

- Excellent knowledge of Dimensional Modeling.

- Ability to work independently.