Data Engineering Manager - Google Cloud Platform - IT

Job Description:

- Experience with Apache Beam/Google Dataflow/Apache Spark in creating end-to-end data pipelines.

- Should have people management skills.

- Experience in one or more of the following: Python, Hadoop, Spark, SQL, Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning (Preferred)

- Experience programming in Java, Python, etc.

- Expertise in at least two of these technologies: Relational Databases, Analytical Databases, NoSQL databases

- Certification in Google Professional Data Engineer/ Solution Architect is a major Advantage

- 8 -12 years- experience in IT or professional services experience in IT delivery or large-scale IT analytics projects

- Experience connecting and integrating with at least one of the following platforms: Google Cloud, Microsoft Azure, Amazon AWS and/or various data providers like Facebook or Twitter API Integration

- Expertise in Google Cloud Platform, the other cloud platforms is preferred

- Expertise in SQL development

- Expertise in building data integration and preparation tools using cloud technologies (like Snaplogic, Google Dataflow, Cloud Dataprep, Python, etc.)

- Must identify downstream implications of data loads/migration (e.g., data quality, regulatory, etc.)

- Must implement data pipelines to automate the ingestion, transformation, and augmentation of data sources, and provide best practices for pipeline operations

- Able to work in a rapidly changing business environment and to enable simplified user access to massive data by building scalable data solutions

- Advanced SQL writing and experience in data mining (SQL, ETL, data warehouse, etc.) and using databases in a business environment with complex datasets

Experience:

7 to 10 Years

Skills Required:

GCP, big data, python, NoSQL,

Roles:

- Serve as a leader to drive the IT strategy to create value across the organization

- Lead the organization to focus on implementing both top-level, strategic, innovative solutions, and the day-to-day tactics that drive efficiency, effectiveness and value across the entire organization

- Create and analyse deliverables to provide critical content to enable fact-based decision making, facilitation and achievement of successful collaboration with the business stakeholders

- Analyze, design, and develop best practices business changes through technology solutions

- Have to implement and architect solutions on Google Cloud Platform using the components of GCP

Department:

Technology

Designation:

Manager