- 7+ years of Data engineering experience with 3+ years hands on Databricks (DB) experience.
- Should have thorough knowledge in creation of jobs using Pyspark. Should be extremely good with SQL and possess good exposure to Python.
- Should be able to create New Clusters, Cluster Pools and attach existing clusters to pool in DB.
- Should have some pool management experience.
- Should be good in Datalakehouse concepts.
- Should have good experience in Data Engineering in Databricks Batch process, Streaming is good to have.
- Should have good experience in creating Workflows & scheduling the pipelines.
- Should have good exposure on how to make packages or libraries available in DB.
- Should have good experience in Databricks default runtimes, Photon & Light is good to have.
- Some experience in Databricks SQL / DW in Databricks.
- Excellent communication and coordination skills and client-facing experience
- Strong problem-solving abilities
- Experience working with geographically distributed teams
- Fast learner, ability to perform well in ambiguity and with little supervision
- Ability to take ownership
Didn’t find the job appropriate? Report this Job