Your Mission:

- Develop high performant, scalable data processing systems for dealing with internet-scale data.

- Develop and deploy robust, distributed, scalable, realtime, data processing infrastructure that can support various downstream applications including reporting, analytics, user intelligence, machine learning, and decision support.

- Develop and document detailed plans for data products to conform to allocated resources and define quantifiable outcomes for the near-term, interim and future state.

- Hire, mentor, retain and grow a team of world-class data engineers and help them advance in their learning and career goals.

- Communicate clearly about engineering capabilities and limitations, and collaborating productively with customers, vendors, and business stakeholders.

Your Strengths:

- Proven record of building and managing teams of 5+ data engineers, remote or otherwise.

- 10+ years of industry experience owning and building data infrastructure including packaging, deploying and monitoring data systems.

- Having built and shipped a product at a startup will be a plus.

- Masters degree or higher in Computer Science.

- Strong system-level thinking and problem-solving skills with the ability to make architecture decisions as well as deep dive on code at the line level.

- Python implementation experience, with experience in another language like Java.

- Proficiency in designing, implementing and automating systems for data workflow management.

- Experience designing robust, scalable data architectures.

- Proficiency in developing and publishing APIs using web services.

- Proficiency in using distributed storage (e.g. S3), serverless architecture (e.g. Lambda), streaming data (e.g. Kafka), scalable search (e.g. Elasticsearch).

- Proficiency with containerization (e.g. Docker/Kubernetes), and other deployment tooling.

- Proficiency with big data technologies like map-reduce, NoSQL, Spark, HBase, Hive.

- Experience with data security protocols, data access controls, AWS/GCP/Azure security mechanisms at the data and access levels, database security, scripting attacks, API security.

- A record of published patents and/or technical publications in peer-reviewed conferences and journals will be an added bonus.

- Strong communication and collaboration skills to work with stakeholders from different backgrounds.

This job opening was posted long time back. It may not be active. Nor was it removed by the recruiter. Please use your discretion.