- Maintain and work with our data pipeline that transfers and processes several terabytes of data using Spark, Scala, Python, Apache Kafka, PySpark.
- Work directly with internal teams to understand their needs/offerings and build a platform components that meet those needs.
- Design, build and support pipelines of data transformation, conversion, validation
- Build data manipulation, processing, and data visualization tools and share these tools across the team.
- Leverage your statistical and computational knowledge to design and build intelligent algorithms to solve challenging problems.
- Apply data analysis, data mining and data engineering to present data clearly.
- Work with development teams to build tools for data logging and repeatable data tasks that will accelerate and automate data scientist duties.
- Assist senior management in making key business decisions
- Assist in presenting and showcasing capabilities to external stakeholders.
- Provide guidance and architecture support to platform development teams.
Didn’t find the job appropriate? Report this Job