Principal Data Scientist - Online/eCommerce

Job Description :

- Maintain and work with our data pipeline that transfers and processes several terabytes of data using Spark, Scala, Python, Apache Kafka, PySpark.

- Work directly with internal teams to understand their needs/offerings and build platform components that meet those needs.

- Design, build and support pipelines of data transformation, conversion, validation

- Build data manipulation, processing, and data visualization tools and share these tools across the team.

- Leverage your statistical and computational knowledge to design and build intelligent algorithms to solve challenging problems.

- Apply data analysis, data mining and data engineering to present data clearly.

- Work with development teams to build tools for data logging and repeatable data tasks that will accelerate and automate data scientist duties.

- Assist senior management in making key business decisions

- Assist in presenting and showcasing capabilities to external stakeholders.

- Provide guidance and architecture support to platform development teams

Qualifications :

- 6+ years of experience working with large data sets or do large scale quantitative analysis

- Bachelor's or Master's degree in Computer Science, Math, Physics, Engineering, Statistics or other technical field. PhD preferred.

- Expert SQL scripting required.

- Development experience in one of the following: Scala, Java, Python.

- Must have experience working with Hadoop, Spark, Big Data ML frameworks

- Ability to drive projects

- Basic understanding of statistics - hypothesis testing, p-values, confidence intervals, regression, classification, and optimization are core lingo.

- Strong algorithmic problem-solving skills.

- Must have experience manipulating large data sets through scala and Python/R.

- Superior verbal, visual and written communication skills to educate and work with cross functional teams on controlled experiments.

- A willingness to learn, share, and improve.

- Experimentation design or A/B testing experience is preferred