Principal - Data Scientist

Responsibilities:

- Maintain and work with our data pipeline that transfers and processes several terabytes of data using Spark, Scala, Python, Apache Kafka, PySpark.

- Work directly with internal teams to understand their needs/offerings and build platform components that meet those needs. 

- Design, build and support pipelines of data transformation, conversion, validation 

- Build data manipulation, processing, and data visualization tools and share these tools across the team. 

- Leverage your statistical and computational knowledge to design and build intelligent algorithms to solve challenging problems. 

- Apply data analysis, data mining and data engineering to present data clearly. 

- Work with development teams to build tools for data logging and repeatable data tasks that will accelerate and automate data scientist duties. 

- Assist senior management in making key business decisions 

- Assist in presenting and showcasing capabilities to external stakeholders. 

- Provide guidance and architecture support to platform development teams.

Qualifications:

- 6+ years of experience working with large data sets or do large scale quantitative analysis 

- Bachelors or Masters degree in Computer Science, Math, Physics, Engineering, Statistics or other technical field. PhD preferred. 

- Expert SQL scripting required. 

- Development experience in one of the following: Scala, Java, Python. 

- Must have experience working with Hadoop, Spark, Big Data ML frameworks 

- Ability to drive projects 

- Basic understanding of statistics hypothesis testing, p-values, confidence intervals, regression, classification, and optimization are core lingo. 

- Strong algorithmic problem-solving skills.

- Must have experience manipulating large data sets through scala and Python/R. 

- Superior verbal, visual and written communication skills to educate and work with cross functional teams on controlled experiments. 

- A willingness to learn, share, and improve. 

- Experimentation design or A/B testing experience is preferred