Data Engineer - IT

Job Description

Our client is a fast growing B2B SaaS company in the sales and marketing tech space. We are funded by top tier VCs, and going after a billion dollar opportunity. we are building a sales development automation platform that can significantly improve outcomes for sales teams, while reducing the number of hours spent on research and outreach.

We are a big data company and perform deep analysis on technology buying patterns, buyer pain points to understand where buyers are in their journey. Over 100 billion data points are analyzed every week to derive recommendations on where companies should focus their marketing and sales efforts on. Third party intent signals are then clubbed with first party data from CRMs to derive meaningful recommendations on whom to target on any given day.

Experience : 4-8 yrs

Job Location : Bangalore

Responsibilities

- Work in collaboration with the application team and integration team to design, create and maintain optimal data pipeline architecture and data structures for Data Lake/Data Warehouse

- Work with stakeholders including the Sales, Product, and Customer Support teams to assist with data-related technical issues and support their data analytics needs

- Assemble large, complex data sets from third-party vendors to meet business requirements.

- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Elastic search, MongoDB, and AWS technology

- Streamline existing and introduce enhanced reporting and analysis solutions that leverage complex data sources derived from multiple internal systems

Requirements

- 5 years of experience in a Data Engineer role

- Proficiency in Linux

- Must have SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with databases including Mysql, Mongo, Cassandra, and Athena

- Must have experience with Python/Scala

- Must have experience with Big Data technologies like Apache Spark

- Must have experience with Apache Airflow

- Experience with data pipeline and ETL tools like AWS Glue

- Experience working with AWS cloud services: EC2, S3, RDS, Redshift

- Our dual missions - one for the world, one for us - For the world: Improve transparency and trust in the B2B ecosystem

- For ourselves: Lead fulfilling, impactful lives. Our core values (how we act)

- Have Empathy

- Continuously push the barrier

- Make data driven decisions

- Take smart risks

- Have fun at work