Factspan - Senior Principal Analyst - Data Engineering

Responsibilities

The Senior Principal Analyst will be responsible for driving large multi-environment project end to end and will act more of individual contributor

- Design and develop reusable classes for ETL code pipelines and responsible for optimistic ETL framework design.

- Plan and execute the projects and be able to guide the junior folks in the team.

- Excellent presentation and communication skills, and strong team player

- Experience in working with clients, stakeholders, product owners to collect requirements and creating solutions, estimations.

Qualifications & Experience:

- 5+ years of experience solutioning and design in data & analytics projects

- Strong in Data Modelling Skills, Data Warehousing, and Architecture with ETL & SQL Skills

- Experience in handling multiple projects as Data Architect and/or Solution Architect

- 6+ years of Big Data Processing technologies such as Spark, Hadoop etc.

- 6+ years' experience in Programming Python/Scala/Java & Linux shell scripting

- 6+ years of hands-on experience in implementing data Integration frameworks to ingest terabytes of data in batch and real-time to an analytical environment.

- 3+ years of experience in developing big data applications in Cloud (AWS/GCP/Azure and/or Snowflake)

- Deep knowledge of Database technologies such as Relational and NoSQL

- Hands on experience with ETL pipeline development and functional programming preferably with Scala, Python, Spark, and R

- Must be good in developing ETL layer for high data volume transaction processing.

- Experience with any ETL tool (Informatica/DataStage/SSIS/Talend) with Data modelling, and Data warehousing concepts

- Good to have jobs execution/debugging experience with PySpark, PyKafka classes, with combination of Docker containerization.

- Agile/Scrum methodology experience is required.