Job Title: Data Engineer/ Senior Data Engineer No of positions: 2 (Data Engineer and Senior Data Engineer) Job Location: Bangalore (Currently WFH) Salary: Data Engineers (2-4 years of experience): Up to 11 LPA Senior Data Engineer (4-8 years of experience): Up to 21 LPA Candidates who can join immediately or who can join within 15 days only do apply. Job Overview: Consultants are responsible for assisting our clients with building, implementing and supporting end-to-end solutions. Being intricately involved with the project lead/delivery manager, they are tasked with the design, modelling and execution of data models to support end users with analytics and reporting. Consultants must be proficient in designing ETL functions as well as building data pipelines between on-premise, cloud applications and various data sources. Roles and Responsibilities: Will be responsible for onboarding tables to data lake and building pipelines for data ingestion using python. Building data models and tables on Athena which will be used for reporting. Create and maintain workflow/technical documents for all the development activities. Gather business requirement from business stakeholders and deliver solution. Participate in weekly status meetings to provide updates to stakeholders and provide strategic plan for upcoming tasks. Specific skills required are: Must have: - Hands on experience on either RDBMS, Data warehousing, data modelling-star & snowflake schema or Bigdata, Hive, Hadoop. - Strong knowledge on SQL (MSSQL or MySQL or PostgreSQL or Presto). - Hands on experience in Python - pandas, pyathena, boto3 libraries. - Hands on experience in either Azure data analytics or AWS Athena. - Hands on experience in Azure Storage or AWS S3. - Good knowledge on data lake optimization and partitioning. - Good knowledge on file formats like parquet, CSV and Hadoop file system. - Good knowledge on cronjob scheduling and debugging. Good to have: - ADF or AWS Glue/AWS lambda or any ETL, Visualization. - Experience on working in Linux environments. - Experience on working in Retail or FMCG. - Basic understanding on Ambari and Sqoop General Requirements: - Bachelors or Master's Degree from a reputed college - 2 - 8 Years of experience in Date Engineering domain - Experience in all stages of DE project work (requirements and logical design, physical design, implementation, testing and deployment) - Excellent communication and interpersonal skills - Capable of performing under minimal supervision, multi-tasking, meeting deadlines as an individual contributor and being able to coach a team.

Bangalore

Analytics India Magazine - Data Engineer/Senior Data Engineer 

Job Description for Analytics India Magazine - Data Engineer/Senior Data Engineer  in Analytics India Magazine Pvt. Ltd. in  Bangalore for (2-10) years of experience. Apply Now!