Industry - Internet / Online / eCommerce
Job Type - Permanent
Job Duration -
Job Description - Data Engineering position with a leading internet based company.
Client Details
The client is a leading brand and the market leader in it's industry.
Description
- Build scalable architectures for data storage, transformation and analysis
- Designing platforms as consumable data services across the organization using Big Data tech stack
- Think of solutions as scalable generic reusable organization-wide platforms
- Architect and build near real-time (low latency) infrastructure for segmentation, personalized recommendations, reporting etc.
- Build and execute data mining and modeling activities using agile development techniques
- Appreciate and understand the cloud delivery model and how that affects application solutions - both delivery and deployment
Profile :
- B.E / B.Tech / M.E / M.Tech / M.S in Computer Science or software engineering from a premier institute
- Must have good programming experience in Scala
- Must have good experience in distributed processing frameworks like Spark
- Good to know other languages like Java/Python
- Strong knowledge of data structures and algorithms
- Good to have experience in streaming systems like Spark streaming and Storm
- Expertise in big data infrastructure, distributed systems, data modeling, query processing and relational
- Experience in technologies like SQL and NoSQL data stores
- Able to work with polyglot architecture on terabytes of data
- Writes code and unit tests, works on API specs, automation, and conducts code reviews & testing (using ScalaTest)
- Good knowledge of tools like gradle/maven, Intellij IDEA, ScalaTest, ScalaCheck etc.
- Should have extensive experience with capturing, managing and processing Big Data (terabytes of data captured through web logs,
documents, clickstreams, social networks etc.)
- Good to have experience with other tools we use: Kafka, Cassandra, ElasticSearch, Couchbase, ArangoDB, Druid, HBase or you really want to learn about them
- Should value simple solutions, write concise code, and believe in DevOps
- Should have hands-on experience in tuning software for maximum performance out of the given hardware
Didn’t find the job appropriate? Report this Job