News Corp - Senior Data Engineer - Big Data

Title - Senior Data Engineer

Location - Electronic City, - Bangalore

Type - Full time

One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve cCombining all of News Corp's data across categories, countries and organizations into a singular view of a customer enabling engagement, measurement and targeting. The NewsIQ Senior Data Engineer will partner closely with product, data, & engineering teams to help make this data available and accessible to our businesses, teams and partners in order to drive revenue and improve the customer experience.

Responsibilities:

- Design, implement and maintain high performance big data infrastructure/systems, & big data processing pipelines scaling to billions of structured and unstructured events daily

- Design, implement and maintain deep integration with up-stream systems

- Monitor performance of the data platform and optimize as needed

- Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc)

- Support product with the overall roadmap and ensure updates to senior leadership are 100% technically correct.

- Data analysis, understanding of business requirements and translation into logical pipelines & processes

- Conduct timely and effective research in response to specific requests (e.g. data collection, summarization, analysis, and synthesis of relevant data and information)

- Evaluate and prototype new technologies in the area of data processing

- Think quickly, communicate clearly and work collaboratively with product, data, engineering, QA and operations teams

- High energy level, strong team player and good work ethic

Technologies we use:

- Amazon Web Services (S3, EMR, Athena, Glue, Kinesis, Lambda)

- Google Cloud Platform (GCS, Dataflow, BigQuery)

- Python, R, Spark (PySpark)

- Airflow

- Tableau

- Qualifications:

- BS in Computer Science or other technical discipline

- 5+ years of experience designing and developing big data processing systems using distributed computing

- Fluency in Python, Experience in Scala/Java is a huge plus

- Expert knowledge in optimizing complex SQL queries

- An affinity for automation

- Experience working with cloud platforms such as AWS & GCP

- Familiarity with networking and network application programming, including HTTP/HTTPS, JSON, and REST APIs

- Experience with at least one object oriented language (ex: Java)

- Strong OO design, data structure, and algorithm design skills

- Strong interest in emerging technologies: Spark, Hadoop, Hive, ElasticSearch, NoSQL

Nice to Have:

- Experience in the digital advertising and marketing industry

- Experience in Scala and Spark

- Experience with data science / modelling (TensorFlow and/or MXNet)

- Familiarity with API development and design

About News Corp:

News Corp is a global diversified media and information services company focused on creating and distributing authoritative and engaging content to consumers throughout the world. The company comprises businesses across a range of media, including: news and information services, book publishing, digital real estate services, cable network programming in Australia, and pay-tv distribution in Australia. Headquartered in New York, the activities of News Corp are conducted primarily in the United States, Australia, and the United Kingdom. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets.

For more info please visit || https://newscorp.com/about/

About News Technology Services:

We provide global technology and information services that connect people to the news they need.

- News Technology Services (NTS) is an essential part of News Corp's global technology strategy. We work directly with News Corp's global brands to offer a range of technology services, including web development, application support, infrastructure management and cyber operations.

For more info please visit ||www.newstechnologyservices.com ||