Data Architect - IT

Duties And Responsibilities :

- As part of a team of architects, develop and architect an AWS based multi-tenant event-streaming SaaS solution using Microservice architecture.

- Support and provide consultation to developers in app teams on their cloud related projects

- Mentor developers within the cloud service team on software development, cloud deployment and detailed level architecture design

- Provide guidance on hard problems to solve either in existing code, new enhancements, or deployment challenges.

- Participate in solving the problems of capacity, performance, and stability of cloud environment.

- Follow Agile Software Development methodology

- Contribute in continuous integration and continuous delivery (CICD) environment

- Adhere to best practices in coding, documentation, test automation, and deployment

- Create ADRs, design, technical, and solution documents as needed.

- Responsible for Coordination between Client Product Team and Offshore Development Teams

Requirements :

- Solid architecture experience in building cloud based data platforms following the architecture patterns to real-time data streams, database driven application development to support secure, performant, scalable, resilient, real-time/near real-time processing, distributed architecture principles leveraging cloud managed data lakes, SQL, NoSQL databases, streaming buses and serverless implementations.

- Knowledge of upstream data ingestion, data automation, digitization as needed, data curation, data extraction, quality

- Knowledge of data processing/pipelines, classification, automated/rules-based data mapping, matching, merging, data masking, master data management

- Data platform architecture to support BI/Analytics data virtualization, virtual data marts, self-service, search

- Data platform architecture for secure data access self-service, though Graph QL based APIs

- Knowledge of technology stacks: Apache Kafka, AWS Kinesis, PySpark, Databricks, AWS EMR, Hudi, AWS Batch, C#, .Net, .Net Core

- Architecture experience in leveraging data sciences/machine learning in the security event processing data discovery, knowledge models, behavioral analysis, detection of patterns, correlation of events for anomaly/threat detection, decision making and prioritization

- Architecture experience in supporting ML Ops pipelines for centralized training of models, versioning, approval process and on-demand deployment of models

- Database architecture experience using relational databases such as Oracle, SQL, Postgres, MySQL, NoSQL databases such as MongoDB, Cassandra, DynamoDB, Cosmos, Bigdata

- Architecture of BI and analytics: Operational, executive dashboards, reports, trends, predictive analytics

- Data platform architecture in support of data operations and management to support personas for operational, reporting, analytics, on-demand and streaming

- Knowledge of data security and governance: glossary, rules, policies, workflows, quality

- Experience in containerization, Kubernetes based container orchestration, service mesh, implementations using cloud-based PaaS services ECR, EKS, Istio

- Must have Data architecture experience towards a SaaS development platform

- Experience in Conceptualize and design Architectural elements for different scenario

- Experience in software development, cloud infrastructure and application deployment

- Experience and understanding on implementation in enterprise applications, solutions, and data center infrastructures

- Have a good understanding of modern, cloud centric architectures and DevOps principles.

- Familiar with mainstream IaaS provider services from AWS or Azure

- Knowledge of working with large datasets using Elastic Search, SnowFlake, or similar technology

- Familiar with use of stream processing technologies like Apache Flink

- Ability to tackle problems involving large, complex systems.

- Ability to collaborate effectively across disciplines, roles, and geographical and time zone boundaries

- Experience with Agile development, CICD, and Domain Driven Design

- Proficiency in cross-location communication and the English language

- Excellent Communication skill - Candidate should be able to communicate well with Onsite client Product Owner

- Critical Thinking and Listening Capabilities and demonstrate the same with Client

- Knowledge of systems monitoring, capacity planning and performance tuning.

- Experience in supporting large scale, production deployments on main stream cloud platforms

- Linux and/or Windows administration experience.

- Security experience