Senior Manager - Big Data Architect - BFS

Job Description :

Basic Function :

- The Big Data Architect works closely with the customer and the solutions architect to translate the customer's business requirements into a Big Data solution. This includes understanding the customer data requirements, platform selection, design of the technical architecture, design of the application and interfaces, and development, testing, and deployment of the proposed solution.

- Has the ability to design enterprise grade large-scale data processing systems and help identify the best options for architecture. The Big Data Architect also understands the complexity of data and can design systems and models to handle different variety of data with varying levels of volume, velocity and veracity.

- Should have independently worked on proposing architecture, design and data ingestion concepts in a consultative mode. Leads client assessments, preparing current state and future state architectures along with go forward recommendations. Will work with the practice leads and account management team to develop statements of work, implementation plans, resource plans and project estimates

Essential Functions :

- Has a deep understanding and experience with several of the following - Business Analysis, Requirements Gathering, Data Analysis, Data Modeling, Project Management, Project Estimation

- Advanced knowledge of design and architecture patterns and methodologies.

Demonstrated work ethic, focus and self-discipline

- Has and maintains a deep understanding of the role of big data in business and the enterprise.

- Propose recommended and/or best practices regarding the movement, manipulation, and storage of data in a big data solution including data ingestion, data storage options, query techniques, data variety, volume & velocity,

- Collaborate with project teams on platform development process from inception to production deployment, including project scheduling, design, implementation and coordination with other team members.

- Collaborate with other technology teams and architects to define and develop cross- function technology stack interactions.

- Research and experiment with emerging technologies and tools related to big data.

- Experience in scaling applications on big data platforms to massive size.

- Performing solution architecture in adherence to enterprise architecture governance.

- Bridging business and development team.

- Long term development and Technical expertise in DW/BI Practice, communicate well with all stakeholders, optimize objectives, leverage state of the art tools and best practices, integrate into corporate systems and deliver on time.

- Deep understanding in Data Warehousing, Enterprise Architectures, Dimensional Modelling, Star & Snow-flake schema design, Reference DW Architectures, ETL Architect, ETL (Extract/Transform/Load), Data Analysis, Data Conversion/Transformation, Database Design, Data Warehouse Optimization, Data Mart Development, and Enterprise Data Warehouse Maintenance and Support etc.

- Should have independently worked on proposing architecture, design and data ingestion concepts.

Primary Internal Interactions :

Project Delivery :

- Formulates workable solutions that integrate people, process and technology. Integrates competency leads and other subject matter experts to define the details of vision and solution

- Identifies, creates and communicates the vision of the end-to-end solution for the client and implementation teams after completing thorough evaluations of the present state needs

- Leads technical teams in documenting and implementing technical solutions for business problems

- Supports Delivery Enablement and Practice Leads by ensuring appropriate linkage between practices is clear and well understood

- Works with practice leads to develop project estimating methodologies for new areas of focus

Account & Resource Management :

- Partners with the account teams to identify and sell solutions and create high level of client interest in proposed comprehensive solutions

- Works closely with Engagement Managers, Account Managers and Account Leads in strategies to grow existing accounts

- Partners with account team and client to develop the ROI, Business Case, and Statement of Work for an engagement

- Develops comprehensive project, implementation, and resource plans working closely with Engagement and Project Managers

Primary External Interactions :

Assessment Participation & Leadership :

- Identifies, creates and communicates the vision of the end-to-end solution for the client and implementation teams after completing thorough evaluations of the present state needs

- Participates in strategy development and current state assessments for clients to identify opportunities. Acts as proxy for practice leads when necessary

- Works with client to sell the proposed solution and develop internal marketing programs

- Supports work that may not fall into an existing competency and helps to identify possible needs for new competencies.

- Partners with account team and client to develop the ROI, Business Case, and Statement of Work for an engagement

Skills :

Technical Skills (Knowledge, Skills & Abilities) - Experience with enterprise data management, Business Intelligence, data integration, and SQL database implementations

- Experience with the major big data solutions like Hadoop, MapReduce, Hive, Spark, Scala, HBase, MongoDB, Cassandra.

- Programming/scripting languages like Java, Linux, PHP, Ruby, Python and/or R. As well as have experience in working with ETL tools such as Informatica, Talend, Pentaho etc.

- He or she should have experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms.

- Experience in data migration from relational databases to Hadoop HDFS

- Propose best practices/standards

- Translate, load and present disparate datasets in multiple formats/sources including JSON, XML etc.

Must Have Skills :

- Hadoop stack including HDFS cluster, MapReduce, Hive, Spark and Impala

- Web Technologies CSS, DHTML, XML, Hight Charts, Linux

- ETL tools such as Informatica, Talend and/or Pentaho.

Query : SQL, No SQL Concepts

Ingest : Kafka, Sqoop, Flume

Orchestration : Zookeeper

Databases : Postgres, Mongo DB, Cassandra, HBase

Languages : Java, Scala

Scripting : JavaScript, DHTML, XML, Shell

Good to have Skills :

Core : AWS, Hadoop, Yarn

Process : Agile-Scrum, Iterative Development, DevOps, CI

Analytics : Descriptive, Predictive (Added advantage)

Tools : Jenkins and TFS

Languages : Python, Java Enterprise

Process Specific Skills :

(Supervisory Responsibilities) When the Bigdata Architect is acting as an engagement or project manager, they will be responsible for the overall supervision of the staff on the engagement. They will be responsible for coaching and advising the team on the engagement. They will likely need to provide feedback to the people managers and practice leads of the resources on their engagement team.

Soft skills (Desired) :

Experience working with multi-divisional business communities to leverage information across the enterprise to improve business effectiveness

- Strong team building, interpersonal, analytical, problem identification and resolution skills

Soft Skills (Minimum) :

- Exceptional analytical, conceptual, and problem-solving abilities

- Strong written/oral communication and presentation/interpersonal skills

- Highly self-motivated and able to work independently as well as in a team environment

Education Requirements : Bachelor's degree or Master's degree

Work Experience Requirements :

Minimum 10 years of professional experience with BI/DW implementations and with at least 2-3 years of Big Data Architecture. 3+ years of experience in technical or solution architecture providing large scale enterprise data solutions.

Ishika Jain