Data Engineer

Technology

Area

Description

Flink/Beam, Kafka, Java

Education

Degree, Post graduate in Computer Science or related field (or equivalent industry experience)

Experience

Minimum 4+ years of development  and design experience in Java/Scala with Flink, Beam (or spark streaming) and Kafka.

Technical Skills

Extensive coding experience and knowledge in Event driven and streaming architecture

Experience in JVM tuning for performance

Knowledge on Containerisation using Docker and Kubernetes.

Working knowledge on Caching systems, with particular experience using Apache Ignite will be preferable. [Nice to have]

Linux OS configuration and use, including shell scripting.

Good hands on experience with design patterns and their implementation.

Well versed with CI/CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem

Experience working with SQL and NoSQL databases

Familiar with Distributed services resiliency and monitoring in a production environment.

Experience in designing, building, testing and implementing security systems – including identifying security design gaps in existing and proposed architectures and recommend changes or enhancements.

Responsible for adhering to established policies, following best practices, developing and possessing an in-depth understanding of exploits and vulnerabilities, resolving issues by taking the appropriate corrective action.

Knowledge on security controls designing Source and Data Transfers including CRON, ETLs, and JDBC-ODBC scripts.

Understand basics of Networking including DNS, Proxy, ACL, Policy and troubleshooting

High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures

Understand data sensitivity in terms of logging, events and in memory data storage– such as no card numbers or personally identifiable data in logs.

Implements wrapper solutions for new/existing components with no/minimal security controls to ensure compliance to bank standards.

Functional Skills

Experience in Agile methodology.

Ensure quality of technical and application architecture and design of systems across the organization.

Effectively research and benchmark technology against other best in class technologies.

Experience in Banking, Financial and Fintech experience in an enterprise environment preferred

Able to influence multiple teams on technical considerations, increasing their productivity and effectiveness,
by sharing  deep knowledge and experience.

Self-motivator and self-starter,   Ability to own and drive things without supervision and works collaboratively with the teams across the organization.

Soft Skills

Have excellent soft and interpersonal skills to interact and present the ideas to team. The engineer  should've good listening skills and speaks clearly in front of team, stakeholders and management. The engineer should always carry positive attitude towards work and establishes effective team relations and builds a climate of trust within the team. Should be enthusiastic and passionate and creates a motivating environment for the team.