Skip to content

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Scala Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education

Summary: We are seeking an experienced Data Architecture Team Lead to define and drive the architecture of scalable, maintainable data pipelines for real-time banking data products. In this role, you will lead architectural decisions across the end-to-end data platform, including mainframe CDC ingestion, Confluent Kafka, Apache Spark Structured Streaming on Amazon EMR, and MongoDB Atlas. You will play a critical role in onboarding new applications, establishing architecture standards, and ensuring consistency, scalability, and reliability across the applicaiton.

Roles & Responsibilities: Define and enforce architectural standards for real-time Spark Structured Streaming pipelines across the DDS platform Lead architectural design for new application onboarding (NewApp KT) including data flow design, collection modeling and CDC subscription definition Evaluate and propose improvements to existing pipeline architectures for performance, scalability and maintainability Define MongoDB collection schemas, indexing strategies and write patterns (upsert, bulk write, TTL indexes) Design Kafka topic structures, partition strategies and CDC subscription configurations in collaboration with IBM CDC and Confluent teams Collaborate with cross-functional teams including HOST/mainframe, GFT, CDC squad and platform engineering Produce and maintain architecture documentation — high-level design diagrams, data flow documents and ADRs (Architecture Decision Records) Review technical designs proposed by development team members and provide architectural guidance Support production deployments across INT, PRE and PRO environments on Amazon EMR Technical Skills: Must have: Scala and Apache Spark — deep understanding of Structured Streaming internals, execution model and performance tuning Data architecture — experience designing end-to-end real-time data pipelines MongoDB — collection design, indexing, aggregation pipelines, Atlas architecture Kafka — topic design, partition strategy, consumer group management, Confluent Cloud AWS — EMR, S3, CloudWatch Good to have: IBM CDC / Change Data Capture — subscription design, table filtering, multi-table refresh Delta Lake on S3 Banking domain knowledge — account movements, transaction processing, balance calculation Jenkins, SonarQube, Bitbucket Java Desirable: Experience with mainframe DB2 data structures Knowledge of IBAN calculation standards Experience with MongoDB Atlas cross-cluster architectures Experience: Minimum 6 years of experience in data engineering with at least 2 years in a technical architecture or lead role.

15 years full time education

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.

Seen 17 days ago.

Original posting on Logic, Part of Accenture's site ↗

Posting text belongs to the employer. Removal requests: contact us.

One job at a time

One posting. One CV. $25.

Pick the job you actually want and we write for it.

Get my CV for this job