Project Role : Custom Software Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education
Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to effectively migrate and deploy data across various systems, contributing to the overall efficiency and reliability of data management within the organization.
Roles & Responsibilities: -Develop and maintain ETL pipelines using PySpark for data ingestion, transformation, and aggregation. -Write optimized and reusable PySpark code to process large-scale datasets. -Work with structured and unstructured data sources (CSV, JSON, Parquet, Avro, relational DBs, etc.). -Optimize Spark jobs for scalability, reliability, and performance. -Collaborate with data engineers, analysts, and business stakeholders to deliver clean and reliable datasets. -Implement data quality checks, monitoring, and logging for pipelines. -Work with cloud storage and big data frameworks (HDFS, Hive, Delta Lake, S3, ADLS, BigQuery). -Apply best practices for code versioning (Git), testing, and CI/CD deployment. -Document design, workflows, and technical solutions.
Professional & Technical Skills: - Must To Have Skills: Proficiency in PySpark. - Strong understanding of data modeling and database design principles. - Work with cloud storage and big data frameworks (HDFS, Hive, Delta Lake, S3, ADLS, BigQuery). - Experience with ETL tools and processes. - Familiarity with cloud platforms such as AWS or Azure. - Knowledge of data warehousing concepts and technologies.
Additional Information: - The candidate should have minimum 5 years of experience in PySpark. - This position is based at our Bengaluru office. - A 15 years full time education is required.
15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.
Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
Seen 20 days ago.
Original posting on Logic, Part of Accenture's site ↗
Posting text belongs to the employer. Removal requests: contact us.
Nearby
Live postings like this one
Same employer first, then the same role elsewhere.
- 3h ago
- 3h ago
- 3h ago
- 3h ago
- 3h ago
- 3h ago
- 3h ago
- 3h ago
One job at a time
One posting. One CV. $25.
Pick the job you actually want and we write for it.