The posting
ADB Pyspark
## Job Summary We are seeking an experienced ADB Pyspark professional to join our team as a full-time employee. The ideal candidate will be responsible for developing, optimizing, and maintaining big data solutions using Databricks Spark and PySpark SQL. You will play a key role in handling large-scale data processing tasks and support our data engineering initiatives to drive business outcomes. Immediate joiners are preferred.
## Responsibilities - Design, develop, and maintain scalable data pipelines using Databricks Spark and PySpark SQL. - Collaborate with cross-functional teams to understand data requirements and deliver efficient solutions. - Optimize existing data workflows for performance, reliability, and scalability. - Implement best practices for data ingestion, transformation, and storage. - Troubleshoot and resolve data pipeline and processing issues. - Document technical solutions and provide knowledge sharing to team members.
## Qualifications - Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field. - Minimum of 5 years of professional experience working with Databricks Spark and PySpark SQL. - Strong expertise in building and optimizing data pipelines in distributed data environments. - Proficient in writing complex SQL queries for data extraction and transformation. - Solid understanding of big data concepts and architecture. - Strong analytical and problem-solving skills. - Excellent communication and teamwork abilities.
## Preferred Skills - Experience with cloud data platforms (such as Azure, AWS, or Google Cloud Platform). - Familiarity with data warehousing and ETL concepts. - Exposure to additional big data technologies (e.g., Hadoop, Hive). - Experience in Agile/Scrum development environments.
## Experience - Minimum 5 years of relevant experience in Databricks Spark and PySpark SQL. - Hands-on experience with large-scale data processing, data pipeline development, and optimization.
## Environment - Work Location: Bangalore or Chennai (in-office). - Employment Type: Full-Time. - Start Date: Immediate. - Collaborative, fast-paced, and technology-driven environment.
## Salary - INR 12,00,000 – 17,00,000 per annum.
## Deadline - Application Deadline: 30 May 2025, 6:30 PM IST.



