The posting
Job Description
- Serve as the offshore thought leader for data engineering, driving technical direction, best practices, and architectural standards across the team while staying current with emerging tools and trends.
- Lead, mentor, and manage the offshore data engineering team — owning task allocation, performance guidance, and skill development to build a high-performing, self-sufficient unit.
- Apply strong problem-solving skills to troubleshoot complex data/pipeline issues and unblock the team, acting as the primary escalation point for critical technical challenges.
- Design and build scalable, production-grade data engineering solutions using the Databricks Lakehouse Platform
- Develop client-focused Proof of Concepts (POCs) demonstrating modern data engineering and analytics capabilities
- Translate business and analytical requirements into robust data models and layered architectures (Bronze/Silver/Gold)
- Design robust data ingestion, transformation, and orchestration pipelines using Databricks best practices
- Implement enterprise-grade data governance, security, and access control using Unity Catalog and related Databricks capabilities
- Stay current with new Databricks product capabilities and recommend innovative approaches for solving client challenges
- Collaborate with cross-functional teams including Data Scientists, AI Engineers, Cloud Engineers, and Business Consultants
Responsibilities
- Serve as the offshore thought leader for data engineering, driving technical direction, best practices, and architectural standards across the team while staying current with emerging tools and trends.
- Lead, mentor, and manage the offshore data engineering team — owning task allocation, performance guidance, and skill development to build a high-performing, self-sufficient unit.
- Apply strong problem-solving skills to troubleshoot complex data/pipeline issues and unblock the team, acting as the primary escalation point for critical technical challenges.
- Design and build scalable, production-grade data engineering solutions using the Databricks Lakehouse Platform
- Develop client-focused Proof of Concepts (POCs) demonstrating modern data engineering and analytics capabilities
- Translate business and analytical requirements into robust data models and layered architectures (Bronze/Silver/Gold)
- Design robust data ingestion, transformation, and orchestration pipelines using Databricks best practices
- Implement enterprise-grade data governance, security, and access control using Unity Catalog and related Databricks capabilities
- Stay current with new Databricks product capabilities and recommend innovative approaches for solving client challenges
- Collaborate with cross-functional teams including Data Scientists, AI Engineers, Cloud Engineers, and Business Consultants
Qualifications
- 8+ years of experience in Data Engineering
- Expert knowledge of the Databricks platform and its ecosystem
- Demonstrated experience of leading 10+ member team for Offshore/Onshore Project delivery model
- Demonstrated ownership of cost optimization for Databricks workloads, including cluster policies, workload isolation, Photon usage, job vs. interactive compute, and SQL/query cost management
- Strong hands-on experience with Databricks Lakehouse Architecture, Delta Lake, Unity Catalog, Databricks SQL, Spark SQL, and PySpark.
- Deep understanding of data modeling, distributed computing, and modern data architecture principles
- Experience building scalable ETL/ELT pipelines for enterprise workloads
- Hands-on experience with workflow orchestration using Databricks Workflows, Airflow, or similar orchestration platforms
- Expertise in data governance, security, and access controls, including Unity Catalog, RBAC, data masking, and secure data sharing
- Experience working on at least one major cloud platform (Azure, AWS, or GCP).
- Experience integrating AI capabilities into enterprise data platforms.
- Excellent analytical, problem-solving, and communication skills, with the confidence to engage directly with enterprise clients and business stakeholder
Ability to independently own solution design and rapidly develop Proof of Concepts



