Azure Data Engineer Lead

Infogain

Location: Bengaluru, Karnataka, India

Category: Data Engineering

Salary: 1,200,000 - 1,800,000 INR / yearly

Full-time

Job Description

Infogain is seeking an experienced Azure Data Engineer Lead to design, develop, and maintain ETL pipelines using Databricks, PySpark, and ADF for data extraction, transformation, and loading. The ideal candidate will have expertise in Pyspark, SQL, and optimizing ETL workflows for performance and scalability.

Responsibilities

Design and develop ETL pipelines using Databricks, PySpark, and ADF
Optimize existing ETL workflows for performance and scalability
Work with large datasets and implement Delta tables, deduplication, and merging
Proficient in SQL for complex joins, subqueries, functions, and procedures

Qualifications

8-11 years of experience in Data Engineering
Proficiency in Pyspark, SQL, and Azure Data Factory
Experience working with terabytes of data and optimizing ETL workflows
Good understanding of Delta tables and data deduplication

Perks & Benefits

Infogain offers competitive compensation, opportunities for career growth, health insurance, and a collaborative work environment.

Why Join Us?

Join Infogain, a leading digital platform and software engineering company, to work on cutting-edge technologies and accelerate experience-led transformation for Fortune 500 companies.