Location: Pune, Maharashtra, India
Category: Data Engineering
Salary: 1,500,000 - 2,500,000 INR / yearly
Full-time
Join Infosys as a Data Architect with 9+ years of experience in data engineering. Must be proficient with Databricks, Apache Spark, and have strong SQL skills.
Design, develop, and maintain scalable data pipelines on Databricks using PySpark
Collaborate with data analysts and scientists to understand data requirements and deliver solutions
Optimize and troubleshoot existing data pipelines for performance and reliability
Ensure data quality and integrity across various data sources
Implement data security and compliance best practices
Monitor data pipeline performance and conduct necessary maintenance and updates
Document data pipeline processes and technical specifications
9+ years of experience in data engineering
Proficiency with Databricks, Apache Spark, and strong SQL skills
Experience with big data technologies such as Hadoop, Kafka
Knowledge of data warehousing concepts and ETL processes
Experience with CI/CD tools, particularly Jenkins
Experience with cloud platforms like AWS, Azure
Understanding of DevOps principles and tools
Databricks certification is a plus