Location: Bengaluru, India
Category: Data Science & Machine Learning
Salary: 1,000,000 - 1,500,000 INR / yearly
Full-time
At TE, we are looking for a Senior Data Lake Developer with experience in building data lake architectures using AWS and related technologies. You will work on managing the existing cloud data platform to make it more scalable, reliable, and cost-efficient.
6+ years of Experience
Design and develop data lakes, manage data flows that integrate information from various sources into a common data lake platform through an ETL Tool
Code and manage data lake implementations on S3 using technologies like Apache Hoodie or Databricks
Triage, debug and fix technical issues related to Data Lakes
Design and Develop Data warehouses for Scale
Design and Evaluate Data Models (Star, Snowflake and Flattened)
Design data access patterns for OLTP and OLAP based transactions.
Coordinate with Business and Technical teams through all the phases in the software development life cycle
Participate in making major technical and architectural decisions
Maintain and Manage Code repositories like Git
5+ Years of Experience operating on AWS Cloud with building Data Lake architectures.
3+ Years of Experience with AWS Data services like S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS and Redshift
Proficient in SQL programming to perform data validation/manipulations. Experience in performing Code optimization
3+ Years of Experience building Data Warehouses on Snowflake, Redshift etc.
3+ Years of Experience in building Delta Lakes using technologies like Apache Hoodie or Data bricks
3+ Years of Experience working on any ETL tools and technologies, Experience in any programming language (Python, R, Scala, Java)
Experience working on Agile projects and Agile methodology in general
AWS cloud certification is a plus
Strong RDBMS and data modelling skills