Position: Data Engineer Architect
Experience: 5+ Years
Work Location: Chennai
Work Mode: Work From Office (WFO)
Availability: Only Immediate Joiners
We are seeking an experienced Architect Data Engineer for one of our client with 5+ years of relevant experience to join our team in Chennai. The ideal candidate will be responsible for designing and implementing scalable data architectures, ensuring efficient data processing, and managing data pipelines. You will play a key role in ensuring that data flows smoothly across systems and is easily accessible to the teams that need it.
Key Responsibilities:
- Design and implement scalable and efficient data architectures to support business needs.
- Lead the development of end-to-end data pipelines using Python, SQL, and Spark.
- Architect and manage large-scale data processing on AWS cloud platforms.
- Collaborate with cross-functional teams to understand data requirements and ensure data accessibility.
- Implement and maintain best practices for data governance, security, and scalability.
- Work with Databricks to create and optimize big data solutions.
- Monitor, troubleshoot, and optimize data systems for performance, reliability, and scalability.
- Mentor junior engineers and contribute to the continuous improvement of data engineering practices within the organization.
Required Skills:
- 5+ years of hands-on experience in Data Engineering, including a minimum of 3 years in a lead/architect role.
- Strong proficiency in Python, SQL, and Apache Spark.
- Experience with AWS cloud services including S3, Redshift, EC2, and Lambda.
- In-depth knowledge of Databricks and its integration into data pipelines.
- Proven experience in designing and building large-scale, high-performance data pipelines.
- Experience with data modeling, ETL processes, and data warehousing solutions.
- Familiarity with data governance, privacy regulations, and best practices in data security.
- Strong problem-solving skills and ability to work in a fast-paced environment.
Interested candidates please share resume to [Confidential Information].
