Skills:
SQL, Python, Data Warehousing, Data Pipeline Development, Azure Databricks, PySpark, Snowflake Cloud,
Job title - Senior Data Engineer
Exp - 6 to 8 years
Job Location: Coimbatore / Hyderabad
Do you love building the infrastructure that fuels data-driven decision making Are you passionate about wrangling raw data into a usable format If so, then we want to hear from you!
We are searching for a
Senior Data Engineer to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the organization.
Responsibilities
- Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.
- Develop and implement data quality checks and monitoring processes to ensure data integrity.
- Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.
- Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.
- Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.
- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
- Version control code using Git and collaborate with the team through code reviews.
- Document data pipelines and processes for future reference and knowledge sharing.
Qualifications
- 5+ years of experience in data engineering or a related field.
- Proven experience in designing, developing, and deploying data pipelines.
- Hands on experience with Snowflake or Data Bricks, Python or Pyspark and SQL
- Should have experience working in Data Build Tool (DBT).
- Experience with data warehousing and data modeling concepts.
- Experience working with cloud platforms (AWS, Azure, GCP) is a plus.
- Working knowledge of Terraform and Infrastructure as Code (IaC) principles.
- Experience with Git for version control.
- Excellent communication and collaboration skills.
- Should have experience in leading the data team.
- Ability to work independently and as part of a team.
- Strong problem-solving and analytical skills.
Bonus Points
- Experience with data orchestration tools (Airflow, Luigi, etc.).
- Experience with data visualization tools (Tableau, Power BI, etc.)
