Data Engineer

Company name confidential

Quick Apply

2-4 Years

INR 8.1 - 12.4 LPA

Internet/E-commerce

Job Description

HIRING FOR AIRBNB

Responsibilities:

Design and develop ETL and data processing solutions using data integration tools, python scripts, and AWS / Azure / On-Premises Environment.
Develop and create transformation queries, views, and stored procedures for ETL processes, and process automation.
Document data mappings, data dictionaries, processes, programs, and solutions as per established standards for data governance.
Work with the data analytics team to assess and troubleshoot potential data quality issues at key intake points such as validating control totals at intake and then upon transformation, and transparently build lessons learned into future data quality assessments.

Requirements:

2+ Years experience as an ETL developer with strong data architecture knowledge around data warehousing concepts, SQL development and optimization, and operational support models.
Experience using Python to automate ETL/Data Processes jobs.
Experience / Willingness to learn AWS Glue / AWS Data Pipeline / Azure Data Factory for Data Integration.
Solid experience with data modelling, business logic, and RESTful APIs.
Solid experience in the Linux environment.
Experience with NoSQL / PostgreSQL preferred.
Experience working with databases such as MySQL, NoSQL, and Postgres, and enterprise-level connectivity experience (such as connecting over TLS and through proxies).
Experience with NGINX and SSL.
Performance-tune data processes and SQL queries and recommend and implement data process optimization and query tuning techniques.