Data Engineer

JD-Data Engineer

Required Skills and Qualifications

Strong programming skills in Python, including experience with data libraries and frameworks, like OS, Flask, FastAPI, Marshmallow, SQL Alchemy.

Expertise with data pipeline orchestration tools like Apache Airflow

Ability to fetch JSON files using Python API and Airflow.

Ability to handle, process and manipulate sequential data using Python.

Ability to setup and manage Python Virtual Environments.

Source control - Git (daily commits, PR process, etc)

Knowledge on CI/CD pipelines

OPTIONAL: Experience of data warehouse & ETL like Snowflake, SQL and database mgmt.

Strong communication and collaboration skills, with the ability to work in a team environment.

Bachelor's or Master's degree in computer science, Information Technology, or a related field.

Key Responsibilities

Candidate should be able to write the code and explain the approach/logic and flow of code.

Utilize Python for automating data processes, integrating data systems, and building advanced analytics models.

Lead data modeling initiatives, ensuring the integrity and efficiency of data structures.

Collaborate with cross functional teams to understand data needs, gather requirements, and deliver data driven solutions that align with business goals.

Implement data security and compliance measures, adhering to industry standards and regulations.

Conduct data analysis and provide insights to support decision making and strategy development.

Stay abreast of emerging technologies and trends in data engineering, recommending, and implementing improvements to our data systems and processes.