Enterprise Technology Engineer

Early Applicant

Exp: 0-2 Years

Job Description

Design, develop, and implement data pipelines using Python (Pandas), SQL, and Apache Airflow.
Extract, transform, and load (ETL) data from various sources including web APIs, databases, and flat files.
Leverage AWS services like S3, Redshift, and EC2 to build and deploy data pipelines in the cloud.
Optimize and solve data pipelines for performance and efficiency.
Write unit and integration tests to ensure data quality and pipeline integrity.
Use Databricks for large-scale data processing tasks.
Create data visualizations to communicate insights to technical and non-technical audiences.
Collaborate with traders, trading analysts, business analysts and fellow engineers to ensure data pipelines meet business needs.
Work in an Agile environment (Kanban/Scrum) using Azure Dev Ops for planning, tracking, and leading work.
Document data pipelines and procedures for maintainability and knowledge transfer.
Bachelor s or master s degree or equivalent experience in computer science, engineering, information systems or a numerate degree