Data Engineer

Data Engineer is part of the in-house product engineering team that has been setup to create technical differentiation and intellectual property in the domain of Software Defined Vehicle (SDV). This role will be managing, transforming, extracting and loading data from Source Systems to Azure Data Storage services using Azure Data Factory.

As a Data Engineer , you will be responsible to own end-to-end development by working with various stakeholders. Your key responsibilities will include, but not limited to:

Design and Architecture: Design the structure and architecture of the data lake, ensuring it meets the organization's needs for data storage, processing, and analytics. Develop and maintain systems for ingesting data into the data lake from various sources, including databases, APIs, logs, and third-party sources.

ETL Process Management: Design, build, and maintain ETL pipelines to extract data from various sources, transform it into the desired format, and load it into target systems or data lakes. Automate ETL workflows and set up orchestration tools to schedule and monitor ETL jobs.

Data Quality and Implementation: Define and implement data transformation logic to clean, aggregate, and structure data to meet business and analytical requirements. Ensure the quality and consistency of data in the ETL process by implementing data validation checks and handling exceptions.

Collaboration and Communication: Collaborate with cross-functional teams, including hardware engineers, product managers, and designers, to ensure a cohesive user experience. Communicate technical concepts effectively to both technical and non-technical stakeholders.

Security and Compliance: Ensure that applications meet security standards and comply with relevant regulations. Implement security practices such as authentication, authorization, and data encryption.