Developer - Connected Platform

As an Developer - Connected Platform, you will be responsible to own end-to-end of development by working with various stakeholders. Your key responsibilities will include, but not limited to:

Data Pipeline Development: Design and implement data pipelines using Kafka, MQTT, or HTTP to facilitate real-time data streaming and integration from various sources. Ensure pipelines are scalable and maintainable

Data Ingestion and Integration: Develop systems to ingest data from a variety of sources, including IoT devices, databases, APIs, and external services. Integrate data into downstream systems and data lakes.

Real-Time Data Processing: Implement real-time data processing solutions using Kafka Streams, Kafka Connect, or similar technologies. Ensure that data processing is reliable and consistent with business requirements

Data Transformation and Storage: Design and implement data transformation logic to clean, aggregate, and structure data for downstream applications. Work with databases (SQL, NoSQL, or data lakes) to store and retrieve processed data

Collaboration and Communication: Collaborate with data scientists, analysts, and software engineers to understand data requirements and deliver solutions that meet their needs. Communicate technical concepts effectively to both technical and non-technical stakeholders

Continuous Improvement: Stay updated with the latest developments in data engineering, Kafka, and related technologies. Drive continuous improvement in data engineering practices and processes