Data Engineering Consultant

Early Applicant

Exp: 0-2 Years

Job Description

Continuous assuring of a high data quality by checking and validating it together with customer success team and data science/ technical consultant
Responsible for transforming (normalizing and standardizing) and storing incoming and outgoing data.
Interfering with data transmission technologies such as Apache Kafka.
work closely with product tech team on improving data model and data interface structure
Use of Python, Spark and SQL to implement complex ETL/ELT processes.
Interfacing with customers and external partners to align on data formats and transmission schedules.
Ensure all customer specific time effort is being tracked accurately
Ensure stable data flow incoming and outgoing

What You Bring

You have a university or college degree in (business) computer science, data science/engineering, mathematics or a comparable qualification.
Hands-on experience with the Big Data ecosystem (Spark, Hive/Impala, HBase, Yarn) and the data lake paradigm.
Experience with stacks based on AWS/Azure/GCP and Java/Scala/Python.
Experience with microservice architectures and data streaming systems such as Kafka.
Hands-on experience in database engineering with a focus on database architecture, production automation, monitoring systems, and operations.
You can think of data as a graph and know how to use Avro, Protobuf or JSON schema.
Hands-on experience in working practices of cross-functional teams.
Fluency in English. Other language skills are a plus.
Experience in retail application development is a plus.