Qualifications
- Bachelor's degree in Engineering, Computer Science, or relevant field.
- 5+ years of experience in a Data Engineer role.
- 3+ years experience with Apache Spark and solid understanding of the fundamentals.
- Deep understanding of Big Data concepts and distributed systems.
- Strong coding skills with Scala, Python, Java and/or other languages and the ability to
quickly switch between them with ease.
- Advanced working SQL knowledge and experience working with a variety of relational
databases such as Postgres and/or MySQL.
- Cloud Experience with DataBricks
- Experience working with data stored in many formats including Delta Tables, Parquet,
CSV and JSON.
- Comfortable working in a linux shell environment and writing scripts as needed.
- Comfortable working in an Agile environment
- Machine Learning knowledge is a plus.
- Must be capable of working independently and delivering stable, efficient and reliable
software.
- Excellent written and verbal communication skills in English.
- Experience supporting and working with cross-functional teams in a dynamic
environment.
Skills: data engineering,data lakes,big data,cloud,scala,python,java,apache spark,mysql,postgresql,sql,json,computerized system validation (csv),us process
