Job Description
SQL - Ability to write Medium complex SQLs
PySpark (or Spark with Scala) - Good Hands-on
Design Aspects - ETL/ Data Engg Pipeline
Cloud understanding (Any Cloud tech is fine)
Ability to debug issue and resolve the challenges (as an individual Contributor)
CI / CD- Basic to intermediate Level
Data Modelling
Airflow
Kafka
EMR/ Databricks
Snowflake
Hive
4-6 Years PySpark