Company - Yash Technologies
Job location Bangalore
Experience 3-6 Years
ECTC 11-14 LPA
Job Title: Data Engineer
Job Description
- Data Engineer / Application Developer Foundry B.Tech/ B.Sc./M.Sc. in Computer Science or related field
- 3+ years of relevant industry experience Strong experience in Big Data & Data Analytics Experience in building robust ETL pipelines for batch as well as streaming ingestion
- Big Data engineers with a firm grounding in Object Oriented Programming and an advanced level knowledge
- commercial experience in Python, PySpark and SQL Interacting with RESTful APIs incl. authentication via SAML and OAuth2 Experience with test driven development and CI/CD workflows Knowledge of Git for source control management
- Agile experience in Scrum environments like Jira Knowledge of container technologies such as Docker and Kubernetes is an
- advantage Experience in visualization tools like Tableau or Qlik is a plus Experience in Palantir Foundry, AWS or Snowflake is an advantage
- Basic knowledge of Statistics and Machine Learning is favorable Problem solving abilities
- Proficient in English with strong written and verbal communication
Primary Responsibilities
Responsible for designing, developing, testing and supporting data pipelines and applications Industrialize data pipelines
Establishes a continuous quality improvement process to systematically optimize
data quality Collaboration with various stakeholders incl. business and IT
