Technical Lead

Early Applicant

Exp: 8-12 Years

Job Description

What you'll do

Extract, Transform and Load data from multiple sources and multiple formats using Big Data Technologies.
Development, enhancement, and support of data ingestion jobs from various source systems using GCP Services such as Dataproc, Dataflow, BigQuery, Airflow, etc.
Work closely with senior engineers to optimize query and data access techniques.
Apply modern software development practices (serverless computing, microservices architecture, CI/CD, infrastructure-as-code, etc.)

What Experience You Need

12+ years of overall IT experience
8+ years experience in Java & Big Data
Bachelor's degree in Computer Science, Systems Engineering or equivalent experience.
GCP Services- Dataflow, Dataproc, BigQuery, Airflow, GCS, PubSub
Programming Language - JAVA, Python
BigData framework - Apache Beam, Apache Spark, Airflow 2+
Relational databases (e.g. SQL Server, Oracle, MySQL)
Source code control management systems (e.g. SVN/Git, Github)
Build tools - Maven or Gradle.
Agile environments (e.g. Scrum)
Atlassian tooling (e.g. JIRA, Confluence)

What could set you apart