Akka + Spark ( Lead Dev AIOPS)

Long term

Location India

Remote

Payment USD Dollar

Send resume with a monthly rate intended to [Confidential Information]

Requirements

Akka Stream application + scalatest - able to write streaming apps in akka which migrate data from source to sinks

- Kafka, Spark, Airflow, Presto

- MongoDB

- Delta Lake

- Map reduce

• Strong knowledge (at least 1 expertise, experienced with some others)

- Scala, Java & Python

- Lake housing

- Event driven design

- Data engineering

- Streaming processing

- Data pipelining

Scala + Spark Batch and Streaming Jobs + S3 + Kafka + Scala test - Ability to build and maintain batch and streaming jobs

Comments

Need someone smart and technically sharp, to lead and guide the team. Discuss with Architect.