Pyspark developers

Deep expertise in Spark Job optimisations tuning

Debugging bottlenecks through Spark UI

Resource utilization of instances

Increasing throughput

Experience working with EMR EKS AWS

Understanding of OSS DeltaDelta lakeOpen Source StorageGeneral Spark job tuning involves optimizing configurations and parameters to enhance throughput and maximize resource utilization

Programming Java Scala Python SECONDARY SKILLAbility to work with APIs

Clean code with OOPs designs No DS algo required

Good to have - Familiarity with Spark Structured Streaming

Familiarity with Scala very rare

Familiarity with Python1Changes in SSC Socrates Streams Connector Rewrite Update the spark job using AWS open sourced Kinesis connector to land delta tables in S3

What is SSC and how it is deployed currently

Note:

You will be automatically registered for TriumphAsia's leading Virtual Career Fair for Diversity once you apply to this role listed with the participating organization.

The fair will be held between Nov 12th and 14th. This is an exclusive opportunity for professionals with more than 3 years of experience to get placed in leading diversity-

focused organizations in India.