Data Engineer - PySpark developer

KeyResponsibilities

Creatingcomplex,enterprise-transformingapplicationsondiverse,highenergyteams

Workingwiththelatesttoolsandtechniques

Hands-oncoding,usuallyinapairprogrammingenvironment

Workinginhighlycollaborativeteamsandbuildingqualitycode

Thecandidatemustexhibitagoodunderstandingofmodelimplementation,datastructures,datamanipulation,

distributedprocessing,applicationdevelopment,andautomation.

Thecandidatemusthaveagoodunderstandingofconsumerfinancialproducts,datasystemsanddata

environments,andprocessesthatarenecessaryfortheimplementationofRiskandFinancemodels

EssentialSkills&Prerequisites

Degreeincomputerscienceoranumeratesubject(e.g.engineering,sciences,ormathematics)orBachelor's/Master

degreewith6yearsofexperience

Hand-onDevelopmentexperiencewithPySpark,Scala,SparkandDistributedcomputing.

Developmentandimplementationexperienceofapplicationsfor4-6years.

4to6yearsexperiencedesigninganddevelopinginPython.

4to6yearsexperienceinHadoopPlatform(Hive,HDFSandSpark)

3to5yearsexperiencewithUnixshellscripting

3to5yearsexperiencewithSQL

2to3yearsexperiencewithSparkprogramming.

Knowledgeofmicro-servicesarchitectureandcloudwillbeaddedadvantage.

KnowledgeofJavaandScalawillbeaddedadvantage

Desired

ABachelor'sdegreeorhigherpreferablyinComputerScienceorIT

Additionalexperienceondevelopingservice-basedapplication

Excellentanalyticalskills:ProficientinMSOfficeandabletoproduceboard-leveldocumentation

FluencyinwrittenandspokenEnglish;Goodcommunicationandinterpersonalskills

Self-starterwhosetsandmeetschallengingpersonaltargets,Detailedperson,withabigpictureoutlook

UnderstandingofcurrenttechnologiesemployedbyTier1InvestmentBankingInstitutions

Mustbeateamplayer