Job Title: Big Data Engineer
Location:Remote
Employment Type: Full-time
Experience Level: Mid to Senior Level
Job Overview:
We are seeking a skilledBig Data Engineerwith expertise inAzure Cloud,Databricks, and a strong background inJavaandSpark/Scala. The ideal candidate will have hands-on experience designing and implementing scalable data pipelines and working with large-scale distributed systems. This is an opportunity to work on cutting-edge data solutions and contribute to impactful projects in a collaborative environment.
Key Responsibilities:
- Design, develop, and optimizebig data pipelinesusingSparkandScala.
- Implement data processing workflows onAzure Databricksto handle complex datasets efficiently.
- LeverageAzure Cloud servicesto design scalable and reliable data solutions.
- Write high-quality, reusable, and efficientJavacode for backend systems and data processing.
- Collaborate with cross-functional teams to integrate data solutions into applications and services.
- Monitor and maintain the performance of data systems, ensuring data integrity and reliability.
- Stay updated with the latest industry trends and technologies to improve systems and processes.
Required Qualifications:
- Azure Cloud: Minimum of 2 years of hands-on experience with Azure services such as Azure Data Lake, Azure Synapse, or Azure Functions.
- Databricks: At least 2 years of experience working with Databricks for data engineering or analytics projects.
- Big Data: 2+ years of experience with big data tools and frameworks, including Hadoop, Spark, and Kafka.
- Java Development: 5+ years of experience with strong proficiency in building robust, scalable systems.
- Spark/Scala: Minimum of 2 years of experience with Spark for big data processing and Scala programming.
