Data Engineer - Contract

Contract Period will be for 6 Months. May be extended only if the Candidate is an Extrovert AND OR the Project Duration is further extended.

Job Description:

o Cloud Platforms: Familiarity with Azure cloud services.

o Microservices Architecture: Experience with designing and building scalable microservice architectures.

o Containerization and Orchestration: Exposure to Docker, Kubernetes, or similar technologies for containerization and orchestration.

o Expertise in API Development: Proficiency in designing, implementing, and maintaining RESTful APIs.

Data Pipeline Construction: Skills in building and maintaining robust data pipelines for large-scale data processing using languages like Python, PySpark, and SQL.

o Streaming Data: Experience creating streaming pipelines using technologies such as Kafka and Azure Event Hub.

o CI/CD Pipelines: Experience with Continuous Integration/Continuous Deployment (CI/CD) pipelines for automated testing and deployment.

o Database Management: Proficiency with various databases, both SQL and NoSQL, including Clickhouse, PostgreSQL, and knowledge of database optimization techniques.

Data Parsing Tools: Experience with tools such as Akka and MinIO.

o Agile Methodology: Experience with agile development methodologies and tools for version control, such as Git, Jenkins, or Azure DevOps.

o Proficiency in JavaScript: Strong knowledge of JavaScript and related frameworks for both front-end and back-end development.

o Collaboration and Communication: Strong teamwork skills and the ability to communicate effectively with both technical and non-technical stakeholders.