Data Engineer

Positon: Data Engineer

Location: Cochin, Kerala, India

Employment Type: Full-Time (In-office position)

Experience Level: 2 - 4 years

Job Description:

We are seeking a skilled Data Engineer to join our team in Cochin, Kerala. The ideal

candidate will have 2 to 4 years of experience in designing, implementing, and managing

data solutions. The role involves developing and maintaining data pipelines, architecting

data warehouses, and ensuring data integrity and security.

Key Responsibilities:

Data Architecture: Design and implement data architectures on Azure, including

data warehousing and ETL pipelines.

Data Pipelines: Develop and maintain data pipelines using ETL tools like Azure

Data Factory (ADF).

Data Processing: Process structured and unstructured data using Python, PySpark,

and SQL.

Data Warehousing: Implement data warehousing solutions using RDBMS

databases including synapse, MS SQL etc.

ETL Pipelines: Design and build ETL pipelines to extract, transform, and load data

from various sources.

Data Security: Ensure data security and compliance by implementing appropriate

access controls and encryption.

Collaboration: Work with data analysts, data scientists, and other stakeholders to

understand business requirements and deliver data solutions.

Troubleshooting: Troubleshoot data pipeline issues and optimize data processing

workflows.

Documentation: Document data architectures, data pipelines, and data

processing workflows.

Maintenance: Maintain and update existing data pipelines and data architectures.Required Skills:

Azure: Proficient in Azure Data Factory (ADF), Azure Synapse Analytics, and Azure

SQL Database.

SQL: Proficient in SQL and SQL Server.

Python: Proficient in Python and PySpark.

Data Warehousing: Strong understanding of data warehousing principles and ETL

pipelines.

Data Processing: Experience in processing structured and unstructured data.

Collaboration: Excellent communication and interpersonal skills.

Troubleshooting: Strong problem-solving and troubleshooting skills.

Preferred Skills:

Azure Certification: Azure Data Engineer certification is a plus.

DevOps: Experience with DevOps practices and tools like Azure DevOps and

Github.

NoSQL Databases: Experience with NoSQL databases like Mongo DB, Cassandra.

Machine Learning: Knowledge of machine learning frameworks and tools like

Azure Machine Learning.

Benefits:

Competitive salary and benefits package.

Opportunities for professional growth and advancement.

A dynamic and supportive work environment.