Job Description
1.About the Job - The candidate should require mandatory Data Engineer, Hive, Hadoop, and Azure
2.Job Title - Data Engineer
3.Location - Bangalore, Hyderabad, Noida, Pune, Mumbai, Chennai
4.Educational Background - UG. B.Tech /B.E in any specialization & PG. MCA/MSC in Computers
5.Key Responsibilities -
8-10 years of extensive experience in designing, building, and maintaining complex ETL pipelines and data lakes/data marts in both on-premises and cloud environments.
Proficiency in using ETL tools like Talend, Informatica, or similar data integration platforms.
Deep expertise in data warehousing and data lake technologies, including Hadoop ecosystem.
(HDFS, Hive, Spark), Azure SQL, Azure Synapse Analytics, and other cloud-based data storage and processing services.
Solid understanding of data modelling and architecture principles, including dimensional modelling, star and snowflake schemas, and data normalization.
Experience in developing and optimizing efficient data ingestion, transformation, and load processes.
Strong problem-solving and critical thinking skills to identify and resolve data-related issues.
Excellent communication and collaboration skills to work with cross-functional teams, including data analysts, data scientists, and business stakeholders.
6.Skills Required -
Knowledge of cloud-based data engineering services, such as Azure Databricks, Azure Data Lake Storage, Azure Event Hubs, and Azure Stream Analytics.
Familiarity with NoSQL databases (e.g., MongoDB, Cassandra) and their integration with data ware housing and data lake solutions.
Familiarity with Agile software development methodologies and project management practices.
Certification in cloud data engineering (e.g., Azure Data Engineer Associate, AWS Certified Data Analytics Specialty)
7.Additional Requirements -
Hands-on experience in writing efficient SQL queries and working with programming languages like Python, Scala, or Java.
Experience in implementing and managing data pipelines using modern orchestration tools like Azure Data Factory.
About Company
Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a multibillion-dollar enterprise, we boast a 12,500+ professional team committed to upholding the Group's 162-year legacy. Our core values prioritize Diversity, Equity, and Inclusion (DEI) initiatives, along with Corporate Sustainable Responsibility (CSR) activities, demonstrating our dedication to building inclusive and sustainable communities. Join us in shaping a future where technology seamlessly aligns with purpose.