Azure Data Engineer

About Truelancer Enterprise:

Truelancer Enterprise is a premier Gig Talent platform that connects large enterprise clients with highly skilled and vetted software developers. Our network ensures top-tier professionals, providing unmatched expertise to tackle any project. With Truelancer Enterprise, businesses gain access to a pool of exceptional talents, fostering innovation, and achieving success. Trust, efficiency, and excellence define our commitment to empowering enterprises with the best tech solutions, making us the ultimate destination for hiring top-notch software developers.

About the Client:

Our client is a global leader in next-generation digital services and consulting. Enabling clients in 45 countries to navigate their digital transformation. With over three decades of experience in managing the systems and workings of global enterprises.

Job Title: LEAD DATA ENGINEER Azure

Years of Experience: 7+ years

Location: Chennai, Coimbatore (Hybrid WFO 3 days a week)

Role Description

As an Azure Lead Data Engineer, your primary role is to design, develop, and manage data systems on the Microsoft Azure cloud platform. You will be responsible for leading a team of

data engineers and collaborating with other teams to ensure the reliability and scalability of the data systems

If you love the challenges that come with big data, then this role is for you. We are looking for Data Engineers who can handle of events a day, manage petabyte scale data on Redshift and

S3, and develop data pipelines using Spark/Scala EMR, SQL based ETL, and Java services.

You are a talented, enthusiastic, and detail-oriented Data Engineer, Data Science, Business Intelligence, or Software Development who knows how to take on big data challenges in an

agile way. Duties include big data design and analysis data modeling, and development, deployment, and operations of big data pipelines. You will also help hire, mentor, and develop

peers in the Data Analytics team including Data Scientists, Data Engineers, and Software Engineers. You will help Coda build data pipelines and data sets and expand self-service data

knowledge.

This role requires you to live at the cross section of data and engineering. You have a deep understanding of data, analytical techniques, and how to connect insights to the business, and

you have practical experience in insisting on highest standards on operations in ETL and big data pipelines.

We deal in Azure technologies like Azure SQL, Azure Data Factory, Azure Synapse, Azure

Dedicated SQL Pool, Azure Data Lake, Azure Databricks, PySpark, SparkSQL, Azure Analysis Services, SSIS, Power BI and Data Modeling. You will build our data portfolio and partner with

Product, Marketing, BI, and ML teams to build new behavioral events, pipelines, datasets, models, and reporting to support their initiatives. You will also continue to develop our offline analytics capabilities in Tableau and build out our real-time dashboarding capabilities.

Basic Qualifications

Designing and implementing large-scale data processing systems on Azure, including data ingestion, storage, processing, and visualization.

Developing data integration and migration strategies to move data from legacy systems to Azure.

Building data pipelines and ETL workflows using Azure Data Factory, Azure Databricks, or other relevant tools.

Designing and implementing data models, data warehouses, and data lakes using Azure Synapse Analytics, Azure SQL Data Warehouse, or other relevant tools.

Working with data scientists and analysts to understand their data requirements and ensure that the data infrastructure supports their needs.

Monitoring and troubleshooting the performance and availability of the data systems and implementing strategies to improve their reliability and scalability.

Managing security and access controls for the data systems, including managing roles and permissions, implementing encryption, and complying with regulatory requirements.

Mentoring and guiding junior data engineers and providing technical leadership to the team