Experience: 3 -5 years
Job Desc: Data Engineer
Key Skills : Databricks, Python, PySpark , SQL, AZURE Cloud
Location : Pune
Job Description:
Technical Expertise:
Design and implement a scalable, secure, and efficient data platform to support large-scale data processing, storage, and access for AI applications.
Select and implement appropriate tools and technologies for data ingestion, transformation, storage, and retrieval for AI projects.
Develop and maintain data pipelines for efficient movement and processing of data for AI development and training.
Oversee data quality checks and establish data governance practices to ensure data integrity.
Collaborate with data scientists to understand AI requirements and translate them into technical solutions.
Stay up-to-date on the latest advancements in AI, machine learning, and data engineering technologies.
Communication and Collaboration:
Effectively communicate complex technical concepts to both technical and non-technical audiences.
Document processes, and best practices for knowledge transfer.
Qualifications:
Master's degree in computer science, Artificial Intelligence, Data Science, or a related field (Bachelor's degree with extensive experience may be considered).
4+ years of experience in data engineering or a related field.
Strong understanding of machine learning pipelines and experience with AI frameworks (TensorFlow, PyTorch, etc.) is a plus.
Extensive experience with big data technologies (Hadoop, Spark, Kafka) and cloud platforms (AWS, Azure, GCP) is essential.
Expertise in SQL and scripting languages (Python, Bash) is required.
Strong communication, collaboration, problem-solving, and leadership skills.
4+ years in Data Engineering, experience on AI Flow engineering will be huge plus.
Your future duties and responsibilities
Required qualifications to be successful in this role
Together, as owners, let's turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction.
Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our teamone of the largest IT and business consulting services firms in the world.
