Data Engineer- Job Location:- Bengaluru/Solapur
- Experience Level:-5-8 years
We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have a Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field, as well as proven experience as a Data Engineer or similar role. The candidate must have a strong knowledge of data management, data warehousing, and ETL processes. In addition, the candidate should have experience with cloud services such as GCP, Azure, AWS, familiarity with Agile development methodologies, and experience with distributed data/computing tools.
Design, build, and maintain data pipelines to collect and process data from various sources, including databases, APIs, and external feeds to support the needs of the Data Science team.
Work with the Data Science team to understand their data requirements and design and implement solutions to meet those requirements.
Develop and maintain data models and schema designs to support data analytics and machine learning workflows.
Collaborate with cross-functional teams to integrate data engineering solutions into business systems and applications.
Ensure data quality, data accuracy, and data consistency throughout the data pipeline and data warehouse.
Keep up to date with the latest developments in data engineering, data management, and related fields and apply them to business problems as needed.
Monitor and optimize the performance of data pipelines and infrastructure to ensure optimal performance and scalability.
Maintain comprehensive documentation for data engineering processes, pipelines, and systems.
Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field.
Proven experience as a Data Engineer or similar role.
Strong knowledge of data management, data warehousing, and ETL processes.
Experience with cloud services (GCP, Azure, AWS).
Familiarity with Agile development methodologies.
Experience with distributed data/computing tools.
Familiarity with database systems such as MySQL, MongoDB, and PostgreSQL, and familiarity with SQL and NoSQL databases.
Proficiency in at least one programming language, such as Python or Java.
Experience with big data platforms like Hadoop, Spark, or similar technologies.
Familiarity with data modeling and schema design.
Excellent written and verbal communication skills.
Strong problem-solving ability.
Ability to work collaboratively with cross-functional teams, including Data Scientists, Software Engineers, and Business stakeholders, to deliver data engineering solutions that meet business needs.
Strong attention to detail and ability to manage multiple projects simultaneously.
Job Type: Full-time
Pay: 557,
- 07 - 1,922,002.62 per year
Education: - Bachelor's (Preferred)
Experience:
- Data Engineer: 5 years (Preferred)
Work Location: In person
