Description
We are seeking a highly skilled Big Data Engineer with 5-9 years of experience to join our team in India. The ideal candidate should have a strong technical background in big data technologies and be able to design, develop, and maintain large-scale data processing systems. The candidate should also be able to work collaboratively with cross-functional teams to deliver high-quality solutions that meet the business needs.
Responsibilities
- Design and implement data processing systems using big data technologies such as Hadoop, Spark, and Kafka
- Develop and maintain data pipelines for data ingestion, processing, and storage
- Optimize and tune data processing systems for performance and scalability
- Collaborate with data scientists and analysts to build data models and analytics solutions
- Work with cross-functional teams to identify and solve complex data-related problems
- Stay up-to-date with the latest big data technologies and trends and evaluate their potential impact on the business
Skills and Qualifications
- Bachelor's or Master's degree in Computer Science or a related field
- 5-9 years of experience in big data technologies such as Hadoop, Spark, and Kafka
- Strong programming skills in Java, Scala, or Python
- Experience with data modeling and database design
- Experience with distributed systems and parallel computing
- Experience with data warehousing and ETL processes
- Experience with cloud-based big data technologies such as AWS, Azure, or Google Cloud Platform
- Excellent problem-solving and analytical skills
- Ability to work independently and in a team environment
- Excellent communication and interpersonal skills
