About Moonfrog:
Moonfrog is a leading gaming company dedicated to creating innovative and engaging games for players around the world. We are passionate about delivering top-notch gaming experiences and continuously evolving our offerings to meet the dynamic needs of our audience. Join our team and be part of the exciting world of gaming!
Position Overview:
We are seeking a talented and experienced Data Engineer 2 to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining our data pipelines and customization platform. Additionally, you will focus on integrating machine learning capabilities to enhance our customization platform and drive innovative solutions. Your expertise in big data technologies, such as Spark, Hadoop, Amazon EMR, and experience in machine learning, will be crucial in ensuring the efficiency and scalability of our data infrastructure.
Key Responsibilities:
- Data Pipeline Development: Design, construct, and maintain scalable data pipelines to automate the extraction, transformation, and loading (ETL) of data from various sources.
- Customization Platform Management: Oversee and enhance our customization platform, integrating machine learning models to provide personalized experiences for players.
- Big Data Technologies: Utilize Spark, Hadoop, Amazon EMR, or similar technologies to process and manage large datasets efficiently.
- Machine Learning Integration: Collaborate with data scientists to implement machine learning models into the customization platform, ensuring seamless integration and scalability.
- Data Integration: Integrate data from diverse sources, ensuring consistency, accuracy, and availability across our systems.
- Data Quality and Governance: Implement measures to ensure the integrity and quality of our data, and enforce data governance policies.
- Performance Optimization: Optimize data processing and storage solutions for performance, speed, and reliability.
- Collaboration: Work closely with game developers, data scientists, and other stakeholders to understand data needs and provide the necessary infrastructure and tools.
- Documentation and Reporting: Document data architecture, data flow, and processing steps; generate reports and provide insights on data infrastructure performance.
- Security and Compliance: Implement security measures to protect data and ensure compliance with relevant regulations and standards.
Qualifications:
- Experience: Minimum of 3-5 years of experience in data engineering or a related field.
- Technologies: Proficiency in Spark, Hadoop, Amazon EMR, or similar big data technologies is required.
- Machine Learning: Experience with integrating machine learning models into production systems.
- Programming: Strong programming skills in languages such as Python, Java, or Scala.
- Data Modeling: Experience with data modeling, data warehousing, and data integration techniques.
- Data Storage Solutions: Familiarity with data storage solutions like Amazon S3, HDFS, or other distributed storage systems.
- Problem-Solving: Excellent problem-solving skills and attention to detail.
- Collaboration: Ability to work collaboratively in a fast-paced, cross-functional team environment.
- Education: Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).
Preferred Skills:
- Experience in the gaming industry or a similar high-data-volume environment.
- Familiarity with cloud platforms such as AWS, GCP, or Azure.
- Experience with data orchestration tools like Apache Airflow or AWS Step Functions.
- Knowledge of data governance and data quality best practices.
- Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders.
