We are seeking a highly skilled Senior Architect with extensive experience in leading Hadoop to BigQuery migration projects. As a key member of our team, you will be responsible for designing and implementing scalable solutions that leverage Google Cloud Platform (GCP) technologies, specifically focusing on BigQuery. Your expertise in Big Data technologies, Python scripting, and database migration will be crucial in ensuring the successful transition from Hadoop to BigQuery
Responsibilities
Key Responsibilities:
- Lead the architecture and design phases of the Hadoop to BigQuery migration project.
- Develop strategies and solutions for efficient data ingestion, processing, and storage on GCP.
- Collaborate with cross-functional teams to ensure alignment with business requirements and technical specifications.
- Implement best practices for data governance, security, and performance optimization.
- Provide technical guidance and mentorship to junior team members.
Mandatory Skills:
- GCP Data Engineer Certification
- Extensive experience with Big Data technologies and frameworks (e.g., Hadoop, BigQuery).
- Proficiency in Python for scripting and automation.
- Hands-on experience with Apache Airflow for workflow orchestration.
- Proven track record in database migration projects, particularly from Hadoop to BigQuery.
Optional Skills:
- Experience with Scala, PySpark, and Spark SQL.
- Proficiency in Java programming.
- Familiarity with Informatica or similar ETL tools.
Requirements
- A Bachelor's degree in any field, with a desired MSc/BE/Masters with
- 15+ years of experience in software development and architecture roles.
- Strong analytical and problem-solving skills.
- Excellent communication and interpersonal skills.
- Experience working in multi-channel delivery projects
