Contributes to community building initiatives like CoE, CoP
Responsibilities
- Design and Develop Data Solutions: Architect, build, and optimize data pipelines and ETL processes on AWS using services like Amazon Redshift, Amazon RDS, AWS Glue, and AWS Lambda. Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
- Data Modeling and Warehousing: Design and implement data models, schemas, and data warehouses to support analytics and reporting needs. Ensure data integrity, reliability, and performance across all data-related processes.
- Data Integration and Transformation: Implement data integration solutions to consolidate data from various sources, ensuring consistency and accuracy. Transform and cleanse data as needed to meet business requirements.
- Performance Optimization: Identify opportunities for performance optimization and scalability improvements in data processing and storage. Implement best practices for data partitioning, indexing, and caching to enhance system performance.
- Monitoring and Maintenance: Monitor data pipelines and infrastructure components for performance, availability, and reliability. Implement proactive measures to address issues and ensure continuous operation.
- Documentation and Knowledge Sharing: Document data architecture, processes, and best practices. Contribute to knowledge sharing initiatives like CoE and CoP by sharing insights, presenting findings, and participating in discussions related to data engineering and AWS.
- Collaboration and Teamwork: Collaborate effectively with cross-functional teams including data scientists, analysts, and business stakeholders. Participate in Agile ceremonies and contribute to a culture of collaboration, innovation, and continuous improvement.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field.
- years of experience as a Data Engineer, with a strong focus on AWS technologies.
- Proficiency in SQL, Python, or other programming languages commonly used in data engineering.
- Hands-on experience with AWS data services such as Amazon Redshift, Amazon RDS, AWS Glue, AWS Lambda, etc.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- [Any additional qualifications specific to the role or organization]
Join us in our mission to leverage data for driving business growth and innovation, while also contributing to community building initiatives that promote knowledge sharing and collaboration across the organization. If you are passionate about data engineering and AWS, and thrive in a dynamic and collaborative environment, we'd love to hear from you!
Skills: collaboration,sql,python,performance optimization,data warehousing,aws,etl processes,data integration,amazon,data engineering,documentation,monitoring,data modeling
