Responsibilities
Azure Data Engineering:
Design, develop, and maintain data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.
Implement data storage solutions leveraging Azure SQL Database, Azure Data Lake, and other relevant Azure services.
Ensure data integration and ETL processes are optimized for performance and reliability.
MongoDB Administration
Install, configure, and maintain MongoDB databases across production, staging, and development environments.
Monitor database performance, implement strategies for improvement, and ensure high availability and disaster recovery.
Manage database security, backup, and recovery processes to protect data integrity.
Performance Tuning And Optimization
Conduct performance tuning of MongoDB databases and Azure data solutions to ensure optimal performance.
Analyze query performance, identify bottlenecks, and implement solutions to enhance efficiency.
Collaboration And Support
Collaborate with developers, data scientists, and other stakeholders to understand data needs and provide appropriate solutions.
Provide support for data-related issues and assist in troubleshooting and resolving problems promptly.
Qualifications
- Proficiency in Azure data services, including Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake.
- Strong experience with MongoDB, including installation, configuration, performance tuning, and maintenance.
- Solid understanding of data integration, ETL processes, and data warehousing concepts.
- Experience with scripting and automation using languages such as PowerShell, Python, or similar.
- Excellent problem-solving skills and ability to troubleshoot complex data issues.
- Strong communication and collaboration skills, with the ability to work effectively in a team-oriented environment