Job Summary:
As a Data Engineer, you will be responsible for designing, implementing, and maintaining the data architecture and infrastructure necessary for supporting our data analytics and business intelligence efforts. You will work closely with data scientists, analysts, and other stakeholders to ensure the efficient and reliable flow of data throughout the organization.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes to ingest, process, and transform large volumes of data from various sources.
- Build and optimize data storage solutions, including databases, data lakes, and data warehouses.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Implement and manage data governance, data quality, and data security measures to ensure data integrity and compliance with relevant regulations.
- Monitor and troubleshoot data pipelines and infrastructure to ensure optimal performance and reliability.
- Develop and maintain documentation for data processes, architecture, and workflows.
- Stay current with emerging trends and technologies in data engineering and recommend improvements to existing systems.
Qualifications
- Bachelor's or Masters degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
- Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (e.g., AWS, Azure, Google Cloud).
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with ETL tools and frameworks (e.g., Apache NiFi, Talend, Airflow).
- Familiarity with data warehousing solutions (e.g., Redshift, Snowflake, BigQuery).
- Knowledge of data modeling, data governance, and data security best practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Please use the below link for job application and quicker response.
https://lifelancer.com/jobs/view/b781487157a10e55aab104bc1a7ac835