Role Overview: Work Dynamics APAC is seeking a skilled Data Engineer to join our team. The main responsibility of this role is to prepare and organize data for Business Intelligence (BI) developers, acting as a foundation layer to build BI solutions and provide valuable insights to support senior executive reviews of the business. The ideal candidate will have 4-5 years of experience working in SQL Server, Azure, and Databricks environments, with a strong understanding of data engineering principles.
Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines to ingest, transform, and store data from various sources for BI purposes.
- Collaborate with cross-functional teams to gather data requirements and ensure data quality, accuracy, and consistency.
- Work closely with BI Analysts to understand their data needs and design optimal data models and structures.
- Develop and implement ETL/ELT processes to extract, transform, and load data from disparate sources into data warehouses or data lakes.
- Optimize and maintain existing data pipelines, including performance tuning and troubleshooting.
- Develop and enforce data engineering best practices, standards, and guidelines.
- Collaborate with IT and data governance teams to ensure compliance with data security and privacy regulations.
- Continuously evaluate and recommend new technologies and tools to improve data engineering processes and performance.
- Create and maintain documentation for data pipelines, data models, and workflows.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 4-5 years of professional experience as a data engineer, preferably in a SQL Server, Azure, and Databricks environment.
- Strong proficiency in SQL and experience with data modeling and database design principles.
- Experience in designing and building ETL/ELT processes, data pipelines, and workflows.
- Familiarity with big data processing tools such as Databricks, Spark, or Azure.
- Proficiency in scripting languages (e.g., Python, Scala) for data transformation and processing.
- Solid understanding of data governance, data quality, and data security principles.
- Strong analytical and problem-solving skills, with a keen attention to detail.
- Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
- Ability to work independently and manage multiple priorities in a fast-paced environment.
- Experience in the real estate industry or related fields is a plus.
If you are a motivated and experienced Databricks Data Engineer looking to contribute to the creation of impactful BI solutions that drive senior executive decision-making, we would love to hear from you.