- As a Data Engineer, this position will support the building of data pipelines for the Azure cloud data platform
- The data engineer will review the existing solution and design a unified solution to transfer the data to data lake and data warehouse
- The digital future has arrived and the tax and accounting professions are changing rapidly
- Professionals today have different needs, expectations and capabilities
- In addition to accuracy, they need greater mobility, simplicity and speed
- These needs place a premium on access to active intelligence, agile systems, and integrated workflow solutions in short Best in Process solutions
- This is precisely the value that Wolters Kluwer, Tax & Accounting US delivers to professionals
- If you enjoy tackling problems that are often elusive and working with software engineers to ensure the highest level of quality
- you're not content to know what , you need to know why , and are meticulous in your attention to detail
- You take your commitments seriously, and you are organized in your interfaces with the rest of the organization
- You have passions equally for technical excellence and seeing your work have an impact
ESSENTIAL DUTIES AND RESPONSIBILITIES
- Participate and collaborate with team members to review the use cases for data pipelines.
- Design and develop highly optimized and reliable enterprise level data pipelines to move data to data warehouse in real-time.
- Review and analyze existing business process, identify any gaps, and recommend improvements.
- Design and develop modern real-time solutions with Scala, Spark, Azure Databricks.
- Partner with business users and data scientists to build and deploy machine learning models.
- Improve data governance and operational excellence.
- Develop data expertise and take ownership of data quality for the newly developed pipelines.
- Adhere to company coding standards and best practices.
- Conduct code reviews and create technical solution document.
MINIMUM QUALIFICATIONS
- 4 years of building data pipelines for structured and un-structured data.
- 1+ years of experience of azure data pipeline development.
- 2 + years of experience with Hadoop, Azure Databricks, Stream Analytics, Eventhub, Kafka.
- 2+ years of experience of relational and dimensional data modeling with SQL Server and data warehouse.
- 2+ years of experience with SQL Server, T-SQL, stored procedure development and database optimization.
- 2+ years of experience with MS BI stack (SSIS/SSRS/SSAS, Power BI).
- 1 + years of experience with Azure data platform (Azure data factory, Azure data lake, Azure SQL DB, Azure DW/Synapse).
- 1 + years of experience with Azure ML, Python, Scala
- 2+ years of experience with big data technologies.
- 2 + years of experience with Power BI, Azure Analysis Services
- Experience with working with business stakeholders, requirements & use case analysis.
- Strong communication and collaboration skills with creative problem-solving skills.
PREFERRED QUALIFICATIONS
- Bachelors degree in Computer Science or equivalent work experience.
- Experience with Agile/Scrum methodology.
- Experience with tax and accounting domain a plus.
- Azure Data Engineer certification a plus