Search by job, company or skills
vConstruct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data aspects of the business. You will be responsible for designing, developing, and maintaining our data infrastructure, ensuring data integrity, and supporting various data-driven projects. You will work closely with cross-functional teams to integrate, process, and manage data from various sources, enabling business insights and enhancing operational efficiency.
Responsibilities
Design, develop, and maintain robust, scalable data pipelines and ETL/ELT processes to efficiently ingest, transform, and store data from diverse sources.
Work with a variety of data sources, extracting actionable insights and valuable knowledge from large and complex datasets.
Architect and implement scalable, efficient data pipelines using Snowflake and DBT to support data processing and transformation.
Build and optimize data models, warehouses, and data marts to drive business intelligence and analytics initiatives.
Handle large datasets, creating transformation layers to enable effective analysis and decision-making.
Write clean, efficient, and reusable SQL queries within DBT to manage data transformations and ensure high-quality results.
Establish and enforce data quality checks, validation processes, and continuous monitoring using DBT to maintain data integrity.
Collaborate with cross-functional teams to design, implement, and sustain data-driven solutions that optimize data flow and system integration.
Organize and lead discussions with business and operational data stakeholders to understand requirements and deliver solutions.
Operate within an Agile framework, designing, developing, testing, and deploying analytics and reporting functionalities in an iterative manner.
Qualifications
5 to 8 years of experience in data engineering, with a focus on building data solutions at scale.
5+ years of hands-on experience in writing complex, highly optimized SQL queries across large data sets.
3+ years of hands-on experience working with Snowflake.
2+ years of experience using DBT (Data Build Tool) for data transformation.
2+ years of experience in scripting languages like Python etc.
Expertise in SQL with a strong focus on database optimization and performance tuning.
Proficient in using Snowflake for data warehousing, modeling, and scalable data solutions.
Extensive hands-on experience with DBT (Data Build Tool) for data transformation, including developing and maintaining modular, reusable, and efficient DBT models.
Strong ability to write and optimize DBT SQL models for transformation layers and data pipelines.
In-depth understanding of data warehousing principles and dimensional modeling.
Hands-on experience with data integration tools like Azure Data Factory, Matillion, or FiveTran, with a preference for Azure Data Factory.
Proven experience with API integrations and working with diverse data sources.
Ability to understand, consume and use API's, JSON, Webservices for data pipelines.
Experience in designing and implementing data pipelines using cloud platforms such as AWS, GCP, or Azure.
Education
Bachelor's or Master's degree in Computer Science/Information technology or related field.
Equivalent academic and work experience can be considered.
About vConstruct:
vConstruct specializes in providing high quality Building Information Modeling and Construction Technology services geared towards construction projects. vConstruct is a wholly owned subsidiary of DPR Construction. For more information, please visit www.vconstruct.com
About DPR Construction:
DPR Construction is a national commercial general contractor and construction manager specializing in technically challenging and sustainable projects for the advanced technology, biopharmaceutical, corporate office, and higher education and healthcare markets. With the purpose of building great thingsgreat teams, great buildings, great relationshipsDPR is a truly great company. For more information, please visit www.dpr.com.
Industry:Other
Job Type:Permanent Job
Login to check your skill match score
Date Posted: 30/10/2024
Job ID: 98690227