AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation.
At AHEAD, we prioritize creating a culture of belonging, where all perspectives and voices are represented, valued, respected, and heard. We create spaces to empower everyone to speak up, make change, and drive the culture at AHEAD.
We are an equal opportunity employer, and do not discriminate based on an individual's race, national origin, color, gender, gender identity, gender expression, sexual orientation, religion, age, disability, marital status, or any other protected characteristic under applicable law, whether actual or perceived.
We embrace all candidates that will contribute to the diversification and enrichment of ideas and perspectives at AHEAD.
AHEAD is looking for a Sr. Data Engineer (L3 support) to work closely with our dynamic project teams (both on-site and remotely). This Data Engineer will be responsible for hands-on engineering of Data platforms that support our clients advanced analytics, data science, and other data engineering initiatives. This consultant will build and support modern data environments that reside in the public cloud or multi-cloud enterprise architectures.
The Data Engineer will have responsibility for working on a variety of data projects. This includes orchestrating pipelines using modern Data Engineering tools/architectures as well as design and integration of existing transactional processing systems. The appropriate candidate must be a subject matter expert in managing data platforms.
Responsibilities
- A Sr. Data Engineer should be able to build, operationalize and monitor data processing systems
- Create robust and automated pipelines to ingest and process structured and unstructured data from various source systems into analytical platforms using batch and streaming mechanisms leveraging cloud native toolset
- Implement custom applications using tools such as EventHub's, ADF and other cloud native tools as required to address streaming use cases
- Engineers and maintain ELT processes for loading data lake (Cloud Storage, data lake gen2)
- Leverages the right tools for the right job to deliver testable, maintainable, and modern data solutions
- Respond to customer/team inquiries and escalations and assist in troubleshooting and resolving challenges
- Works with other scrum team members to estimate and deliver work inside of a sprint
- Research data questions, identifies root causes, and interacts closely with business users and technical resources
- Should possess ownership and leadership skills to collaborate effectively with Level 1 and Level 2 teams.
- Must have experience in raising tickets with Microsoft and engaging with them to address any service or tool outages in production.
Qualifications
- 7+ years of professional technical experience
- 5+ years of hands-on Data Architecture and Data Modelling SME level
- 5+ years of experience building highly scalable data solutions using Azure data factory, Spark, Databricks, Python
- 5+ years of experience working in cloud environments (AWS and/or Azure)
- 3+ years of programming languages such as Python, Spark and Spark SQL.
- Should have strong knowledge on architecture of ADF and Databricks.
- Able to work with Level1 and Level 2 teams to resolve platform outages in production environments.
- Strong client-facing communication and facilitation skills
- Strong sense of urgency, ability to set priorities and perform the job with little guidance
- Excellent written and verbal interpersonal skills and the ability to build and maintain collaborative and positive working relationships at all levels
- Strong interpersonal and communication skills (Written and oral) required
- Should be able to work in shifts
- Should have knowledge on azure Dev Ops process.
Key Skills
- Azure Data Factory, Azure Data bricks, Python, ETL/ELT, Spark, Data Lake, Data Engineering, EventHub's, Azure delta, Spark streaming
Why AHEAD
Through our daily work and internal groups like Moving Women AHEAD and RISE AHEAD, we value and benefit from diversity of people, ideas, experience, and everything in between.
We fuel growth by stacking our office with top-notch technologies in a multi-million-dollar lab, by encouraging cross department training and development, sponsoring certifications and credentials for continued learning.
We understand that you have a life outside of work. That's why we offer paid time off, paid company holidays, and a great benefits program including maternity/paternity leave and much more!
