Search by job, company or skills

bp

Staff data engineer

Early Applicant
  • a month ago
  • Be among the first 50 applicants

Job Description

Job summary

Job Family Group:


IT&S Group

Job Description:


Responsibilities
Leads, grows and develops a team of data engineers that writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
Creates positive engagement and drives an inclusive work environment with team and stakeholders through the quality of interactions and collaboration across multiple business entities.
Set and communicate team priorities that align and support the broader organization's goals
Effectively works with cross-disciplinary collaborators and stakeholders across multiple business entities.
Set clear expectations with individuals based on their level and role and aligned to the broader organization's goals. Meet regularly with individuals to discuss performance and development and provide feedback and coaching
Develop the mid-term technical vision and roadmap within the scope of your (often multiple) team(s)
Evolve the roadmap to meet anticipated future requirements and infrastructure needs
Architects and designs reliable and scalable data infrastructure.
Advocates for and ensures their team adheres to software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),
Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they oversee, responsible for defining and maintaining SLAs.
Qualifications

Essential

BS degree in computer science or related field
Experience (typically 2+ years) leading, growing and developing a data engineering team of around 7-30 people
Deep and hands-on experience (typically 5+ years) designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
3+ years of experience in a technical leadership role, overseeing projects
Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#)
Solid database and SQL knowledge
Experience designing and implementing large-scale distributed systems
Deep knowledge and hands-on experience in technologies across all data lifecycle stages
Strong stakeholder management and ability to lead teams through managerial and technical influence
Continuous learning and improvement mindset

Desired

No prior experience in the energy industry required
Senior Platform Engineer - (Individual Contributor, Grade H)

Responsibilities

As a Senior Platform Engineer, you will be responsible for designing, building, and maintaining the software infrastructure and services that powers our technology platforms. In this role, you will provide technical leadership of junior engineers to ensure that the platform is highly available, scalable, and secure. You will also be responsible for developing features, improving the platform's performance, and providing technical support to other teams.

Design and document sophisticated software components, services, and platforms
Implement robust and maintainable code with clear and maintained documentation
Deliver customer value in iterative fashion while working towards longer term systems to solve roadmap goals with increasing efficiency
Serve as a technical lead and own projects end-to-end
Communicate status and changes to the work they are responsible and accountable for, keep all stakeholders informed of changes and updates to original plan
Design test automation on all code implemented through unit testing and integration testing
Work with internal and external teams to bring new platforms to market
Maintain and enhance software frameworks for development
Serve as a technical mentor for other engineers on the team
Participate in code reviews and contribute to the development of best practices
Collaborate with cross-functional teams to identify and resolve platform-related issues
Support internal and external audit teams to prepare for and participate in security, software licensing, and regulatory audits, ensuring that all necessary documentation and evidence is available and accurate
Collaborate with cross-functional teams to implement new controls and procedures to ddress identified compliance gaps or risks
Define behaviour driven development cycle for Glue PySpark SDLF data pipelines
create training material and run sessions to support data engineers to adopt of new tooling and ways of working
define target Python package to consolidate existing Glue PySpark SDLF data pipeline helper functions
Support Bazel adoption for Data / Software Engineers across C&P
Improve development velocity, pull request merge rate, and product quality through introduction of continuous integration pipelines for Glue PySpark jobs:
design continuous integration solution for PySpark data pipelines
implement continuous integration pipelines within subtenant repositories

Improve development velocity though introduction of continuous deployment pipelines:

collaborate with AWS Data Hub platform team to define Glue PySpark SDLF data pipeline deployment APIs
collaborate with bp DevInfra and AWS Data Hub platform team to develop continuous deployment solution
support subtenant adoption of continuous deployment pipelines

Technical Skills we need from you

Bachelor's degree in Computer Science, Engineering, Computer Information Systems or equivalent work experience
Competent in the ability to adapt to new technologies and processes, and be able to work independently and as part of a team
Competent in problem-solving, with the ability to analyze complex problems, identify root causes and develop creative and effective solutions
Excellent communication skills and ability to communicate with your peers through to senior leaders. You should be able to engage and influence others to collect requirements, describe what you're doing, work through problems, and find productive solutions
Self-starter, able to handle ambiguity, navigate uncertainty, identify risks, and find the right people and tools to get the job done

Software Skills

Competent in at least one programming language (C#, Python, or TypeScript) including object-oriented design. You should be competent in the use of data structures, algorithms, runtime complexity, API and database design, as well as unit and functional test methodologies
Competent in writing secure, stable, testable, and maintainable code with minimal defects
Competent in systems design
4+ years of experience in software development, with a focus on platform or service engineering
Competent in software engineering practices & best practices for full software development life cycle, including coding standards, code reviews, source control management, continuous deployments, testing, and operations
Competent in designing and building complex software systems end-to-end which have been optimally delivered and operated in production. You should understand security and privacy best practices as well as how to properly monitor, log, and alarm production systems

Infrastructure Skills

Competent in building and scaling infrastructure services using Amazon Web Services or Microsoft Azure
Competent in the understanding of using core cloud application infrastructure services including identity platforms, networking, storage, databases, containers, and serverless
Competent in troubleshooting large-scale distributed production systems
4+ years of experience working on production systems. You'll have supported these production systems through on-call rotations

Database Skills

Competent knowledge of databases, such as relational, graph, document, and key-value
Competent ability in data modeling

Travel Requirement:


Up to 10% travel should be expected with this role

Relocation Assistance:


This role is eligible for relocation within country

Remote Type:


This position is a hybrid of office/remote working

Skills:


Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving

Legal Disclaimer:


We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment/accommodation related to bp's recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodation related to the recruitment process, please contact us.

If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

More Info

Industry:Other

Job Type:Permanent Job

Date Posted: 08/10/2024

Job ID: 95359853

Report Job

About Company

bp
Follow

Hi , want to stand out? Get your resume crafted by experts.

Similar Jobs

Sr Staff Data Engineer

RepucomCompany Name Confidential

Staff Data Engineer

PayPalCompany Name Confidential
Last Updated: 25-11-2024 07:17:28 PM
Home Jobs in Pune Staff data engineer