- Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans by providing expert advice and guidance to others in the application of information and best practices; supporting and aligning efforts to meet customer and business needs; and building commitment for perspectives and rationales
- Provides and supports the implementation of business solutions by building relationships and partnerships with key stakeholders; identifying business needs; determining and carrying out necessary processes and practices; monitoring progress and results; recognizing and capitalizing on improvement opportunities; and adapting to competing demands, organizational changes, and new responsibilities
- Models compliance with company policies and procedures and supports company mission, values, and standards of ethics and integrity by incorporating these into the development and implementation of business plans; using the Open Door Policy; and demonstrating and assisting others with how to apply these in executing business processes and practices
What you'll do...
This role will focus on Data engineering and ETL development. A strong understanding of creating workflow is needed. This role will assist in ETL design leveraging standard Data Warehousing techniques and functional programming techniques.
What you'll do:
- Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide drive value from data at Walmart Scale
- Develop high performance and scalable solutions that extract, transform, and load Spark/big data.
- Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.
- Experience building and optimizing spark/big data data pipelines, architectures and data sets involving petabyte and terabyte of data.
- Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the tech community.
- Engage with Product Management and Business to drive the agenda, set your priorities and deliver awesome product features to keep platform ahead of market scenarios.
- Closely interact with Data Engineers from within Walmart to identify right open-source tools to deliver product features by performing research, POC/Pilot.
- Engage with Product Management and Business to support and build data solutions and develop expertise w.r.t data thereby being known as the true data analyst.
- You also get to collaborate with team members to develop best practices and client requirements for the software.
- You will show your skills in analyzing and testing programs/products before formal launch to ensure flawless performance.
- Software security is of prime importance and by developing programs that monitor sharing of private information, you will be able to add tremendous credibility to your work.
- You will also be required to seek ways to improve the software and its effectiveness.
- You will be called upon to support the coaching and training of other team members to ensure all employees are confident in the use of software applications.
What you'll bring:
- bachelors or masters degree in computer science or related technical field.
- Over all 3-6 years of programming experience in PySpark.
- 3-6 years of experience in building of large-scale data pipelines using big data technologies (ie, Spark / Kafka / Hadoop / Hive / Presto / Airflow / BiqQuery / SQL).
- Good Knowledge on Big Data, Apache Spark Scala Development
- Good understanding of on-premises big data technology.
- Good/Strong understanding of ETL & Data Warehousing concepts
- Strong in connecting to and ingesting from multiple source types to Google Cloud Storage
- Large scale distributed systems experience, including scalability and fault tolerance.
- Exposure to cloud infrastructure, such as Open Stack, GCP
- A continuous drive to explore, improve, enhance, automate and optimize systems and tools.
- Strong computer science fundamentals in data structures and algorithms
- Exposure to information retrieval, statistics, and machine learning.
- Excellent oral and written communication skills.
- Good understanding of metadata driven development
- Excellent problem solving, Critical and Analytical thinking skills.
Benefits
Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.
Minimum Qualifications
Option 1: Bachelors degree in Computer Science and 2 years experience in software engineering or related field.
Option 2: 4 years experience in software engineering or related field.
Option 3: Masters degree in Computer Science
