Position Summary...
Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans by providing expert advice and guidance to others in the application of information and best practices; supporting and aligning efforts to meet customer and business needs; and building commitment for perspectives and rationales. Provides and supports the implementation of business solutions by building relationships and partnerships with key stakeholders; identifying business needs; determining and carrying out necessary processes and practices; monitoring progress and results; recognizing and capitalizing on improvement opportunities; and adapting to competing demands, organizational changes, and new responsibilities. Models compliance with company policies and procedures and supports company mission, values, and standards of ethics and integrity by incorporating these into the development and implementation of business plans; using the Open Door Policy; and demonstrating and assisting others with how to apply these in executing business processes and practices.
What you'll do...
Responsible for designing, coding, and maintaining data processing applications using Scala and Apache Spark. Develop and optimize data pipelines, implement complex data transformations, and perform analytics tasks. Collaborate with teams to integrate applications into data architectures and ensure high-quality performance.
About Team:
Enterprise Business Services is invested in building a compact, robust organisation that includes service operations and technology solutions for Finance, People, Associate Digital Experience.
What you'll do:
- Develop and maintain data pipelines using Apache Spark and Scala to process large volumes of data efficiently.
- Implement data transformation logic to cleanse, normalize, and aggregate data from various sources, ensuring high data quality and consistency.
- Develop Web services on Scala using various libraries like Akka HTTP, Play Framework etc.
- Develop efficient and scalable Kafka messaging solutions, configure and manage Kafka clusters, and ensure reliable data ingestion and processing.
- Integrate data from different systems and sources, including structured and unstructured data, databases, and Mainframe systems, ensuring seamless data flow and compatibility.
- Implement data validation and quality checks within data pipelines to ensure data accuracy, consistency, and integrity, and handle exception handling and error logging.
- Develop and execute unit tests, integration tests, and end-to-end tests to ensure the reliability and correctness of Spark applications. Debug and troubleshoot issues during development and production phases.
- Contribute to the overall DevOps for SBT builds, application deployment stages and releases.
- Designing, Implementing, and maintain Continuous Integration and Continuous Deployment pipelines. Automate/Optimize the build, test, and deployment processes to enable rapid and reliable software delivery.
- Collaborate with Walmart cross-functional teams, including Product managers, Architects, and other developers, to understand data requirements and deliver optimal solutions. Document data engineering processes, data flows, and technical specifications.
- Keep up-to-date with the latest advancements in Spark, Scala, and related technologies, frameworks, and tools. Continuously improve skills and knowledge through self-learning and professional development.
What you'll bring:
- Bachelor's degree in computer science or related discipline and 3 to 6 years of core software product development experience.
- Strong computer science fundamentals in algorithms, data structures, databases, operating systems, etc.
- Spark and Scala Expertise(Must): Strong proficiency in Apache Spark and Scala programming language, including extensive knowledge of Spark's core concepts, RDDs, DataFrames. Ability to write optimized and scalable Spark applications.
- Big Data Technologies: Familiarity with big data technologies and strong understanding of distributed computing concepts and experience with handling large-scale data processing.
- Strong expertise in Kafka messaging and good hands-on experience in developing Kafka-based applications
- Data Engineering: Solid understanding of data engineering principles, data modeling, and ETL (Extract, Transform, Load) processes. Experience in designing and developing data pipelines and working with various data formats (e.g., ORC, JSON, CSV, Parquet).
- SQL and Database Knowledge: Proficiency in SQL for data manipulation, querying, and performance optimization. Experience with relational databases (e.g., MySQL, PostgreSQL) and knowledge of database design principles.
- Strong understanding of Cloud-based data architecture and GCP services, including BigQuery, Cloud Storage, and Dataflow.
- Familiarity with containerization technologies (e.g., Docker, Kubernetes) and Strong knowledge of CI/CD concepts, tools, and best practices, such as Jenkins, GitLab CI/CD.
- Programming and Software Development: Strong programming skills and software development practices, including version control (e.g., Git), debugging, testing, and code documentation. Familiarity with software development lifecycle (SDLC) methodologies.
- Problem Solving and Analytical Thinking: Strong problem-solving skills and ability to analyze complex data engineering challenges. Capacity to break down problems, identify root causes, and propose effective solutions.
About Walmart Global Tech
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That's what we do at Walmart Global Tech. We're a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered.
We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.
Flexible, hybrid work
We use a hybrid way of working with primary in office presence coupled with an optimal mix of virtual presence. We use our campuses to collaborate and be together in person, as business needs require and for development and networking opportunities. This approach helps us make quicker decisions, remove location barriers across our global team, be more flexible in our personal lives.
Benefits
Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.
Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions while being inclusive of all people.
Minimum Qualifications...
Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.
Minimum Qualifications:Option 1: Bachelor's degree in computer science, information technology, engineering, information systems, cybersecurity, or related area and 2years experience in software engineering or related area at a technology, retail, or data-driven company.
Option 2: 4 years experience in software engineering or related area at a technology, retail, or data-driven company.
Preferred Qualifications...
Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.
Certification in Security+, Network+, GISF, GSEC, CISSP, or CCSP, Master's degree in Computer Science, Information Technology, Engineering, Information Systems, Cybersecurity, or related area
Primary Location...
Rmz Millenia Business Park, No 143, Campus 1B (1St -6Th Floor), Dr. Mgr Road, (North Veeranam Salai) Perungudi , India R-1812697
