Software Development Engineering- Data

Aspire For Her is excited to present the following opportunity with one of our esteemed partners.

Please find the details below:

Are you looking to return from a career break

This Returnship Program is an initiative designed to support professionals looking to re-enter the workforce post-career break by offering a 24-week paid internship opportunity, with potential full-time employment upon successful completion of the internship, depending on performance and feedback during the program. This is an opportunity for professionals with a minimum of 4 years of prior work experience. The program will enable you to work on projects that match your expertise, interests, and abilities.

Job Description

Coding & Development Practices:

1. Good understanding of distributed computing concepts.

2. Very good knowledge on PySpark and dataframe APIs.

3. Understanding of Spark application performance tuning and optimisations. Should have worked on batch and good to have streaming data processing experience.

4. Good understanding of Hive and usage with Spark as well as any other open table format like iceberg.

5. Good knowledge on data integration tools similar to Sqoop or ADF (Azure Data Factory).

6. Experience on orchestration tools like oozie; airflow etc.

7. Basic knowledge on shell scripting.

8. Proven ability to write clean code that's maintainable and extensible (design patterns; OOPs).

Proven ability to write unite test cases.

9. Comfortable with Git and GitHub.

10. Experience in cloud platform like MS Azure is an added advantage.

11. Automate everything by default and debugging problem-solving capabilities.

12. Understanding of building a CI/CD pipeline

13. Understanding automation and apply it for security scanning, implementation and performance testing as part of build.

Design:

1. Actively participate with the team to evaluate multiple design decisions to choose an appropriate solution based on functional and non-functional requirements

2. Actively work along with the team to understand the requirements and to convert them into user stories

3. Active participation and design thinking with the team considering future needs, maximize performance.

4. Ability to design reusable and scalable modules

Problem Solving:

1. Solves problems on their own merit.

2. Clarifies requirements and asserts them in unit tests when necessary.

3. Takes an iterative incremental approach to solving the problem.

4. Is able to communicate and discuss the problem effectively with the team.

5. Able to re-create the problematic scenario and suggest ideal solution.

Skills:

Data Engineering; Big Data Processing; Spark; Hadoop; HBase; Hive; Hadoop; Data Pipelines;

Python; Scala; CI; CD; Problem Solving; Leadership skills; Performance analysis & improvements.