Data Engineer

Job Title- Data Engineer

Position type- Full Time

Work Location- Bangalore,Noida, Gurgaon

Working style- Hybrid

Cab Facility- Yes

Shift Time - 12:30 pm- 9:30 pm (Flexible)

People Manager role: No

Required education and certifications critical for the role-

Bachelor's degree in computer science, engineering, or a related field

Required years of experience - 4-8 years of relevant experience

Aon is in the business of better decisions

At Aon, we shape decisions for the better to protect and enrich the lives of people around the world.

As an organization, we are united through trust as one inclusive, diverse team, and we are passionate about helping our colleagues and clients succeed.

Competencies

- Independent worker

- Research/reading around the subject

- Abstraction of the problem

Required Skills

- 4+ years Python + pyTest, UnitTest, numpy, pandas

- Understanding of functional/modular development

- TDD

- DevOps CI/CD

- Schema / Database design

- ETL / ELT

- Relational (RDBS) vs Non-Relational (NoSql data stores)

- Formats: Xml, Json, Parquet, Excel, CSV, TxT

- Github/ SourceControl

Desirable / Awareness of

- Docker

- Airflow

- Spark

- Rabbit

- Kafka

- ML tools

1. Technical Skills

• Programming Languages: Proficiency in languages like Python, SQL, and sometimes Scala or Java for data processing.
• Database Management: Experience with both relational (SQL-based) and NoSQL databases, such as MS SQL
• Data Warehousing: Knowledge of data warehousing solutions like Amazon Redshift, Google BigQuery, Snowflake, or Microsoft Azure SQL Data Warehouse.
• ETL Tools: Proficiency with Extract, Transform, Load (ETL) tools such as Apache Airflow, Talend, or Informatica.
• Big Data Technologies: Experience with Hadoop ecosystem (Hive, Pig, HDFS) and Spark, Databricks for processing and managing large datasets.
• Machine Learning Modelling: Faimiliarity with XGBoost and creating decision trees.
• Cloud Platforms: Familiarity with cloud services (AWS, Google Cloud Platform, or Microsoft Azure) and their data storage, computing, and analysis services.
• Modular Development: Class design and familiarity with testing modular code
• Testing: Familiarity with unit testing concepts such as pytest and unittest.

1. Data Modeling and Pipeline Design

• Ability to design, implement, and optimize data pipelines that enable efficient data flow and retrieval for downstream use.
• Knowledge of data modeling and schema design, including dimensional modeling for analytics.
• Knowledge of streaming concepts and transformations required to convert data. Medallion approach to transformations.

1. Data Quality and Monitoring

• Experience with tools and processes to ensure data accuracy, consistency, and integrity.
• Setting up data validation, monitoring, and error-handling systems to maintain high data quality standards.

1. Scalability and Optimization

• Skills in optimizing data systems to handle scaling and increasing data volumes effectively.
• Knowledge of distributed systems, caching, and query optimization to improve performance.

1. Problem-Solving and Analytical Thinking

• Strong analytical skills for identifying data issues and understanding business requirements.
• Creative problem-solving ability to develop efficient data solutions that fit project needs.

1. Soft Skills

• Collaboration: Working effectively with data scientists, analysts, and other teams to understand data needs and ensure proper data access.
• Communication: Clearly communicating technical processes and insights to both technical and non-technical stakeholders.
• Attention to Detail: Ensuring data accuracy and completeness in all data processes.

How we support our colleagues

In addition to our comprehensive benefits package, we encourage a diverse workforce. Plus, our agile, inclusive environment allows you to manage your wellbeing and work/life balance, ensuring you can be your best self at Aon. Furthermore, all colleagues enjoy two Global Wellbeing Days each year, encouraging you to take time to focus on yourself. We offer a variety of working style solutions, but we also recognise that flexibility goes beyond just the place of work... and we are all for it. We call this Smart Working!

Our continuous learning culture inspires and equips you to learn, share and grow, helping you achieve your fullest potential. As a result, at Aon, you are more connected, more relevant, and more valued.

Aon values an innovative, diverse workplace where all colleagues feel empowered to be their authentic selves. Aon is proud to be an equal opportunity workplace.

Aon provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, creed, sex, sexual orientation, gender identity, national origin, age, disability, veteran, marital, domestic partner status, or other legally protected status.

We welcome applications from all and provide individuals with disabilities with reasonable adjustments to participate in the job application, interview process and to perform essential job functions once onboard. If you would like to learn more about the reasonable accommodations we provide, email

#LI-SN-1