Senior Data Engineer

Minimum Qualifications

6+ years experience in Data Engineering Data Processing using various tools

Excellent understanding and hands on experience with T-SQL programming

Excellent understanding and hands on experience with Microsoft SQL Server, other RDBMS, and No-SQL systems

Excellent understanding and hands on experience with ETL, Data Warehouse and Data Lake Concepts

Exposure to cloud database technologies

Skills/Knowledge

Python, Spark, Jupyter, AWS Lambda, AWS S3, AWS EMR, AWS Glue, AWS Step Functions

Good to have AWS QuickSight

DocumentDB/DynamoDB/RDS/Athena/MSK/Amazone Redshift/ Apache Iceberg

Big data experience (Pyspark/Hadoop/Bigdata)

Technical expertise with data models, data mining and segmentation techniques and software architecture.

Good in performance tuning, especially tuning complex queries, procedure, and indexing strategies

Working experience with relational databases, queries optimization (DBA or database developer with proven hands on application and understanding) with high emphasis on postgres and SQL.

Proficient with Database Normalization process.

Must be proficient in MS-SQL programming and can handle complex logic.

Expert in SQL Queries, Stored Procedures, Performance Measurement & Tuning.

Designing and developing Database solutions, schemas for structured and unstructured data, stored procedures, and functions.

Experience on various ETL tools and techniques to handle data for cleaning, formatting, extraction, transforming and loading into Database Data Warehouse/Data Lake

Build data systems, pipelines, and workflows.

Work with software engineering teams to develop and scale our data infrastructure.

Develop and test stored procedures, views, triggers, and functions.

Sound knowledge and practical experience covering end to end Data Science life cycle.

Write well designed, testable, and efficient code.

Design, develop and implement the complete life cycle of data warehouses, data lakes etc.

Ensure compliance of standards and conventions in developing programs.

Good to have .Net/Java