10+ years of experience leading team of data engineers & architects in large scale & complex big data solutions
Expertise in developing architecture blueprints for various design patterns - batch, real time and micro batches.
Extensive experience in designing and implementing scalable data solutions using AWS services like MWAA and Lambda, RDS, ECS, EKS (7+ years).
Proficient in Databricks using pyspark, unity catalog, SQL Warehouse (6+ years) for optimizing data pipelines, ensuring high performance, and managing large-scale data processing.
Proficient in Snowflake (5+ years) for optimizing queries, schemas, and security layers.
Deep expertise in FinOps best practices in AWS, Databricks, and Snowflake to build cost effective data products and solution
Adept at developing and enforcing data governance policies and best practices to ensure data quality and compliance.
Skilled in deployment patterns and proficient with CI/CD tools, specifically CDK, CloudFormation, and Terraform.
Knowledge of using AppSecOps tools and best practices
