Job Description
We are looking for an experienced data engineer to join our team. You will analyze and organize raw data, build data systems and pipelines. You would evaluate business needs & objectives, conduct complex data analysis and explore ways to enhance data quality and reliability. Work on data acquisition and collaborate with architects on several projects.
If you are detail-oriented, with excellent organizational skills and experience in this field, we'd like to hear from you.
Key Responsibilities
Provides thought leadership with respect to R&D of the latest and greatest Big data toolsets available in the market, perform comparative analysis and provides recommendations to choose the best tool as per the current and future needs of the enterprise.
Act as a strong proponent for promoting cloud technology culture within the organization. Provides thought leadership with respect to the R&D of the cloud toolsets available in the market.
Liaison as an intermediary between Data scientists/Platform and cloud engineering teams to understand the requirements, provide technical guidance/mentorship and consultation towards resolution of their queries.
Engineering responsibilities of the cloud ecosystem including data enablement and data acquisition support.
Provide thought leadership in development of automated pipeline, dataops and curation functions for the lake ecosystem.
Leading the technical discussions across infrastructure teams on tool and infra performance parameters such as CPU, disk IO, memory usage, disk space etc. in order to provide an optimal performance experience to the end users.
Encourage a culture of innovation and research within the team by providing strong thought leadership and promoting out-of-box thinking.
Diligently teaming with the cloud engineering, delivery, infrastructure (storage and compute), network, security teams to deliver an optimal tool experience to the end users.
Working closely with various stakeholders in US team with a collaborative approach.
Required Qualifications
7-10 years of overall IT experience, which includes hands on experience in Big Data technologies.
Mandatory - Hands on experience in Python and Pyspark. Python as a language is practically usable for anything, we are looking for application Development and Extract/Transform/Load and Data lake curation experience using Python.
Build Pyspark applications using Spark Data frames in Python using Jupyter notebook and PyCharm(IDE).
Worked on optimizing spark jobs that processes huge volumes of data.
Hands on experience in version control tools like Git.
Worked on Amazon's Analytics services like Amazon EMR, Amazon Athena, AWS Glue.
Worked on Amazon's Compute services like Amazon Lambda, Amazon EC2 and Amazon's Storage service like S3 and few other services like SNS.
Experience/knowledge of bash/shell scripting will be a plus.
Has built ETL processes to take data, copy it, structurally transform it etc. involving a wide variety of formats like CSV, TSV, XML and JSON.
Experience in working with fixed width, delimited , multi record file formats etc.
Good to have knowledge of data warehouse concepts dimensions, facts, schemas- snowflake, star etc.
Have worked with columnar storage formats- Parquet, Avro, ORC etc. Well versed with compression techniques Snappy, Gzip.
Good to have knowledge of AWS databases (at least one) Aurora, RDS, Redshift, ElastiCache, DynamoDB.
Preferred Qualifications
Certifications Preferred: aws Solution Architect
AWS Certified Cloud Practitioner Certification
About Our Company
Ameriprise India LLP has been providing client based financial solutions to help clients plan and achieve their financial objectives for 125 years. We are a U.S. based financial planning company headquartered in Minneapolis with a global presence. The firm's focus areas include Asset Management and Advice, Retirement Planning and Insurance Protection. Be part of an inclusive, collaborative culture that rewards you for your contributions and work with other talented individuals who share your passion for doing great work. You'll also have plenty of opportunities to make your mark at the office and a difference in your community. So if you're talented, driven and want to work for a strong ethical company that cares, take the next step and create a career at Ameriprise India LLP.
Ameriprise India LLP is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex, genetic information, age, sexual orientation, gender identity, disability, veteran status, marital status, family status or any other basis prohibited by law.
Full-Time/Part-Time
Full time
Timings
(2:00p-10:30p)
India Business Unit
AWMPO AWMP&S President's Office
Job Family Group
Technology
