Translate business requirements/problems into comprehensive data management and analytical frameworks through usage of appropriate techniques
Execute analytics solutions by utilizing web scraping, text mining, and other techniques
Developing new web harvesters and maintenance of existing harvesters
Technically analyzing web pages and their underlying technologies
Undertake automation of recurring tasks â automated data extraction, generating PDF reports, etc.
Develop algorithms that extract and use information from large datasets
Investigating data issues and statistical anomalies of harvested data
Handle requirements right from data identification and acquisition to presentation of the data. Conduct data cleansing, data preparation, completeness testing, and data loading
Analyze business trends and nuances to create and provide actionable client insights
FUNCTIONAL & BEHAVIOURAL KNOWLEDGE
Be fluent in Python (and many of its libraries)
Has experience in web scraping (extract large amounts of data from websites)
Past track record of building automated solutions, and delivering insights and analysis
Ability to think outside of the box and solve abstract, ill-defined problems
Can demonstrate the ability and willingness to quickly learn new technologies
Be a self-starter and willingness to take initiative with little supervision
Has strong verbal and written communication skills
Cloud experience preferable (AWS)
Airflow experience preferable
Having proficiency in other programming languages is a plus
Minimum & Preferred Education
B.E / B.Tech (a degree in computer science, computer engineering, or a highly related field.)
Minimum & Preferred Experience / Skills
Prior experience of 1-5 years in web scraping and related automation
