Essential Requirements:
- Years of Experience 8+
- Bachelor s degree in computer science / software engineering (or similar)
- 3+ yrs. Java with Spring boot
- 2+ yrs of Technical Lead experience with end-to-end project exposure
- Practical experience of at least 6 year of SW development OR proven equivalent seniority in SW development with Product teams
- In-depth technical understanding of data structures, I/O, multi-threading, Restful Web Services
- AWS Cloud Knowledge, Deployment, troubleshooting
- Database knowledge (RDBS/NoSQL)
- Strong debugging skills of performance/memory leaks / crash / Multi-threaded / Algorithms.
- Experience with source control tools (GIT or similar)
- Experience with compiling and continuous integration tools like: Eclipse/IntelliJ, Gradle/Maven, Jenkins, Artifactory
- Excellent teamwork and communication skills.
- High self-learning and self-managed abilities.
- Integration/build/static code analysis tools
- System wide and end to product understanding.
- Leadership skills
- Strong interpersonal skills, high communication skills.
Principal Duties and Essential Responsibilities:
- Design and develop overall data architecture to ensure the effective storage, retrieval, and analysis of large-scale data sets.
- Build and maintain scalable data pipelines for ingesting, processing, and transforming data from various sources into our data warehouse or data lake. Ensure data quality and data consistency throughout the pipeline
- Optimize data storage, retrieval, and processing performance through indexing, partitioning, and caching techniques
- Evaluate and select appropriate technologies, tools, and platforms for data processing
- Improve availability and reliability of data streaming pipeline.
- Evaluate the scalability of data architecture to accommodate future growth and changing business needs.
- Develop build and deployment automation for microservices using CI/CD.
Good To have.
- Working Knowledge or Exposure to NLP, AI/ML
- Spark Knowledge
- Kafka Knowledge
- Data Warehousing Concepts
- Working Knowledge or Exposure to Python
- Working Knowledge or Exposure AWS SDK
- Data Modelling
- Large scale systems design exposure
