Overview:
The Data Platform Team looks to raise the level and productivity of data engineering by building, scaling and supporting our big data infrastructure with an emphasis on simple and efficient solutions on top of complex distributed data stores. As a contributing platform engineer you will assist in architecting, designing and implementing a new, cutting edge, cloud platform expanding our data assets within scalable, elastic systems that can be instantiated on demand, on cloud.
Responsibilities:
Primary Accountabilities/Responsibilities:
Create recommendations for integrating DevOps practices and solutions
Provisioning, securing, and management of scalable, and highly available Big Data Platform
Work collaboratively with data engineering to define infrastructure & deployment requirements (CI/CD)
Ensure configuration and compliance with configuration management tools
Work with Application Security, QA to ensure adherence to applicable compliance and standards
Definition and deployment of systems for metrics, logging, and monitoring surrounding our platform
Expertise building CI/CD pipelines
Expertise using configuration management
Hands-on experience deploying and managing infrastructure with Kubernetes
Solid foundation of networking and Linux administration
Experience with Docker, Git, Gradle, Splunk and deploying applications on Azure are huge plusesQualifications:
Job Requirements:
Bachelor's degree or relevant work experience in Computer Science, Mathematics, Electrical Engineering or related technical discipline.
Ability to work and define best practices in colloboration with Agile Development teams
Hands-on development and programming experience on any Object Oriented Programming Language such as Java/C#/Python.
Knowledge of Microservices architecture, design and business processes
Knowledge in Distributed application, data and infrastructure architecture disciplines
Experience with modern agile software delivery practices such as Scrum/Kanban, Continuous Integration and Delivery (CI/CD) and Automation using Gradle or equivalent automation framework
Knowledge of container orchestration using native or managed Kubernetes and Infrsatstucture as Code tools such as Terraform and/or Ansible
Requires supporting teams for CI/CD for a hybrid cloud native environment.
Knowledge of data and persistence technologies such as SQL, No-SQL (ex. Cassandra, Dynamo DB)
Experience with data streaming, messaging and event driven systems such as Kafka, Kinesis, AWS MSK
Good understanding of Security and Data Encryption principles such as OAuth, Kerberos and KMS solutions
Excellent verbal and written communication skills are required for the role
