This is a remote position.
Job title: Data Engineering Analyst.
Location:Remote
Primary Skills : Azure Data Factory, Azure Databricks, Azure SQL, SQL Server
Budget : As per Market
Experience: 4-5Years
Required
- Experience with our data pipeline and workflow management tools - Azure Data Factory, Azure Databricks, Azure SQL, SQL Server
- Experience with Python generally and PySpark specifically
- Bachelor's degree in Computer Science or related field, or equivalent experience working as a Database developer, ETL Developer, BI Developer or similar role.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- A successful history of manipulating, processing and extracting value from large, disconnected datasets.
- Ability to communicate effectively with both technical and non-technical audiences.
- Ability to work autonomously as well as part of a team.
- Exceptional work ethic, judgment, business acumen, attention to detail, analytical skills, and problem-solving skills with the ability to make informed decisions.
- Excellent verbal and written communication skills with the ability to simplify technical concepts and present to senior-level executives.
- Results-driven and thrives in a fast-paced environment. Preferred
- Experience with and understanding of agile methodologies such as Scrum and/or Kanban.
- Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
- Experience with cloud-based technologies and working in a cloud environment. Experience with Microsoft Azure is preferred.
- Experience building and optimizing big data data pipelines, architectures and data sets
- Experience with big data tools such as Hadoop, Spark, Kafka, etc.
- Experience with Azure messaging services such as Event Grid, Event Hub, and Service Bus.
- Familiarity with scripting languages such as R, JavaScript, Scala, etc.
- Understanding of JSON format and experience working with JSON documents.
