Job Overview:
We are seeking an experienced and highly skilled Lead Software Engineer to join our data team at RadiusAI. The ideal candidate will have a strong background in data engineering, leadership, and a passion for building scalable data infrastructure. As a Lead Software Engineer, you will oversee the design, implementation, and maintenance of our data pipelines, ensure data quality, and lead a team of data engineers to deliver high-quality data solutions.
Key Responsibilities:
- Lead and mentor a team of data engineers, providing guidance and support in their daily tasks and professional development.
- Design, develop, and maintain scalable and robust data pipelines and ETL processes.
- Implement best practices for data governance, data quality, and data security.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet their needs.
- Optimize and manage data storage solutions, including data warehouses, data lakes, and databases.
- Ensure the reliability, availability, and performance of data infrastructure.
- Develop and maintain documentation for data engineering processes and systems.
- Stay up-to-date with industry trends and emerging technologies in data engineering, and integrate relevant advancements into the data strategy.
- Troubleshoot and resolve issues related to data pipelines and infrastructure.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
- 7+ years of experience in data engineering or a related field.
- Proven experience in designing and implementing large-scale data pipelines and ETL processes.
- Strong expertise in SQL and experience with programming languages such as Python, Java, or Scala.
- Extensive experience with data storage solutions, such as data warehouses (e.g., Snowflake, Redshift, BigQuery), data lakes, and relational databases.
- Experience with data pipeline orchestration tools like Apache Airflow or similar.
- Familiarity with big data technologies such as Spark, and Kafka.
- Strong understanding of data modeling, data warehousing, and database design principles.
- Excellent leadership and team management skills.
- Strong problem-solving abilities and attention to detail.
- Exceptional communication and collaboration skills.
Preferred Qualifications:
- Master's degree in Computer Science, Engineering, or a related field.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Knowledge of data governance frameworks and best practices.
- Experience with machine learning and data science workflows.
- Certification in relevant technologies (e.g., AWS Certified Big Data Specialty).
This role demands a balance of advanced technical skills, leadership capabilities, and a strong understanding of data engineering principles to ensure the effective operation and continuous improvement of our data infrastructure.