Lead Data Software Engineer

We are looking for a seasoned Lead Data Software Engineer for a remote position to contribute to the success of our team and enhance our Data Science initiatives.

In this position, you will play a key role in developing and managing datamarts while delivering scalable and efficient data solutions tailored to client requirements. Your responsibilities will include building and maintaining data pipelines, providing on-call support, and collaborating with Data Science teams to ensure high-quality outcomes. Additionally, you will lead a team of talented professionals, offering mentorship and guidance to foster innovation and industry-leading solutions.

Responsibilities

• Provide leadership and mentorship to the Data Software Engineering team, cultivating an environment of growth and continuous learning
• Collaborate with cross-functional teams to deliver top-tier data solutions that align with project timelines and objectives
• Develop and implement effective Data Software Engineering practices, prioritizing automation, innovation, and efficiency
• Design and maintain scalable data solutions using AWS infrastructure
• Manage and optimize workflows and data processing using tools like Apache Airflow and Apache Spark
• Stay informed on industry trends and best practices, integrating them into the Data Software Engineering processes
• Offer on-call support for data pipelines and datamarts to ensure smooth operations
• Guide the development and deployment of REST APIs for seamless data integration and communication
• Work directly with clients to understand their needs and provide tailored, effective solutions
• Oversee team organization and structure to ensure projects are delivered on time and within scope
• Collaborate with stakeholders, demonstrating strong leadership and communication skills

Requirements

• At least 5 years of experience as a Data Software Engineer, with a focus on large-scale and complex data infrastructures
• A minimum of 1 year of experience leading and managing a team of Data Software Engineers
• Expertise in AWS, including designing and implementing scalable data solutions
• Advanced knowledge of Apache Airflow and Apache Spark for managing workflows and data processing
• Proficiency in CI/CD tools like Jenkins to streamline data pipeline delivery
• Strong skills in Python and SQL for developing and maintaining data pipelines and ETL processes
• Experience with Databricks and PySpark for data analysis and processing
• Familiarity with REST APIs for efficient data integration and communication
• Excellent problem-solving and analytical skills for navigating complex environments
• Strong client-facing abilities to foster collaboration and achieve project goals
• Exceptional organizational and leadership skills to ensure the efficient delivery of projects
• Upper-intermediate English proficiency for effective communication and presentations with stakeholders

Nice to have

• Experience with Redshift for data warehousing and analysis