Tech lead - Data Engineer
As part of the Data Engineer team, you will be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You will interact with the engineers, product managers, QA, BI developers and architects to provide scalable robust technical solutions.
Responsabilidades e atribuições
- Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
- Provides and supports the implementation and operations of the data pipelines and analytical solutions
- Experience in REST API data service – Data Consumption
- Experience in managing work teams
- Advanced project management
Requisitos e qualificações
- 8 a 10 years in technology project implementation
- English conversational (Advanced)
- Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development.
- Experience in agile models
- Experience with, Python, Java to write data pipelines and data processing layers
- Experience in Advance Pipelines with Airflow
- Experience Continuous Integration, DevOps, Github.
- Performance tuning experience of systems working with large data sets
- Proven, working expertise with Big Data Technologies Hadoop, Hive, Kafka, Presto, Spark.
- Highly Proficient in SQL.
- Experience with Cloud Technologies
- GCP – DataProc, Big Query, Cloud Fuctions
- Azure – ADLS, Data Factory.
- Experience with relational model, memory data stores desirable (Sql Server, Oracle, Cassandra, Druid)
- Knowledge in implementing advanced analytics models using ML/AI (Desirable)
- Knowledge of BI tools (Power BI, Tableau, Looker, etc.) Desirable
- Retail experience is a huge plus.
Etapas do processo
- Etapa 1: Cadastro
- Etapa 2: Entrevista
- Etapa 3: Confirmación de Candidato
- Etapa 4: Onbording
- Etapa 5: Contratação
Creer para co-crear
¿Buscas un lugar donde tus ideas brillen?
Con más de 38 años y una presencia global, en Stefanini transformamos el mañana juntos. Aquí, cada acción cuenta y cada idea puede marcar la diferencia. Únete a un equipo que valora la innovación, el respeto y el compromiso.
Si eres una persona disruptiva, te mantienes en aprendizaje continuo y la innovación está en tu ADN, entonces somos lo que buscas. ¡Ven y construyamos juntos un futuro mejor!