Sr Data Engineering Specialist

Confidencial (Apenas para Cadastrados) has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.

Job Description:

Collaborate with Innovative Confidencial (Apenas para Cadastrados)ers Around the World

Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a diversity of people, global locations, technologies and products, Confidencial (Apenas para Cadastrados) is a place where you can collaborate with 60,000 other curious, creative Confidencial (Apenas para Cadastrados)ers.

The Impact You’ll Make in this Role

Confidencial (Apenas para Cadastrados) is seeking a Senior Data Engineering Specialist to join the Corporate Research Digital Platforms (CRDP) to develop scalable Data Systems and Solutions. As part of an agile team, you will enable applications in diverse markets including energy, manufacturing, personal safety, transportation, electronics, and consumer.

As a Senior Data Engineering Specialis, you will have the opportunity to design and support an Enterprise Data Mesh to empower informatics and digital technologies for users across the globe:

• Design, and build scalable, efficient, and fault-tolerant data operations.
• Collaborate with senior technical leads, analysts, engineers, and scientists to implement new mesh domain nodes and data initiatives.
• Implement the technical architecture for accelerated solution designs, including data integration, modeling, governance, and applications.
• Explore and recommend new tools and technologies to optimize the data platform.
• Improve and implement data engineering and analytics engineering best practices.
• Collaborate with data engineering and domain nodes teams to design physical data models and mappings.
• Work with scientists and informaticians to develop advanced digital solutions and promote digital transformation and technologies.
• Develop and maintain scalable data pipelines for ingesting, transforming, and distributing data streams.
• Advise and mentor Confidencial (Apenas para Cadastrados) businesses, data scientists, and data consumers on data standards, pipeline development, and data consumption.

Your Skills and Expertise

To set you up for success in this role from day one, Confidencial (Apenas para Cadastrados) requires (at a minimum) the following qualifications:

• Bachelor’s Bachelor’s degree or higher in Computer Science from an accredited university.
• Professional experience in data management, data governance, and data warehouse/lakehouse design and development with proficiency across SQL and NoSQL data management systems
• Completely proficient in advanced SQL, Python/PySpark/Scala (any object-oriented language concepts), ML Libraries
• Must have hands-on experience in Python to extract data from APIs, build data pipelines.
• Background in data engineering and data systems, and having comfort working with structured and unstructured data and analyses. Exposure to data and data types in the Materials science, chemistry, computational chemistry, physics space a definite plus, but not required.
• Intermediate English Proficiency

Additional qualifications that could help you succeed even further in this role include:

• Proficiency in developing on modern distributed cloud architecture and workloads (AWS, Databricks preferred).
• Proficiency in building data pipelines to integrate business applications and procedures.
• Solid understanding preferred of advanced Databricks concepts like Delta Lake, MLFlow, Advanced Notebook Features, Custom Libraries and Workflows, Unity Catalog, etc.
• Experience with AWS cloud computing services and infrastructure developing data lakes and data pipelines leveraging multiple technologies such as AWS S3, AWS Glue, Elastic MapReduce, etc. and awareness of considerations for building scalable, distributed computational systems on Spark.
• Experience with stream-processing systems: Amazon Kinesis, Spark, Storm, Kafka, etc.
• Hands-on experience with relational SQL and NoSQL databases.
• Data quality and validation principles experience, security principles data encryption, access control, authentication & authorization.
• Experience with Docker containers and Kubernetes, experience developing or interacting with APIs.
• Experience in using data orchestration workflows using open-source tools like Temporal.io, Apache Airflow is a plus.
• Knowledge of data visualization tools like Dash Apps, Tableau, Power BI, etc.
• Good experience with agile development processes and concepts with leveraging project management tools like JIRA and Confluence.
• Devise and implement data engineering best practices across teams, optimize and redesign existing data engineering solutions to improve efficiency or stability, as well as monitoring of and consulting with domain node teams.
• Excellent interpersonal, collaborative, team building, and communication skills to ensure effective collaborations with matrixed teams.

• Local de trabalho:
  Local de trabalho: Este cargo segue um modelo de trabalho presencial, solicitando que o funcionário trabalhe pelo menos quatro dias por semana na Confidencial (Apenas para Cadastrados) Sumaré.

• 
  Apoiando seu Bem-Estar
  
  A Confidencial (Apenas para Cadastrados) oferece muitos programas para que você viva o melhor de sua vida – física e financeiramente. Para garantir remuneração e benefícios competitivos, a Confidencial (Apenas para Cadastrados) realiza benchmarks regularmente com outras companhias de mesmo porte.
  
  Converse com Max
  Para obter ajuda na busca por nossas vagas de emprego atuais ou para obter mais informações sobre tudo relacionado à Confidencial (Apenas para Cadastrados), visite Max, nosso assistente virtual de recrutamento em Confidencial (Apenas para Cadastrados).com/careers.

Learn more about Confidencial (Apenas para Cadastrados)’s creative solutions to the world’s problems at www.Confidencial (Apenas para Cadastrados).com or on Instagram, Facebook, and LinkedIn @Confidencial (Apenas para Cadastrados).

A Confidencial (Apenas para Cadastrados) é um empregador que oferece oportunidades iguais à todos. A Confidencial (Apenas para Cadastrados) não discriminará nenhum candidato baseado em sua raça, cor, idade, religião, gênero, orientação sexual, identidade ou expressão de gênero, nacionalidade ou deficiência.

Safety is a core value at Confidencial (Apenas para Cadastrados). All employees are expected to contribute to a strong Environmental Health and Safety (EHS) culture by following safety policies, identifying hazards, and engaging in continuous improvement.

Please note: your application may not be considered if you do not provide your education and work history, either by: 1) uploading a resume, or 2) entering the information into the application fields directly.

Confidencial (Apenas para Cadastrados) Global Terms of Use and Privacy Statement

Carefully read these Terms of Use before using this website. Your access to and use of this website and application for a job at Confidencial (Apenas para Cadastrados) are conditioned on your acceptance and compliance with these terms.

Please click on the following links and select the country where you are applying for employment to review the applicable Terms of Use (link here) and Privacy Policy (link here). Before submitting your application, you will be asked to confirm your agreement with the terms.