[Job-31906] Senior Data Developer
2 нед. назад
БразилияSeniorRemote
databricksapache sparksqlpythonazure
Design, build, and optimize scalable data solutions and pipelines using modern data technologies.
Обязанности
- Design, develop, and maintain robust and scalable data pipelines using Databricks, Apache Spark, SQL, and Python or Scala.
- Build solutions to process and transform large datasets efficiently.
- Monitor and optimize existing data pipelines and workflows, improving performance, scalability, throughput, and reliability .
- Collaborate with data scientists, analysts, engineers, and business stakeholders to understand data needs and translate them into effective technical solutions.
- Implement data quality checks and governance practices to ensure data accuracy, consistency, and compliance.
- Troubleshoot complex data and pipeline issues, identifying root causes and proposing sustainable solutions.
- Maintain clear technical documentation and contribute to engineering standards and best practices across the team.
Требования
- Solid professional experience in Data Engineering , particularly designing and developing data pipelines.
- Hands-on experience with Databricks and Apache Spark .
- Strong knowledge of SQL and experience working with large datasets.
- Proficiency in Python or Scala for data engineering.
- Experience working with Microsoft Azure and cloud-based data solutions.
- Strong analytical and problem-solving skills, including the ability to troubleshoot complex data issues.
- Excellent communication skills in English and Portuguese , with confidence working in collaborative environments and interacting with clients and stakeholders.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- #Midsenior
- #Li-mg04
Другое
- At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions.
- With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy.
- We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.
- We are looking for a Data Engineer to join our team and help design, build, and optimize scalable data solutions.
- In this role, you will work with modern data technologies such as Databricks, Apache Spark, SQL, Python, and Azure , collaborating with technical teams and business stakeholders to transform large volumes of data into reliable and efficient solutions.