Бразилия[Job-31899] Senior Data Engineer, Campinas (on-site)
2 нед. назад
БразилияSeniorOnsite
awspythonsqlgluelambdasparkathenadataops
Senior Data Engineer role focused on building and maintaining data pipelines with strong AWS and Python/SQL skills, requiring onsite presence in Campinas.
Обязанности
- - Develop and maintain data pipelines; - Integrate data from various sources (APIs, relational databases, files, etc.); - Collaborate with business and analytics teams to understand data requirements; - Ensure quality, reliability, security and governance of the ingested data; - Follow modern DataOps practices such as Code Versioning, Data Tests and CI/CD - Document processes and best practices in data engineering. Must-have:
- - Availability to work 5x/week at our Campinas office. - Proven experience in building data pipelines in AWS , leveraging S3, Glue, Lambda, Iceberg tables, Spark and Athena. - Strong programming skills in Python and SQL for data processing and transformation; - Understanding of ETL/ELT frameworks, data warehousing, and distributed data processing; - Experience with modern DataOps practices. - Familiarity with a variety of cloud platforms (AWS, Azure, or GCP) and related data services). - Advanced English level. Nice-to-have: - Experience with Databricks, Lakehouse and Unity Catalog. - Experience with data contracts, schema evolution, and ensuring compatibility across services. - Expertise in data quality frameworks (e.g., Great Expectations, Soda, dbt tests, or custom-built solutions). - Familiarity with DBT, Atlan and Soda. - Integration with Power BI - Experience with Data Streaming.
- #LI-GP1
Другое
- At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions.
- With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy.
- We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.