[Job-26705] Senior Data Engineer, Campinas, Brazil (Hybrid)

4 мес. назад

BrazilLATAMSeniorHybridC1

pythonsqlawsrest apistep functionsglue

Senior Data Engineer role focused on building and maintaining scalable data pipelines in AWS for a major American investment client.

Условия

 
-Health and dental insurance
-Meal and food allowance
-Childcare assistance
-Extended paternity leave
-Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
-Profit Sharing and Results Participation (PLR);
-Life insurance
-Continuous learning platform (CI&T University);
-Discount club
-Free online platform dedicated to physical, mental, and overall well-being
-Pregnancy and responsible parenting course
-Partnerships with online learning platforms
-Language learning platform
And many more!
 
More details about our benefits here: 
 
At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important  to present your assessment during the selection process.  See which data needs to be included in the report by  clicking here . This way, we can ensure the support and accommodations that you deserve.  If you do not yet have the assessment, don't worry: we can support you in obtaining it.
 
We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.

Другое

We are  tech transformation  specialists, uniting human expertise with AI to create scalable tech solutions.
With over 8,000 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.
 
This position requires a hybrid work model (3x/week) at our office in Campinas, SP, Brazil.
Build and maintain end-to-end data pipelines in AWS, often ingesting data from multiple REST APIs.
Design reliable, observable, and scalable pipelines, with a strong focus on data quality and monitoring. Explain and discuss the logic of your solutions with stakeholders, not just the tools used.
Advanced English, comfortable explaining technical solutions in conversation.
Proven experience as a Data Engineer
Strong hands-on experience in Python (data processing, API integration, automation) and advanced SQL (CTEs, window functions, optimization).
Solid experience designing, building, and maintaining data pipelines on AWS , including: Ingestion from REST APIs (authentication, pagination, rate limiting, error handling).
Transformation and loading into data lakes / data warehouses.
Orchestration (e.g. Step Functions, Glue Workflows, or similar).
Strong hands-on experience with AWS Serverless and data ecosystem : Lambda, Glue (Glue Jobs / Glue Studio), DynamoDB, ECS/Fargate (if applicable).
S3, IAM, CloudWatch (logs, metrics, alarms), Step Functions.
Experience with PySpark or similar distributed processing frameworks (e.g. Spark on EMR/Glue).
Experience in marketing data use cases (campaigns, events, customer 360, CDP).
Experience with Adobe Experience Platform (AEP) , especially CDP.
Experience with event-based architectures (e.g. tracking events, customer journeys).
Good understanding of Data Engineering fundamentals : Data modeling (dimensional and relational), data structures.
ETL vs ELT, batch vs streaming workflows.
Data quality, data governance, and data observability practices (monitoring, alerting, lineage).
Familiarity with Git/GitHub and CI/CD workflows for data pipelines.
Strong problem-solving mindset: Ability to clearly explain the logic behind the solution , trade-offs and troubleshooting steps.
Strong communication skills and ability to collaborate with cross-functional teams.
#mid-senior