Коста-Рика
Перу
КолумбияSenior Data Engineer (Earnix)
3 дн. назад
Коста-РикаПеруКолумбия+1SeniorRemote
azure databricksdbtpythonpysparksqldelta lakeunity catalogci/cd
Senior Data Engineer role requiring 7+ years experience with Azure Databricks, Python, PySpark, SQL, and Delta Lake to design and optimize data pipelines remotely.
Обязанности
- Design, develop, and optimize production-grade data pipelines and governed data products using Azure Databricks, dbt, Python/PySpark, SQL, and Delta Lake.
- Build conformed Silver and Gold data models for rating factors, model inputs, quote versions, policy premiums, and other insurance pricing and rating data.
- Implement scalable Lakehouse engineering practices, including data quality, observability, monitoring, governance with Unity Catalog, and performance optimization.
- Collaborate with pricing, actuarial, underwriting, Data Science, BI, Architecture, and Quality Engineering teams while providing technical leadership through design reviews, code reviews, and mentoring.
Требования
- 7+ years of Data Engineering experience, including strong recent experience with enterprise Databricks platforms.
- Strong production experience with Azure Databricks, Spark, Delta Lake, Workflows/Jobs, Databricks SQL, and platform optimization.
- Advanced hands-on experience with dbt models, macros, tests, documentation, incremental patterns, and CI/CD integration.
- Strong Python and PySpark skills for transformations, reusable frameworks, integrations, validation, and automated testing.
- Advanced SQL skills, including query optimization, data reconciliation, and analytical data modeling.
- Strong experience with enterprise ELT/ETL, batch pipelines, incremental processing, data quality, and production support.
- Practical experience with Unity Catalog or comparable data governance, lineage, and access-control capabilities.
- Experience with CI/CD, Git, automated deployments, peer reviews, and environment promotion for data products.
- Strong Azure experience, including cloud storage, identity, security, and integration patterns.
- Proven ownership of production data pipelines from design through deployment, monitoring, and incident resolution.
Будет плюсом
- Experience with insurance pricing, policies, quotes, premiums, rating factors, underwriting, or actuarial data.
- Experience integrating with Earnix or another enterprise pricing/rating engine.
- Experience with Dataiku, MLflow, or governed machine-learning workflows.
- Knowledge of Kafka, Event Hubs, streaming patterns, FastAPI, REST APIs, or low-latency data services.
- Experience with Power BI and Terraform.
- Posted On: 12-10-2026
Другое
- Job Title: Senior Data Engineer (Earnix)
- Key Skills: Azure Databricks, dbt, Python, PySpark, SQL, Delta Lake, Unity Catalog, Azure, CI/CD, Data Engineering, Earnix
- Experience: 7+ YOE.
- Location: Costa Rica, Peru, Colombia, Bolivia
- Mode: Remote
- We at Coforge are hiring Senior Data Engineer (Earnix) (#006fu00000cVkwnAAC-1) with the following skill set.