Big Data Engineer

3 нед. назад

ФранцияHybrid

data pipelinesdata lakebig data

Design, build, and optimize scalable data pipelines for large-scale data lake ingestion at a SaaS company.

provides enterprise data management and security solutions that help organizations exercise sovereignty over their critical data. Companies representing 10% of global market capitalization trust , including Schneider Electric, Volkswagen and Robert Half. Its Excalibur Data Platform enables customers to protect, secure, move, and use data and code independently of application vendors. The platform supports complex and high-volume use cases, including backup, archiving, zero-copy, BCDR & High Availability, data federation, and semantic AI orchestration. Customer-controlled end-to-end encryption raises the bar for enterprise security. With 11 patents, manages 50 trillion records and supports 100 million users. Join ’s R&D team and help shape the future of our data platform. We’re a SaaS company specializing in secure data management around Salesforce environments. You’ll design, build, and optimize scalable data pipelines for large-scale data lake ingestion.

Data Pipeline Development & Operations: Design, build, handle, and monitor Spark data pipelines for large-volume data lake ingestion (handling hundreds of TBs).
Platform & Cost Optimization: Continuously optimize the performance, reliability, and costs of big data pipelines and infrastructure.
Databricks, Snowflake & Cloud Engineering: Deeply leverage Databricks, Snowflake, or AWS Redshift, alongside cloud provider solutions (AWS S3, Glue/Athena, Lambda) for scalable data engineering.
Lakehouse Architecture: Demonstrate strong expertise in managing, creating, and optimizing Delta Lake or Apache Iceberg tables.
Secure Data Management: Apply security-by-design, data governance, and compliance best practices across storage, compute, and sharing layers.

7+ years of experience in data engineering or backend data platforms, with at least 3 years of hands-on experience building and operating big data pipelines .
Hands-on engineer background with proven track record handling large volumes of data (at least hundreds of TB).
Deep knowledge of at least one data lake platform among Databricks, Snowflake, or AWS Redshift.
Strong expertise in Apache Spark (creation, handling, and monitoring of pipelines) and lakehouse table formats (Delta Lake or Apache Iceberg).
Strong Python or Java and SQL skills, cloud infrastructure (AWS S3, Athena, Glue), and IaC/observability practices.
Solid understanding of cost management principles, data security, governance, and data modeling.
Equivalent engineering school degree or Master’s degree in Computer Science, Data Science, or Applied Mathematics.
Fluent in English and French, with clear communication, ownership mindset, and strong collaborative skills.