Staff Data Engineer – Data Modeling

3 мес. назад

IsraelWorldwideLeadHybrid

sqlpythonairflowsparkawssnowflakedata modeling

Lead design and development of scalable data models and pipelines, ensuring data correctness and optimization.

Our Data team consists of highly skilled senior software and data professionals who collaborate to solve complex data challenges. We process billions of records daily from multiple sources using multi-stage pipelines with intricate data structures and advanced queries. We are responsible for building data pipelines end to end—from raw data ingestion to the creation of actionable datasets—following the bronze, silver, and gold paradigm. This includes business logic, infrastructure, ETLs, optimization, and ongoing maintenance. The data we deliver drives insights and decision-making across the organization and enhances our product offerings. We leverage technologies such as AWS, Snowflake, Iceberg, Airflow, Spark, and more. What You’ll Do Lead the translation of business and product requireme

7+ years of experience as a Data Engineer or Architect or in a similar data-focused role, with clear ownership of end-to-end data solutions.
Strong expertise in writing and optimizing complex SQL queries (advanced joins, aggregations, performance tuning).
Proven experience building and maintaining Airflow DAGs (or similar orchestration tools), focused on workflow logic, code, and SQL rather than infrastructure.
Deep understanding of data modeling principles, including designing datasets at the correct grain and preventing data inconsistencies.  Use of the medallion model.
Strong ability to understand business needs and translate them into scalable, maintainable data solutions.
Demonstrated experience debugging data issues and tracing discrepancies in critical business metrics across pipelines.
Proficient in Python for orchestration and data workflows.
Comfortable reading and reasoning about existing code, SQL, DAGs, schemas, and input data formats (e.g., JSON).
Experience working with cloud data warehouses such as Snowflake, BigQuery, or Databricks. 
Experience in Snowflake and its extended SQL and nuances is a strong advantage.