ГерманияGeospatial Data Engineer
1 мес. назад
ГерманияRemote
pythongoetlspatial databasesapi integrationobject storage
Develop geospatial data ingestion, processing, cataloging, and serving capabilities for satellite imagery and related datasets.
Обязанности
- Build the data foundation that makes satellite imagery and geospatial datasets discoverable, reliable, and ready for analysis. You'll use Python and Go to develop ingestion, processing, cataloging, and serving capabilities for data we acquire, retain, and use within our platform.
- The work spans provider APIs, large raster deliveries, vector datasets, spatial databases, and object storage. You'll partner with Foundation and Platform engineers on infrastructure, and with data scientists and application engineers on the data products they need.
- Build provider integrations for imagery search, acquisition, download, and delivery tracking, handling authentication, rate limits, retries, and differences in vendor metadata.
- Ingest optical, multispectral, thermal, and SAR products from commercial and open sources. Our intended provider landscape includes Airbus Pléiades, Satellogic, SatVu, ICEYE, and Copernicus Sentinel missions.
- Develop raster ETL for metadata extraction, coordinate transformation, reprojection, resampling, mosaicking, COG creation, overviews, and quality checks.
- Build vector pipelines for geometry validation, schema normalization, spatial partitioning, indexing, and production of GeoParquet and PMTiles assets.
- Implement imagery cataloging with STAC/pgSTAC and spatial data services with PostGIS, preserving acquisition times, footprints, source metadata, processing history, and access restrictions.
- Design efficient storage and delivery paths using S3-compatible buckets, HTTP range requests, columnar formats, and appropriate caching and tiling strategies.
- Integrate processing with Sentinel's orchestration and service contracts. Make workflows resumable, safe to retry, observable, and capable of processing data larger than memory.
- Track freshness, completeness, lineage, and processing cost. Diagnose malformed deliveries, missing assets, inconsistent catalogs, and performance bottlenecks.
Требования
- Several years of data or backend engineering experience, with substantial hands-on work on geospatial or Earth observation data.
- Strong Python skills and practical Go experience for services, integrations, or processing infrastructure.
- Experience with GDAL/Rasterio and vector tooling such as GeoPandas, Shapely, or equivalent libraries.
- Strong SQL and PostgreSQL/PostGIS knowledge, including spatial indexes, query planning, and efficient bulk loading.
- Experience handling formats such as GeoTIFF, GeoJSON, GeoPackage, and Shapefile, with a sound understanding of coordinate reference systems, nodata, geometry validity, and the effect of resampling on data quality.
- Experience with object storage and automated pipelines, including failure recovery, deduplication, metadata validation, and reproducible outputs.
- Comfortable packaging and operating software on Linux with containers, automated tests, and useful monitoring.
- Clear communication in English and an ability to agree data contracts with scientific and application teams. Eligible to work in Germany.
Условия
- Ownership of the pipelines and data services behind a growing geospatial platform.
- Work with diverse satellite and spatial datasets, from provider deliveries to reusable analytical products.
- A Python and Go environment with room to shape processing, cataloging, and performance practices.
- Remote-first work in Germany with regular team sessions in Berlin and occasional sessions in Frankfurt and Munich.
- 30 days of vacation, equipment and learning support, and close collaboration across GEOINT, platform engineering, and applied science.
Другое
- Orcrist builds secure data intelligence software for defense, law enforcement, and enterprise teams. Our Sentinel platform combines data integration, AI-assisted analysis, and operational workflows. The GEOINT team is extending it with geospatial data services, remote-sensing capabilities, and a web-based common operational picture.
- STAC/pgSTAC, PySTAC, TiTiler, Martin, or OGC data services.
- Apache Spark, Dask, xarray, DuckDB, Apache Arrow, or Apache Sedona for larger geospatial workloads; familiarity with multidimensional formats such as Zarr, NetCDF, and HDF5.
- Apache Iceberg or similar analytical table formats, including schema evolution, partitioning, and integration with data catalogs.
- Temporal, Kafka, Kubernetes, and operation in self-hosted or air-gapped environments.
- Provider delivery formats such as DIMAP, satellite acquisition APIs, or preparation of optical, thermal, and SAR data for downstream analysis.
- Experience handling Copernicus Sentinel-1 and Sentinel-2 data, including product metadata, processing levels, and quality information.
- Experience supporting scientific processing in production environments.
- Experience working in defence and intelligence environments or on related projects.
- Strong interest and practical ability in agentic software development: using coding agents to plan, implement, test, and review software, and keeping up with rapidly evolving tools, techniques, and trends.
- German language skills or contributions to geospatial open source.