USASenior Software Engineer - PA086
1 нед. назад
USASenior
javaetldata pipelinesstreamingbatch processingworkflow orchestrationcloud infrastructure
Senior Software Engineer role focusing on backend data acquisition pipelines, ETL workflows, and large-scale data processing systems.
Обязанности
- We're looking for a Senior Software Engineer to join the Data Acquisition team — one of 's most strategically important engineering areas.
- In this role, you will design, build, and operate the backend systems and data pipelines that acquire, transform, validate, and store large raw data sets from a wide range of sources. You will work across distributed processing, workflow orchestration, streaming and batch data flows, and cloud infrastructure.
- This is a senior individual-contributor engineering role focused on technical depth, production execution, and high-quality data systems. The right candidate brings strong backend engineering fundamentals, significant pipeline experience, and the ability to turn complex data acquisition requirements into scalable systems.
- Design, build, and operate large-scale data acquisition pipelines that ingest, validate, transform, enrich, and store high-volume raw data.
- Architect resilient ETL/ELT workflows for batch, streaming, scheduled, and event-driven data processing.
- Develop production Java services and data processing applications for ingestion, orchestration, enrichment, deduplication, and delivery.
- Build and improve systems using technologies such as Apache Airflow, Apache Beam, Spark, Google Dataflow, DataProc, Kafka, and Pub/Sub.
- Define practical approaches for schema evolution, data contracts, data validation, backfills, replayability, and idempotent processing.
- Improve reliability, performance, scalability, and cost efficiency across data acquisition pipelines and services.
- Implement observability, monitoring, and alerting for pipeline health, throughput, latency, failure rates, and data quality metrics.
- Work with product, data science, platform, and data quality teams to translate business needs into production-ready systems.
- Contribute to technical designs, implementation plans, and system modernization efforts across Data Acquisition.
Будет плюсом
- Experience with Kubernetes, especially GKE or EKS, for running distributed workloads.
- Experience with Terraform or other infrastructure-as-code tools.
- Experience with Snowflake, BigQuery, Starburst/Trino, or similar query engines.
- Knowledge of data integration patterns involving CRM systems, email/calendar APIs, third-party feeds, change data capture, or external data providers.
- Experience in a B2B data company, data marketplace, or data-as-a-product environment.
- Expert-level experience with Apache Spark or another distributed processing framework.
Другое
- is where careers accelerate. We move fast, think boldly, and empower you to do the best work of your life. You’ll be surrounded by teammates who care deeply, challenge each other, and celebrate wins. With tools that amplify your impact and a culture that backs your ambition, you won’t just contribute. You’ll make things happen–fast.
- 5+ years of professional software engineering experience with a strong focus on backend systems, data engineering, or distributed processing.
- Proven experience building and operating production data pipelines at scale.
- Deep proficiency with Java and object-oriented design.
- Hands-on expertise with data processing and orchestration technologies such as Apache Beam, Apache Airflow, Spark, Google Dataflow, or DataProc.
- Strong experience with streaming systems such as Apache Kafka, Google Pub/Sub, or similar technologies.
- Strong understanding of batch processing, streaming processing, data modeling, schema evolution, and data quality management.
- Experience designing ETL/ELT workflows that process large volumes of structured and semi-structured data.
- Experience designing high-throughput, fault-tolerant backend services and distributed systems.
- Strong understanding of APIs, integration patterns, retries, backpressure, idempotency, and operational failure modes.
- Ability to write clean, maintainable production code and evaluate tradeoffs in system design.
- Experience with large-scale storage and query technologies such as BigQuery, Snowflake, Trino, or similar systems.
- Experience with at least one cloud provider, preferably GCP.
- Hands-on experience with cloud services such as BigQuery, GCS, GKE, Dataflow, DataProc, and Pub/Sub.
- Experience operating production services with monitoring, logging, alerting, SLIs, and incident investigation.
- Ability to analyze and improve pipeline performance, reliability, resource utilization, and cost.
- Bachelor's degree in Computer Science, Software Engineering, or a related field.
- Ability to translate business and data requirements into clear technical designs and implementation plans.
- Pragmatic engineering judgment with the ability to balance correctness, delivery speed, maintainability, and operational risk.
- Data Acquisition is one of 's biggest assets. The pipelines and services you build will directly shape the scale, accuracy, and freshness of the data that powers 's products.
- This role is for an engineer who wants to work on core data infrastructure, difficult production systems, and high-impact data acquisition capabilities where backend engineering and data quality are tightly connected.
- #LI-AR2 #LI-Hybrid
- Actual compensation offered will be based on factors such as the candidate’s work location, qualifications, skills, experience and/or training. Your recruiter can share more information about the specific salary range for your desired work location during the hiring process. We want our employees and their families to thrive.
- In addition to comprehensive benefits we offer holistic mind, body and lifestyle programs designed for overall well-being. Learn more about benefits here .
- About us:
- (NASDAQ: GTM) is the Go-To-Market Intelligence Platform that empowers businesses to grow faster with AI-ready insights, trusted data, and advanced automation. Its solutions provide more than 35,000 companies worldwide with a complete view of their customers, making every seller their best seller.
- is committed to protecting your privacy when you apply for jobs with us. Please review our Job Applicant Privacy Notice for more details on how we handle your personal information.
- may use a software-based assessment as part of the recruitment process. More information about this tool, including the results of the most recent bias audit, is available here .
- is proud to be an equal opportunity employer, hiring based on qualifications, merit, and business needs, and does not discriminate based on protected status. We welcome all applicants and are committed to providing equal employment opportunities regardless of sex, race, age, color, national origin, sexual orientation, gender identity, marital status, disability status, religion, protected military or veteran status, medical condition, or any other characteristic protected by applicable law. We also consider qualified candidates with criminal histories in accordance with legal requirements.
- For Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. does not administer lie detector tests to applicants in any location.