Software Engineer III - PA085

1 мес. назад

USASeniorOnsite

javaapache airflowapache beamgoogle dataflowsparkkafkapub/sub

Backend software engineer focusing on building large-scale data acquisition systems with distributed processing and cloud infrastructure.

Обязанности

Design and build backend data pipelines that ingest, validate, normalize, enrich, and store high-volume raw data from multiple sources.
Develop ETL/ELT workflows and processing jobs using technologies such as Apache Airflow, Apache Beam, Google Dataflow, DataProc, Spark, Kafka, or Pub/Sub.
Implement new features in Java-based services and data processing applications that support data acquisition at scale.
Work with batch and streaming architectures for scheduled, near-real-time, and event-driven data flows.
Improve data quality through schema validation, deduplication, enrichment, monitoring, retries, and controlled backfills.
Contribute to observability for pipeline health, throughput, latency, cost, and error rates.
Collaborate with product managers, data teams, and platform teams to translate business requirements into reliable technical solutions.
Help design, plan, and execute the roadmap for next-generation data acquisition technologies.   
Must-Have Qualifications
Data Engineering and Pipelines
3+ years of professional software engineering experience.
Solid experience building and operating production data pipelines, ETL/ELT workflows, or data processing systems.
Strong proficiency with Java and object-oriented programming.
Hands-on experience with data processing and orchestration technologies such as Apache Beam, Apache Airflow, Spark, Google
Dataflow, or DataProc.
Experience with streaming technologies such as Kafka, Google Pub/Sub, or similar systems.
Understanding of batch processing, streaming processing, data modeling, schema design, and data quality practices.
Backend, Cloud, and Operations
Experience building backend services, APIs, or distributed systems that run in production.
Experience with at least one cloud provider, preferably GCP.
Familiarity with cloud data and compute services such as BigQuery, GCS, GKE, Dataflow, DataProc, and Pub/Sub.
Practical knowledge of SQL, large-scale storage/query systems, logging, monitoring, and alerting.
Ability to troubleshoot pipeline failures, data issues, performance bottlenecks, and operational incidents.

Будет плюсом

Experience with Kubernetes, especially GKE or EKS, for distributed workloads.
Experience with Snowflake, BigQuery, Starburst/Trino, or similar data warehouses and query engines.
Experience with Terraform or other infrastructure-as-code tools.
Exposure to data integration patterns involving CRM systems, email/calendar APIs, third-party feeds, or large external datasets.
Experience in a B2B data company, data marketplace, or data-as-a-product environment.

Другое

is where careers accelerate. We move fast, think boldly, and empower you to do the best work of your life. You’ll be surrounded by teammates who care deeply, challenge each other, and celebrate wins. With tools that amplify your impact and a culture that backs your ambition, you won’t just contribute. You’ll make things happen–fast.
We're looking for a Software Engineer III to join the Data Acquisition team - one of 's most strategically important engineering areas. In this role, you will help build the systems that acquire, transform, validate, and store large raw data sets from a wide range of sources. You will work on backend services, batch and streaming pipelines, workflow orchestration, and the next generation of large-scale data acquisition technologies. This position is focused on backend and data engineering. It requires strong hands-on experience with data pipelines, distributed processing, Java, cloud infrastructure, and production-quality engineering practices.
Bachelor's degree in Computer Science, Software Engineering, or a related field.
Strong problem-solving skills and attention to detail.
Pragmatic engineering judgment with the ability to balance quality, speed, and business impact.
Data Acquisition is one of 's biggest assets. The systems you build will directly affect how quickly and accurately  can acquire, process, and deliver high-quality business data.You will be joining a team that works on large-scale data infrastructure, high-impact product capabilities, and engineering problems where reliability, scale, and data  
#LI-AR2
#LI-Hybrid
Actual compensation offered will be based on factors such as the candidate’s work location, qualifications, skills, experience and/or training. Your recruiter can share more information about the specific salary range for your desired work location during the hiring process. We want our employees and their families to thrive.
In addition to comprehensive benefits we offer holistic mind, body and lifestyle programs designed for overall well-being. Learn more about benefits here .
About us:  
(NASDAQ: GTM) is the Go-To-Market Intelligence Platform that empowers businesses to grow faster with AI-ready insights, trusted data, and advanced automation. Its solutions provide more than 35,000 companies worldwide with a complete view of their customers, making every seller their best seller.
is committed to protecting your privacy when you apply for jobs with us. Please review our Job Applicant Privacy Notice for more details on how we handle your personal information.
may use a software-based assessment as part of the recruitment process. More information about this tool, including the results of the most recent bias audit, is available here .
is proud to be an equal opportunity employer, hiring based on qualifications, merit, and business needs, and does not discriminate based on protected status. We welcome all applicants and are committed to providing equal employment opportunities regardless of sex, race, age, color, national origin, sexual orientation, gender identity, marital status, disability status, religion, protected military or veteran status, medical condition, or any other characteristic protected by applicable law. We also consider qualified candidates with criminal histories in accordance with legal requirements.
For Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. does not administer lie detector tests to applicants in any location.