СШАSoftware Engineer, Ingestion Platform
3 нед. назад
164.2k–229.9k USD / годСШАRemote
data platformstreamingbatch processingmlbi
Software Engineer to solve large scale data platform and efficiency challenges on 's Data Movement team working remotely in the United States.
Обязанности
- Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users.
- Own the Data Movement Platform used to enable batch and stream data processing at .
- Invest in building new infrastructure for Spark, Flink, and Airflow technologies at , including contributing to the open source community as needed.
- Build automated solutions to minimize toilsome work for data users at and provide a declarative, self-service experience for working with data.
- Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of ’s Data Platform.
- If you have a passion for building and maintaining high quality code, want to improve how makes strategic decisions at the company level, and are excited about applying engineering best practices to one of the most powerful corpus of data in the world, then this is the team for you!
Условия
- Comprehensive Healthcare Benefits and Income Replacement Programs
- 401k with Employer Match
- Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
- Family Planning Support
- Gender-Affirming Care
- Mental Health & Coaching Benefits
- Flexible Vacation & Paid Volunteer Time Off
- Generous Paid Parental Leave
- This job posting may span more than one career level.
- In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit.
- To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.
- The base salary range for this position is:
- $164,200 — $229,900 USD
- In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.
- During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our Candidate Privacy Policy for Potential Employees and Contractors .
Другое
- is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, is one of the internet’s largest sources of information. For more information, visit.
- This role is remote friendly. has a flexible first workforce.
- The Data Movement team is looking to hire a Software Engineer who is excited to solve large scale data platform and efficiency challenges.
- ’s mission is to bring community and belonging to everyone in the world. is a community of communities where people can dive into anything through experiences built around their interests, hobbies, and passions. With more than 50 million people visiting 100,000+ communities daily, it is home to the most open and authentic conversations on the internet. From pets to parenting, skincare to stocks, there’s a community for everybody on . For more information, visit.
- Our community of users generates over 100B events per day, each of which is ingested into a data warehouse that sees 55,000+ daily queries. We utilize this data to enable both batch and streaming based ML and BI workloads at the company. Critical teams such as ads, feed generation, and ML experimentation rely on the Data Platform to generate revenue for . The Data Movement team within this group is specifically responsible for empowering the business to more efficiently process data and orchestrate these data workloads.
- As a software engineer, you will work with teammates and partner teams to create and improve scalable, fault tolerant, self-serve systems.
- 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code
- Proficient in object-oriented programming languages like Python, Scala, Go, or Java.
- Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects.
- Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure.
- Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context.