Senior Lead Software Engineer - Data Platform

1 мес. назад

USALead

data lakehousedata orchestrationdata modelingplatform automation

Senior Lead Software Engineer working on Data Platform focusing on data lakehouse and platform scalability.

Требования

You are passionate about building platforms for the long term and can balance technical quality, engineering velocity, and business impact across multiple teams.
You have 12+ years of software engineering experience and deep knowledge of distributed systems, data platform architecture, and large-scale analytical processing.
You bring deep expertise in one or more core Data Platform problem spaces such as lakehouse architecture, data ingestion and transformation, distributed compute, data warehousing, platform reliability, or developer-facing data infrastructure, while maintaining strong system-level thinking across interconnected areas.
You have independently led large, ambiguous, multi-quarter programs and have a track record of making clear architectural calls, breaking through technical obstacles, and leading teams through critical operational moments.
You have strong hands-on experience with the kinds of systems this role touches, including Iceberg-based storage, Spark or EMR-based compute, Airflow-based orchestration, Python-based data platform tooling, modeled data systems, and AWS-hosted infrastructure.
You understand how to build and operate trustworthy data platforms, including schema evolution, materialization patterns, observability, backfills, repairs, audits, access controls, and cost-aware platform operations.
You are highly effective at driving outcomes through influence and technical leadership rather than direct authority, and you communicate clearly with both technical and non-technical partners.
You are passionate about mentoring other engineers and creating the patterns, guidance, and opportunities that help senior engineers and leads grow.
You enjoy improving how systems and teams work, whether through better architecture, tooling, workflows, or operating practices.

Будет плюсом

Experience with custom built databases and CDM-style modeled data layers, especially transforming landing data into durable, queryable business entities.
Experience building or extending managed table frameworks such as Materialized Views and related operational tooling.
Experience with data governance, ownership, discoverability, residency, or regulated-data programs such as GDPR or HIPAA.
Experience building platform automation for backfills, repairs, optimization, autoscaling, and agentic support for engineers operating complex data systems.

Другое

At , we value the unique backgrounds, experiences and perspectives each (we call ourselves Klaviyos) brings to our workplace each and every day. We believe everyone deserves a fair shot at success and appreciate the experiences each person brings beyond the traditional job requirements. If you’re a close but not exact match with the description, we hope you’ll still consider applying. Want to learn more about life at ? Visit .com/careers  to see how we empower creators to own their own destiny.
The Data Platform organization owns the foundational data systems that power analytics, AI/ML, and product use cases across . This Senior Lead role is anchored in the Data Lake domain, while working broadly across Data Platform to support and align with adjacent teams.
 
In practice, this role helps shape and connect the technical direction across lakehouse storage and compute, data onboarding and orchestration, modeled data layers, and the operational automation that keeps the platform reliable, observable, and usable at scale. The role requires strong judgment in connecting work across teams rather than optimizing only within a single technical boundary.
 
The scope is not just to improve one system in isolation, but to make the broader data platform more trustworthy, scalable, and easier to operate. That includes aligning roadmaps across teams, supporting high-impact and complex cross-team projects, and helping represent Data Platform clearly to partner teams and stakeholders.
As a Senior Lead Software Engineer in Data Platform, with primary focus on Data Lake, you will:
 
Independently own and drive high-impact technical objectives that span multiple Data Platform teams, especially Data Lake while supporting work that intersects with Data Automation and Data Warehouse.
Help align technical roadmaps across Data Platform so teams are making coherent investments against shared priorities, dependencies, and long-term platform direction.
Lead large, complex, cross-team initiatives from discovery through rollout and long-term ownership, especially where success depends on coordination across organizational and technical boundaries.
Make high-judgment architectural decisions across core platform systems including lakehouse storage and compute, orchestration, modeled data layers, and operational automation, and create reference patterns that other teams can reuse.
Establish paved paths, standards, and shared abstractions that reduce repetitive manual work and make onboarding, operating, and evolving data systems dramatically faster and more reliable across the platform.
Partner closely with engineering, product, analytics, AI/ML, and governance stakeholders, and represent Data Platform clearly in cross-functional discussions that require both technical depth and strong external communication.
Help drive alignment on complex projects by clarifying trade-offs, surfacing dependencies early, and ensuring teams stay coordinated as priorities or execution details shift.
Be accountable, with team and engineering leaders, for the long-term technical health of the systems in your scope across reliability, scalability, performance, cost, security, and operational excellence.
Own the response to complex platform issues when needed, working directly with engineers across teams during high-severity situations and turning lessons learned into lasting improvements in architecture, operations, and communication.
Invest in the growth of senior and lead engineers through design reviews, RFC feedback, architectural coaching, and active participation in senior engineering hiring.
Core technologies and platform components used by the Data Lake team include:
 
Iceberg S3 tables for the foundational storage layer.
Spark / EMR for large-scale analytical compute.
Airflow for orchestration, scheduling, and workflow tracking.
Materialized Views and Python-based platform frameworks for managed Iceberg tables and related data tooling.
Landing-table loaders and CDM tables for ingestion and modeled data transformations that support KDB.
Audit and operational automation for maintenance, observability, backfills, repairs, optimization, autoscaling, and access controls.
AWS-hosted infrastructure supporting the lakehouse platform and its surrounding systems.
Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Our salary range reflects the cost of labor across various U.S. geographic markets. The range displayed below reflects the minimum and maximum target salaries for the position across all our US locations. The base salary offered for this position is determined by several factors, including the applicant’s job-related skills, relevant experience, education or training, and work location.
In addition to base salary, our total compensation package may include participation in the company’s annual cash bonus plan, variable compensation (OTE) for sales and customer success roles, equity, sign-on payments, and a comprehensive range of health, welfare, and wellbeing benefits based on eligibility. 
Your recruiter can provide more details about the specific salary/OTE range for your preferred location during the hiring process.
This role may require up to 10% travel for purposes such as new hire onboarding, client or partner work if applicable, team meetings, and industry events. Travel is coordinated in advance.
We’re (pronounced clay-vee-oh). We empower creators to own their destiny by making first-party data accessible and actionable like never before. We see limitless potential for the technology we’re developing to nurture personalized experiences in ecommerce and beyond. To reach our goals, we need our own crew of remarkable creators—ambitious and collaborative teammates who stay focused on our north star: delighting our customers. If you’re ready to do the best work of your career, where you’ll be welcomed as your whole self from day one and supported with generous benefits, we hope you’ll join us.
AI fluency at includes responsible use of AI (including privacy, security, bias awareness, and human-in-the-loop). We provide accommodations as needed. 
By participating in ’s interview process, you acknowledge that you have read, understood, and will adhere to our  Guidelines for using AI in the interview Process . For more information about how we process your personal data, see our  Job Applicant Privacy Notice .
is committed to a policy of equal opportunity and non-discrimination. We do not discriminate on the basis of race, ethnicity, citizenship, national origin, color, religion or religious creed, age, sex (including pregnancy), gender identity, sexual orientation, physical or mental disability, veteran or active military status, marital status, criminal record, genetics, retaliation, sexual harassment or any other characteristic protected by applicable law.