Senior Software Engineer, Data & Platform Services

1 мес. назад

GermanyEuropeSeniorRemote

hadoopsparkimpaladatabricks

Senior Software Engineer role to lead modernization of core data platform migrating data pipelines to cloud-native Databricks in Berlin, Germany.

Обязанности

Lead the Modernization of Our Data Platform: Take ownership of migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a modern, scalable Databricks ecosystem. You'll re-architect ETL workflows, convert complex SQL, and seamlessly migrate integrations, connections, and secrets.
Accelerate Development with AI-Powered Engineering: Leverage cutting-edge AI coding assistants such as Claude and Codex to dramatically accelerate migration efforts. Rather than manually rewriting legacy code, you'll guide AI tools to convert SQL, modernize ETL scripts, untangle dependencies, and generate clean, maintainable code—while applying your engineering expertise to validate architecture, performance, and quality.
Build the Next Generation of Data Pipelines: Design, develop, and optimize scalable data workflows using Airflow and Databricks. You'll create resilient, high-performance pipelines that are reliable, cost-efficient, and built to support growing business needs.
Champion Data Quality: Ensure the accuracy and consistency of migrated data by implementing comprehensive validation and testing strategies. You'll play a critical role in maintaining data integrity throughout the migration journey.
Improve Platform Reliability: Help drive operational excellence by enhancing observability, monitoring, and incident response practices. Contribute to service reliability through SLOs/SLAs and participate in a scalable on-call rotation to support production systems.
Deliver Meaningful Business Impact: Apply your understanding of contact center analytics to build platforms that power customer conversation insights, reporting, and business intelligence. You'll embrace a data-driven mindset, designing systems that are measurable, observable, and continuously improving.

Требования

Extensive Software Engineering Experience: 6–8 years of experience building and supporting distributed systems and large-scale data platforms, with a proven ability to own complex technical initiatives from design through production.
Proven Platform Modernization Experience: Hands-on experience leading or playing a key role in migrating enterprise data platforms from legacy technologies—such as Hadoop, Spark, Hive, or Impala—to modern cloud-based solutions like Databricks.
Deep Databricks Expertise: Strong knowledge of the Databricks ecosystem, including Jobs, Delta Lake, cluster configuration and optimization, and migrating complex SQL workloads from Impala or Hive to Spark SQL.
Data Pipeline & Orchestration Skills: Advanced Python programming skills for ETL development and extensive experience designing, building, debugging, and optimizing production data pipelines and orchestration workflows using Airflow and Databricks.
Cloud & Infrastructure Knowledge: Experience working with cloud-native data platforms, particularly Google Cloud Platform (GCP) and Google Cloud Storage (GCS), with an understanding of containerized, Kubernetes-based (GKE) microservice architectures.
Modern Data Platform Expertise: Strong understanding of distributed data processing architectures and the trade-offs between real-time and batch data processing.
Hands-on experience with legacy big data technologies, including Hadoop and MapReduce, with the ability to modernize and migrate complex data ecosystems.
Knowledge of data integration patterns, including APIs, connectors, webhooks, and event-driven architectures.
Cloud & Platform Engineering: Experience building, deploying, and managing cloud-native data platforms, with Google Cloud Platform (GCP) experience preferred.
Familiarity with containerized environments and running data workloads on Kubernetes.
A strong focus on building highly reliable, scalable, and observable platforms, with experience implementing monitoring, validation, and data quality controls to ensure successful migrations.
AI-Assisted Software Development: Experience using AI-powered development tools such as Claude, Codex, or similar coding assistants to accelerate software development, code modernization, and platform migrations.
Skilled at effectively prompting, reviewing, and validating AI-generated code while ensuring architectural integrity, maintainability, and production readiness.
Collaboration & Communication: Excellent communication and collaboration skills, with experience partnering across engineering teams in multiple time zones.
Comfortable working in a globally distributed environment with colleagues across the US, Europe, Israel, and India.

Будет плюсом

Experience working with conversational AI , contact center platforms , or customer engagement technologies .
Proficiency in Java or Scala , particularly when analyzing, maintaining, or modernizing legacy codebases during platform migrations.
Experience designing, implementing, and maintaining CI/CD pipelines to support automated testing, deployment, and reliable software delivery.

Условия

We are committed to supporting the complete well-being, health, financial security, family, and professional growth of our permanent employees.

Другое

Location: Berlin, Germany  Remote Status: Fully Remote (#LI-Remote)
(NASDAQ: LPSN) is a leader in trusted enterprise conversational AI and digital transformation. The world's leading brands use our award-winning Conversational Cloud platform to connect with millions of consumers. We power nearly a billion conversational interactions every month, providing uniquely rich data analytics and safety tools to unlock the power of conversational AI for better business outcomes. Fast Company named the #1 Most Innovative AI Company in the world.
We're looking for a Senior Software Engineer to join our globally distributed Data Platform team in Europe and play a key role in shaping the future of our data ecosystem.
In this high-impact individual contributor role, you'll lead the modernization of our core data platform by migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a scalable, cloud-native Databricks architecture. You'll have the opportunity to drive technical decisions, influence platform architecture, and build the foundation that powers data across the business.
If you're a hands-on engineer who enjoys solving complex technical challenges, building modern data platforms, and making a lasting impact at scale, we'd love to hear from you!
Additional Pension scheme :  deferred pension scheme ( contributes 20%), ESPP and annual bonus depending on achievements
Equipment : Internet and Mobile reimbursement
Development: Access to internal professional development resources.
Flexible Paid Time Off (PTO): Personal time off 33 days , vacation (28 days) and care days (5)
Paid Public Holidays.
Volunteering Days:  Use them to make a difference in your community. Whether it's a cleanup, supporting a local initiative or holding an “Ehrenamt”, just let us know! We're here to help you create a meaningful impact.
Remote-First Model: Be flexible, work flexibly and from anywhere  - no defined working hours or boundaries with offices in Mannheim and Berlin
Monthly Connection: Join our monthly connection pizza day in the office!
As leaders in enterprise customer conversations, we celebrate diversity, empowering our team to forge impactful conversations globally. is a place where uniqueness is embraced, growth is constant, and everyone is empowered to create their own success. We're very proud to have earned recognition from Fast Company, Newsweek, and BuiltIn for being a top innovative, beloved, and remote-friendly workplace, and recognized by Gartner as a leader in the Conversational AI space.
We are committed to fostering an inclusive workplace and are proud to be an Equal Opportunity Employer (EOE) . We believe that diverse perspectives drive innovation. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristics protected by US Federal, State, or Local law.
is dedicated to the accessibility needs of our applicants and employees. We provide reasonable accommodations to job applicants with disabilities. Applicants who require a reasonable accommodation for any part of the application or hiring process should inform their recruiting contact upon initial connection.
The talent acquisition team at has recently been notified of a phishing scam targeting candidates applying for our open roles. Scammers have been posing as hiring managers and recruiters in an effort to access candidates' personal and financial information. The phishing scam is not isolated to only and has been documented in news articles and media outlets.
Please note that any communication from our hiring teams at regarding a job opportunity will only be made by a employee with an @.com email address. does not ask for personal or financial information as part of our interview process, including but not limited to your social security number, online account passwords, credit card numbers, passport information, and other related banking information. If you have any questions and or concerns, please feel free to contact recruiting-lp@.com