Fleetworks
Senior Software Engineer
1w ago
USASeniorflinksparkvitesstidbjavapythonairflowmysql
Design and develop scalable backend systems using Flink, Spark, Vitess, and TiDB for AI-driven freight matching and logistics optimization.
Requirements
- a) Use of Python, Agentic Frameworks, Postgres, Redis, Debugging and API Integrations.
- b) Working with Tech Leads to implement Analytics Framework rewrite using Python.
- c) Knowledge with LLM Orchestration & Tool-Calling Patterns.
- d) Experience in Event-Drive/Workflow Systems Design, ITSM Integration Engineering, and Analytics Systems Architecture.
- e) Experience in Scalable Data Modeling, and Pipeline Design and Reliability.
- f) Use of Flink, Spark and TiBD.
- g) Planning and executing the Workflow aspect of TiDB Migration.
- h) Use of Java, Airflow, Vitess, Kafka, and Mysql.
Other
- Job Title: Senior Software Engineer (multiple positions open)
- Worksite Location: 260 Townsend St, Suite 650, San Francisco, CA, 94107
- Job Description :
- 1. Design and develop scalable backend systems using Flink, Spark, Vitess, and TiDB, leveraging scalable data modeling and pipeline design and reliability principles to support AI-driven freight matching, ensuring seamless handling of high volumes of communications and data.
- 2. Lead the end-to-end development of features from initial concept through to deployment, applying event-driven and workflow system design patterns while making key technical and design decisions to maximize impact and user satisfaction.
- 3. Engage directly with customers and cross-functional teams to gather insights for analytics systems architecture refinements, ITSM integration engineering, and delivery of workflow solutions that streamline freight logistics and improve user experience.
- 4. Contribute to both backend and frontend platform development, incorporating LLM Orchestration and Tool-Calling Patterns and selecting appropriate Java, Python, Airflow, and Mysql technologies, agentic frameworks, and abstractions to maintain a balance between development speed and system reliability.
- 5. Architect and optimize system performance through advanced analytics systems architecture, data modeling, caching strategies, and workflow integration to ensure reliability and scalability under peak load conditions.
- 6. Collaborate with data science and product teams to integrate machine learning models into the platform, enabling real-time freight matching and predictive analytics using Flink, Spark, and TiBD for fast, reliable data ingestion and inference.
- 7. Plan and execute the Workflow aspect of TiDB Migration and implement rigorous testing, monitoring, and observability frameworks to ensure code quality, system integrity, and operational excellence.
- 8. Drive continuous integration and continuous delivery (CI/CD) initiatives, automating workflows and working with tech leads to implement Analytics Framework rewrite using Python to improve deployment speed and overall engineering efficiency.
- 9. Participate in shaping the engineering culture by setting best practices and mentoring new team members to support the company's growth and innovation.
- Minimum Requirements : Bachelor’s (or foreign educ. equiv.) Degree in Computer Science, Computer Engineering, or a related field plus three (3) years’ experience in the job offered or related occupation.