TL;DR
We’re hiring a Senior Product Engineer (Backend) to help scale the deepset AI Platform, our LLM-powered enterprise product. You’ll own features end to end, build systems that process millions of documents, and contribute to our open-source framework, Haystack. If you enjoy solving complex challenges with real impact, this role’s for you.
Requirements
- 5+ years of backend development experience, ideally in Python
- Strong knowledge of REST APIs, SQL databases, CI/CD, Kubernetes, and cloud services
- Experience with Infrastructure-as-Code tools (e.g., Terraform or Crossplane)
- Proven ability to write clean, testable, observable, and maintainable code
- Skilled at fast troubleshooting in high-pressure, cross-functional settings
- Comfortable dealing with customer-facing production issues
- Proactive, collaborative, and aligned with team-wide decisions
Benefits
- Remote-first setup with flexible hours & tech of your choice
- 30 days vacation + extra days for family sick leave
- Competitive salary & stock options for every team member
- Monthly sports & mental health support allowance with Oliva
- Annual learning & development budget
- Monthly team socials & in-person meetups
- Dog-friendly Berlin HQ
Why deepset
At deepset, we’re on a mission to make custom AI solutions accessible to every organization. With Haystack, thousands of developers build advanced LLM applications every day, while our enterprise-ready AI Platform helps companies turn large language models into business value. We’re remote-first, flexible, and built on a culture of trust and ownership. You’ll collaborate with top-tier tech talent, tackle meaningful challenges, and help transform complex AI into solutions that are simple, powerful, and ready for the real world.
Nice to have
- Experience in early-stage or high-growth startups
- Familiarity with open-source development
- Background in NLP, machine learning, or LLM technologies
- Exposure to building or scaling B2B SaaS products
What you will do
- Design and build a scalable AI platform that helps users solve real business problems with LLMs
- Develop infrastructure to support thousands of LLM applications, processing millions of documents and handling 100s of user requests per second
- Own backend features end to end—from architecture and CI/CD to testing, monitoring, and customer feedback
- Collaborate with the Open Source team to improve and contribute to Haystack
- Partner with the infrastructure team on performance, observability, and debugging
- Help resolve high-priority production issues with customer-facing impact
- Improve reliability by maintaining strong debugging tools and processes
- Mentor other engineers and support their technical growth
