Backend / Ops Engineer Product team

As a Backend Engineer at Bitrefill, your mission is to drive the development of our new AI automation functions. In this role, you will leverage your system engineering skills to manage AI agents. You will design, develop, and monitor pipelines to evaluate AI agent performance by tracking conversations and outcomes, addressing the challenges of nondeterministic AI outputs. As a key contributor to this new initiative, you will build the foundation for our AI operations from the ground up, collaborating across departments to implement backend solutions and ensure seamless integration of AI driven automation processes.

Our Tech Stack

• Node.js/TypeScript
• Express.js
• MongoDB, MySQL
• Amazon AWS, Kubernetes

Your Responsibilities

• Manage AI agents and ensure system availability for internal teams
• Design and monitor pipelines to evaluate AI agent performance, tracking conversations and outcomes to measure and improve reliability
• Design and implement evaluation pipelines to assess AI agent performance, report on results, and drive iterative improvements
• Track the performance of AI tools and pipelines, identifying opportunities for enhancement and implementing solutions to boost efficiency
• Work closely with cross functional teams to understand team needs and turn them into technical solutions
• Communicate technical concepts clearly to nontechnical stakeholders
• Leverage your understanding of company workflows to streamline processes and enhance operational efficiency

Who you are

• Mid/Sr Level (BE/OPS)
• Experience with our tech stack (Python is a plus but not required).
• Familiarity with Docker, machine configuration, and system engineering.
• Exposure to AI/LLM technologies, with an understanding of their practical applications.
• Experience with AI/ML frameworks, agent-based systems, or evaluation pipelines is a plus.
• Enthusiasm for staying updated on AI advancements and industry trends
• Excellent interpersonal skills, able to engage with all teams to understand business processes, and turn road blocks into technical solutions.
• Thrives in a fast paced, remote environment while taking initiative to drive projects forward.

You Bring With You

• Located in Europe/Americas time zones (GMT-1 to GMT+3)
• Excellent communication and interpersonal skills, with fluency in written and spoken English
• 4+ years of backend experience, mainly within our tech stack (python is a plus)
• Proof of work with AI via a portfolio or contributions to open source libraries using large language models (LLMs) or AI agent frameworks
• Familiar with cloud platforms (AWS, GCP, or Azure) for deploying and managing AI systems.
• Prior experience in a fast paced startup environment