-
Lead the design and development of AI-powered features for our app and agent builder, covering everything from architectural design and prototyping to production deployment and monitoring.
-
Build and maintain robust agent orchestration (tool/function calling, memory, workflows), retrieval pipelines (RAG), and low-latency inference services.
-
Evaluate, integrate, and optimize LLMs and embeddings (OpenAI, Anthropic, open-source), including prompt engineering, guardrails/safety, and fine-tuning when needed.
-
Develop secure and reliable integrations and SDKs to connect agents with external systems and data sources (REST/GraphQL APIs, webhooks, OAuth).
-
Implement rigorous offline and online evaluation frameworks, experimentation processes, and observability tooling to ensure quality, correctness, and cost-efficiency at scale.
-
Work cross-functionally to translate user challenges into intuitive solutions; mentor engineers and contribute to engineering best practices.
-
Drive operational excellence across testing, CI/CD, performance optimization, reliability, security, and cost management.
-
6+ years of professional software engineering experience, including at least 3 years building production-grade ML/AI or LLM-based systems.
-
Strong Python skills and proficiency in TypeScript/Node.js (or similar), with a proven record of shipping production services.
-
Hands-on experience with LLMs: prompt design, tool/function calling, retrieval-augmented generation (RAG), and agent frameworks (LangChain, LlamaIndex, Semantic Kernel) or custom orchestration.
-
Solid data and infrastructure knowledge: vector databases (pgvector, Pinecone, Weaviate), search engines (Elasticsearch/OpenSearch), SQL databases (Postgres), and caching systems (Redis).
-
Experience with cloud environments (AWS/GCP/Azure), containers (Docker), orchestration/serverless platforms (Kubernetes/Lambda), CI/CD, and observability tools.
-
Strong understanding of API and distributed systems design, with an emphasis on reliability, performance, security, and cost-efficiency.
-
A product-oriented mindset and excellent communication skills; comfortable owning solutions end to end in a fast-moving environment.
-
Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.