About UsRuby Labs is a leading tech company that creates and operates innovative consumer products. Learn more about our story at: The RoleAt RubyLabs, we're seeking a Senior AI Engineer (Node.js / Next.js / TypeScript) to shape our AI infrastructure and drive production‐ready LLM experiences. You'll work in a modern stack, making data‐driven decisions around model performance, reliability, and cost.Observability, debugging, and evaluation are core to the role, leveraging Langfuse and AI gateways like OpenRouter to continuously improve model quality and operational efficiency. Key Responsibilities Advanced Prompt Engineering: Designing complex, dynamic prompt templates with conditional logic and efficiently reusing information and context within prompts to maximize generation quality and reasoning.Implementing various response schemes (JSON mode, function calling, Zod/JSON schemas) to ensure AI outputs are predictable and ready for seamless integration into application logic.Prompt Engineering & Evaluations: Building robust evaluation pipelines and using Langfuse to collect feedback and score the quality of responses in real time.AI A/B Testing: Data-Driven Decisions: Making deployment decisions for new prompts or models strictly based on quantitative benchmarks and trace data, rather than intuition.Output Scoring & Analysis: js & Next.js: Deep knowledge of the stack to build reliable services and handle complex LLM‐generated data.Dynamic Prompting Skills: Proven experience in building prompts where content is highly dependent on input variables and context injection.Understanding of LLM observability principles — setting up tracing, creating test datasets, and integrating scoring systems.Python: Basic knowledge for working with data science scripts or AI evaluation libraries.
Remote Work Environment: Paid National Holidays: Celebrate and relax on national holidays with paid time off to unwind and recharge.Flexible Independent Contractor Agreement: benefit from tax advantages, networking opportunities, reduced employment obligations, and the freedom to work from anywhere. Read more about it here:
Life at Ruby LabsAt Ruby Labs, we move fast, aim high, and expect the same from our team. If you're hungry to achieve, motivated by impact, and want to grow at the speed of your own ambition, Ruby Labs offers the platform to make it happen.Here, effort is matched with reward.