Founded in 2025 ****to empower AI builders with infrastructure and tooling required to run agentic applications at scale. ****Raised pre-seed funding from Open Core Ventures (Sid Sijbrandij’s VC).
Agentic AI systems—composed of LLMs, tools, and stateful agents—break traditional infrastructure. Unlike conventional software, they require orchestrating task scheduling, durable execution, checkpointing, state management, sandboxed code execution, and heterogeneous compute allocation. This infrastructure complexity is a bottleneck for fast moving teams. Engineers spend more time building distributed systems plumbing than their actual AI product.
We are building a platform to tackle this infrastructure complexity for the next generation of developers building AI products.
We are extending Ray for Agentic AI workloads. Ray's core runtime has scaled to thousands of nodes for training and serving the world's largest language models, including GPT.
Building on Ray as the underlying compute engine, we provide the primitives for a secure, scalable, and reliable runtime for AI Agents.
We are compatible with popular agent frameworks like LangGraph, CrewAI, etc. And we are cloud-agnostic, so customers can run within our managed cloud or choose to self-host within their existing infrastructure.
As a backend-focused software engineer at RayAI, you’ll be contributing to Ray open-source, which is immediately distributed to 10s of 1000s of developers worldwide. You will also work on building proprietary services, modeling database schemas, data processing, and LLM magic.