The Weingartz Company reposted this
Notes on Ray2 infra - we made the decision to launch for paid users only anticipating that there weren't enough GPUs around to handle free trials yet. Turns out Ray2 is ridiculously more popular and that thousands of GPUs aren't even sufficient to handle paid demand. So, here's the plan - 1. We are bringing online some of our training GPUs to run inference to increase capacity by a few thousand. 2. We will raise the priority of folks on "unlimited plan" to same level as "enterprise" as a way to help advance some workloads. 3. We are working with our partners to increase base inference capacity to meet market demand. Once we are able to serve paid demand, we will bring Ray2 up for free trial.