The Math Behind Running AI Models on Krutrim AI Cloud
AIM Events
Hosting the World’s Most Impactful AI Conferences & Events. For Brand collaborations write to info@aimmediahouse.com
Ola’s decision to use Krutrim AI Cloud instead of Microsoft Azure and AWS cloud infrastructure is going to save them approximately INR 15 crore annually.
Ola on cloud saving mode
“Cloud costs are crazy. He [Bhavish Aggarwal] basically used to burn INR 5 lakh per day, which is quite a bit of money,” shared Sasank Chilamkurthy, the founder of Qure AI and Von Neumann AI (the company building a personal AI server JOHNAIC), in an exclusive interview with AIM.
Chilamkurthy swiftly did some number-crunching and estimated that it costs about INR 8.2-10 crore to buy servers that can handle Ola’s current load on Azure. Had they not migrated, the expense over three years would have totalled INR 54.74 crore.
The difference, INR 54.75 crore minus INR 8.2 crore, amounts to about INR 45 crore, translating to a substantial savings of roughly INR 15 crore annually.
Assuming a company uses an AWS g4dn.4xlarge instance and reserves it for three years, it would cost them INR 10-25 lakh for a specific instance, according to Chilamkurthy.
As per estimates and disclosures by the Ola chief on X, this shift could lead to a daily revenue loss of INR 5-25 lakh for Microsoft Azure and INR 30-40 lakh for AWS. Annually, this could translate to approximately INR 18.25-91.25 crore for Azure and INR 109.5-146 crore for AWS.
Moreover, according to Chilamkurthy, Ola spent around INR 85 lakh on egress costs paid to Azure. Egress cost is a charge levied by cloud providers for moving or transferring data from the cloud storage where it was earlier uploaded.
Chilamkurthy told AIM that he recently bumped into Aggarwal at a cafe, where he pitched JOHNAIC for Krutrim AI Cloud. He said that Aggarwal showed some interest in JOHNAIC, partly because it also utilises Intel GPUs. He further revealed that Ola Krutrim will buy Intel Gaudi 2 to build Krutrim AI Cloud.
Building products for the world
In a recent post, Aggarwal said that over 2,500 developers have signed up for Krutrim Cloud services, and they will work with everyone to onboard them in the coming weeks. Most recently, Aggarwal met Arm chief Rene Haas in Taiwan.
Krutrim, India’s first AI unicorn, recently launched Krutrim AI Cloud, its own cloud platform for enterprises, researchers, and developers. Recently, Aggarwal said Bengaluru has the world’s largest talent density for semiconductors outside the US Bay Area.
Cred founder and CEO Kunal Shah is also convinced that India is now ready to build products for the world.
Recommended by LinkedIn
“Earlier, I used to think we were not really ready for that, but now I feel there is enough evidence that we might be able to create something interesting for the world,” Shah said in a recent interview.
Jivi’s purpose-built medical LLM Jivi MedX recently ranked number one on the Open Medical-LLM Leaderboard, outperforming OpenAI GPT-4 and Google’s Med-PaLM 2.
Meanwhile, Indian founders started QX Lab AI, which launched the hybrid GenAI multimodal platform ‘Ask QX PRO’. Similarly, Quizizz supports millions of students in over 150 countries.
Most recently, two Indian engineering students, Rudransh Agnihotri and Manasvi Kapoor, launched Mayakriti, an image-generation platform that uses advanced GenAI to create lifelike visuals—from photorealistic portraits and personalised creations to cartoons, anime, and abstract art.
Check out the full story here.
Indian AI Researchers Should Move Beyond PhDs
Though there’s an increase in AI research within India, it seems that most of these have been done by researchers for their PhD theses. None of these actually come off for production. Several researchers shared similar thoughts when they spoke with AIM.
Indian universities have produced research on LLMs, voice models, and using AI in several fields, but most of it remains in the research phase. However, this is slowly changing, with several researchers sending their papers to ICML and NeurIPS. Read more here.
INDIA