This is a tale of FinOps and the dark "secret" of the Cloud. During the past 12 months, I've probably spoken with close to 100 Data Engineering and DevOps leaders. 💸 There's been one common denominator trend-wise that has only accelerated: the focus on FinOps and cloud cost optimization as we've entered a more "normal" macroeconomic climate after some crazy growth-at-all-costs years when money was cheap. 💡As DevOps and Data Engineering teams have had to concentrate on speed and agility to meet the extraordinarily high expectations placed on them during the growth at all cost times propelled by low-interest rates, best practices in the field of data cloud cost optimization are still relatively new. 📚 This is changing fast, highlighted by e.g. Battery Ventures Q1 2023 State of Cloud Software Spending report that just came out: https://lnkd.in/g9t7YeZ5 📊 The report among others highlights that 95% of CXOs consider cloud cost optimization either a medium or a high priority over the next 2 years. It further highlights that non-cloud provider solutions for FinOps and cloud cost optimization are a priority for 65% of CXOs. 💬 Further, plenty of data leaders here on LinkedIn have highlighted the rising importance of FinOps such as Benjamin Rogojan, Robert Sahlin, Matthew Weingarten and Chad Sanderson to name a few. 📈 Benjamin Rogojan actually did a survey a few months back about FinOps and cost saving. The survey with 617 respondents showed that 66% of data teams had worked on cost-saving projects during the past 12 months. 😱 So to the dark "secret" of the Cloud... Cloud Egress costs are a nightmare to understand and forecast. It's also the best example of cloud provider lock-in. It represents how much providers will charge you to take YOUR data out of their data centers. Affordable prices and efficient service should be the only customer retainers, not egress costs. The graph below by the awesome team at Holori ☁️ showcases this. ➡️ Smaller players make more efforts than tech giants and push for a more open cloud ecosystem as you can see in Holori’s analysis. 🚀 The reasons listed above are a few examples of why I started looking at the end of last year at ambitious European founders looking to solve this. I'm very excited to be supporting Antoine Jeol, Alexandre Guérin and the team at Holori ☁️ building a global category leader from Europe in the space. I'm convinced that their innovative approach is the way to go to abstract complexity away from FinOps, cloud cost optimization and multi-cloud management. In the 2010s, cloud infrastructures enabled a new generation of companies to build and scale their businesses. In this decade, cloud infrastructure is table stakes and Cloud Economics is top of mind. Today the Cloud is perceived as a utility rather than a differentiator, like when Netflix started moving their workloads to AWS in early 2010! #cloud #finops #devops #dataengineering #startups #venturecapital
Great post Oliver. I have said it before, profitability, performance and data sovereignty are not mutually exclusive. There are ways to leave Hotel California...
Great to be working with you and benefit from your experience Oliver! Let's simplify multicloud together! ☁💪
Glad to have you aboard Oliver Molander !
you can use Cloudflare in front of your Cloud provider to act as a CDN to save on egress fees. Also Cloudflare offers R2 storage with NO EGRESS FEES whatsover!
I would challenge that egress cost is a lock-in, because it prevents you to take your data out of the Cloud. When you want to transfer say 1PB of data out of the cloud, you probably want to use things like cheap snowball, not transfer that through slow internet. You need > 3 months to transfer that through 1Gbps link and would cost say 80k$ according to this table. To order 13 devices to hold 1PB of data will cost you 4k$, 20x less than using regular egress. Data transfer to snowball is free. And it will be 10x faster as well. I'm ignoring (as you did I believe) the cost of transferring out of say S3.. Obviously all operation would be more expensive in both cases. So no, I don't think it's a vendor lock-in. Just use features of the cloud that are availble
"Free to get in; expensive to get out" - That's the business model of the bigger cloud providers when it comes to customer data.
I'm a huge fan of the Cloud, and I don't think AWS is the evil force it sometimes is made out to be. The main lesson to take away from using AWS (and any Cloud in general) is to be knowledgeable and up-to-date on what you're doing and what Cloud providers offer to help with costs. A large portion of spend is a result of throwing it away when it wasn't necessary, rather than actually being used for something useful.
Great to see growing attention to the cost and performance efficiency of cloud providers. And proud to see Oracle being the leader in the hyper scaler league, with egress being 10x cheaper than the others. Thanks Holori ☁️
A dark secret indeed - after so many years of growth and attractive pricing, we see vendor lock-in that makes IaaS and SaaS increasingly no longer cost competitive vs in-house / open source alternatives, we start to see corporates moving the pendulum in the other direction
Data & AI Entrepreneur and Investor | Bridging Business and Engineering
1y⚔️ Game of Egress ⚔️