Heartspace.AI omdelade detta
Today I have been able to reroute most of Heartspace.AIs model router to be able to make the most use of being part of Google for Startups and to be able to let our users choose model provider themselves (or let our router do it for them). It’s funny how many moving parts includes. And how different things like streaming responses and thread handling works when working with different APIs. All of that are engineering problems we have had to solve once and now I resolving them but in a more streamlined and modular way. What will this lead to? 1. Users willl be able to choose their favorite model in Heartspace. If you love Claude sonnet 3,5 or any of the Gemini or OpenAI models you will be able to choose them by yourself instead of our model router choosing for you. 2. We will be defaulting more toward Gemini since Googles models are in general outperforming other models when it comes to content creation and because we can offer so much more from our inference approach when we can leverage the free credits Google has given us. Very generous program by the way! If you are an startup check it out! Google is doing awesome stuff for the builder ecosystem!This allows us to increase output quality and consistency without increasing prices. Most of the day I had the shit kicked out of me by resilient front-end bugs (front-end is still not my favorite thing) but progress is being made and by the end of the day I had a early version up and running. Still some things left to do but it is so good so can’t wait to release this to our users! Another cool thing is that we also got accepted into one of Cloudflares programs today and will get free hosting for a least a year from today. Saves us up to $5 000. Super grateful for that 🙌🏼🙏🏼.