I’ve had building a RAG on my to-do list for a while. Lately, I’ve been experimenting with Groq, which has consistently impressed me with its inference speed. It’s been over four months since I cancelled my ChatGPT Plus subscription and switched to BoltAI, where I can access leading models like GPT-4, Llama-3.70B, Claude Opus, and Mistral-8x7b at a fraction of the cost. What I appreciate about BoltAI is its well-designed graphical user interface, which allows me to easily connect with multiple foundational models via API.
Category: Open Source
In recent times, SaaS solutions built upon Open Source Software (OSS), commonly referred to as Commercial OSS (COSS), have garnered significant attention. This growing trend has made it much easier to develop a comprehensive and scalable web application without resorting to expensive SaaS offerings. Now, all that is required is a team of 3-5 skilled engineers who possess the ability to navigate through extensive code bases. With the aid of tools such as cursor.sh or GitHub Copilot, these engineers can immerse themselves in solving the business or technical challenges at hand, without getting overly fixated on opinionated technology stacks. As someone who tends to get caught up in such stacks, this shift allows me to focus more on the task at hand and avoid unnecessary distractions.