Abhay Bhat

Life | Technology | Investing

cropped header 2.jpeg

Managed to setup my own Autonomous RAG with llama3 on Groq in less than 20mins, looks like it is going to be awesome. Hooking it with gpt-4o would be next! Thanks ⁦@ashpreetbedi⁩ https://t.co/ta9dyBSyrq

Autonomous RAG with llama3 on Groq

I’ve had building a RAG on my to-do list for a while. Lately, I’ve been experimenting with Groq, which has consistently impressed me with its inference speed. It’s been over four months since I cancelled my ChatGPT Plus subscription and switched to BoltAI, where I can access leading models like GPT-4, Llama-3.70B, Claude Opus, and Mistral-8x7b at a fraction of the cost. What I appreciate about BoltAI is its well-designed graphical user interface, which allows me to easily connect with multiple foundational models via API.

My current stack LLM/AI products I use everyday – Cursor ide to write code – BoltAI for writing and brainstorming (gpt4, llama3, claude, mistral) – perplexity for research https://t.co/tQ135Sqo7Z

RT @laurenbalik: ClickHouse is very good. It has the power to disrupt much of the SIEM/cyber space, not to mention many Snowflake $SNOW an…

RT @zimmskal: Llama 3 70B takes the king’s crown 👑 from GPT-4 Turbo – 100% in coverage and 70% in quality of code – 💵 most cost-effective…

– Looking at their balance sheet, their dry powder will deplete. So new acquisitions will likely come with equity. Win-win for acquiree and shareholders. – Organic innovation still seems unaddressed, as with the buyback they might not be able to take moon shots

– With the democratization of open-source foundational models, monetization will likely come from their utilization, which Apple will enable with their devices’ ecosystem.

– Their silicon strength and fab supply chain influence will likely give them an edge over Nvidia – GenAI / OpenAI is not a threat to them. Just a matter of time to allocate enggs and they can do it. Apple might partner with OpenAI

So difficult to make sense of Apple’s $110 Billion Stock Buyback Plan. Their moat in devices, silicon-to-retail, is undisputed and the GenAI froth will subside, but the innovation element is still missing, Vision pro bleh https://t.co/uKixMt1x4O

Stripe, doubling down on embedded finance, de-couples payments from the rest of its stack. Getting lean before IPO and riding the embedded finance wave https://t.co/VYiUGzPO2H

Page 4 of 68