๐Ÿ—๐Ÿšข๐Ÿš€ On-Prem RAG with LlamaIndex


โ€‹

โ€‹

๐Ÿ‘‹ Hey, AIM community!

โ€‹

Join Dr. Greg, The Wiz, and the creators of AutoGen next Wednesday for AG2: AutoGen, Evolved! They just dropped new features and a new website. Join us to hear the latest!

โ€‹


Last Wednesday, AI Makerspace explored On-Prem Agentic RAG: Report Generation with LlamaIndex! We dug into what "on-prem" means, exactly, how dependency hell is extra real on-prem, and how there are unique challenges you run into when operating at the LLM edge.

โ€‹

๐Ÿงฐ Resources

  • ๐Ÿง‘โ€๐Ÿซ Concepts: Slidesโ€‹
  • ๐Ÿง‘โ€๐Ÿ’ป Code: GitHub Repoโ€‹
  • ๐Ÿงฐ Tools: LlamaIndex Workflows, QDrant, Ollama, HF Pipelines

โ€‹


๐Ÿ”ญ Coming Up!

vLLM: Virtual LLM

December 11, 2024

vLLM is an industry-leading end-to-end solution for efficient inference AND serving of LLMs born out of the open-source community. We'll take a look at the latest and what to expect in 2025.

On-Prem Agents with LangGraph

To ensure privacy from Cloud Service Providers, you must build applications to run on your hardware. If you're a LangChain shop or enthusiast aiming to build prototypes on-prem, join us!

๐ŸŒ Around the Community!

๐Ÿค“ See what the community is building, shipping, and sharing this week. Join us in the Lounge every Monday at 9 AM PT for some accountability!

โ€‹

Want to join the AIM community? Hop into Discord and share your intro now!



๐Ÿ–ผ๏ธ Meme of the Week


Keep building ๐Ÿ—๏ธ shipping ๐Ÿšข and sharing ๐Ÿš€,

โ€‹

โ€‹Dr. Greg, The Wiz, Seraacha, and Luskโ€‹
โ€‹AI Makerspaceโ€‹

โ€‹
โ€‹Unsubscribe ยท Preferencesโ€‹

The LLM Edge

Read more from The LLM Edge

Hey, AIM community! Join Dr. Greg and The Wiz as they cover Large Reasoning Models next Wednesday, Jan 18. With the release of o1, o3, and the new Gemini, everyone is talking about Chain-of-Thought Reasoning and Test-Time Compute. What are these things, anyway? And what are the implications for building production LLM applications with models like this in 2025 and beyond? Join the discussion live on Wed. at 10 AM PT! Last week, we dove into the latest RAG Evaluation metrics and RAGAS...

๐Ÿ‘‹ Hey, AIM community! As we near the end of 2024, our team is looking back at all we've accomplished as a community this year. Thanks to all of you for learning ๐Ÿ“š, building ๐Ÿ—, shipping ๐Ÿšข, and sharing ๐Ÿš€ with us at the open-source LLM Edge! We'll be rooting for you to take your AI career to the next level in 2025, and when you do, we hope you'll lean on us to amplify your story and showcase your best work. In this way, you'll help the AI Makerspace community achieve its mission of becoming the...

๐Ÿ‘‹ Hey, AIM community! Dr. Greg and the Wiz will go on-prem with LangGraph next week! Join us for our last YouTube Live event before the New Year ๐ŸŽ†! Last Wednesday, Dr. Greg and The Wiz guest spoke with Malikeh from Arcee on the SLM Show about the year in summary at the LLM Edge, and what to expect in 2025! We also explored vLLM! We learned that Virtual LLM helps us relieve memory bottlenecks when serving LLMs through PagedAttention, just like Virtual Memory relieves memory bottlenecks in...