Download as PDF, PPTX
Uploaded byQuentin Reul
Taming the LLM Herd - Effortless Multi-Model Integration with LangChain
The document outlines a presentation on integrating large language models (LLMs) using Langchain in a software development meetup held in Naperville on April 3, 2024. It highlights the speaker's background in computing science, their experience with generative AI, and provides insights into the applications and extensions of Langchain, including compatibility with various LLM providers. Additionally, the document promotes TechType Rocket as a tool for enhancing tech blogging and concludes with the importance of streamlined LLM integration.
More Related Content
Similar to Taming the LLM Herd - Effortless Multi-Model Integration with LangChain
Taming the LLM Herd - Effortless Multi-Model Integration with LangChain
- 1. Naperville Software DevelopmentMeetup - April 3rd, 2024 Credit: Microsoft Designer Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 2. Who am I? 2 ●Academic Background ○ Ph.D. in Computing Science from Aberdeen University (Scotland) ■ Leveraged Semantic Technologies to facilitate inter-department collaboration ■ Introduced an approach to map entities across semantic schemas (Thesis) ■ Contributed to development of W3C standards, such as SKOS ● Work Experience ○ 1+ year experience developing prototypes demonstrating value of Generative AI for research ○ Spearheaded several expert research solutions based on Artificial Intelligence ○ Architected a hybrid AI system combining NLP and rule-based techniques to deliver a functional solution despite labeled data limitations ○ Awarded multiple internal Innovation Awards for contribution to integration of AI solutions Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 3. Agenda ● Introduction ● LangChain ●RQle.ai LangChain extension ● TechType Rocket ● Conclusion 3 Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 4. Generative AI 4 Taming theLLM Herd Effortless Multi-Model Integration with LangChain Generative AI is a branch of AI that focuses on creating entirely new content. This content can come in many forms, including text, images, audio, and even videos.
- 5. Generative AI 5 Taming theLLM Herd Effortless Multi-Model Integration with LangChain
- 6. Key Areas forGenerative AI 6 Taming the LLM Herd Effortless Multi-Model Integration with LangChain Source: The economic potential of generative AI: The next productivity frontier 75% of Generative AI value focuses on: - Customer Operations - Marketing & Sales - Software Engineering - Research & Development
- 7. Generative AI 7 Taming theLLM Herd Effortless Multi-Model Integration with LangChain Source: Predicts 2024: AI’s Impact on the Employee Experience, Gartner
- 8. Evolution of LargeLanguage Models 8 Source: Guide to Large Language Models Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 9. Evolution of LargeLanguage Models 9 Source: Introducing the next generation of Claude. Taming the LLM Herd Effortless Multi-Model Integration with LangChain Due to their training datasets, different LLMs are performing better for some tasks than others.
- 10. Agenda ● Introduction ● LangChain ●RQle.ai LangChain extension ● TechType Rocket ● Conclusion 10 Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 11. 11 Taming the LLMHerd Effortless Multi-Model Integration with LangChain Source: Introduction to LangChain LangChain is a framework for developing applications powered by LLMs. LangChain can be used for a wide variety of applications including: ● Document question answering ● Summarization ● Entity / Relation Extraction ● Conversational Interfaces ● Code Analysis
- 12. 12 Taming the LLMHerd Effortless Multi-Model Integration with LangChain Source: Introduction to LangChain
- 13. 13 Taming the LLMHerd Effortless Multi-Model Integration with LangChain Source: LangChain LLM Integration
- 14. 14 Taming the LLMHerd Effortless Multi-Model Integration with LangChain Source: LangChain LLM Integration
- 15. Agenda ● Introduction ● LangChain ●RQle.ai LangChain extension ● TechType Rocket ● Conclusion 15 Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 16. RQle.ai LangChain Extension ExtendLangChain to facilitate integration with different LLM providers: ● AWS Bedrock ● Azure OpenAI ● Google AI ● Oracle Cloud Infrastructure (OCI) Generative AI ● ollama (local deployment) Leverages llm-guard library to provide guardrails on input/output 16 Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 17. RQle.ai LangChain Extension 17 Tamingthe LLM Herd Effortless Multi-Model Integration with LangChain
- 18. RQle.ai LangChain Extension 18 Tamingthe LLM Herd Effortless Multi-Model Integration with LangChain
- 19. RQle.ai LangChain Extension- Adapters 19 Taming the LLM Herd Effortless Multi-Model Integration with LangChain ⚠Note This is mostly caused by the fact that no chat interface have yet been created for this LLM provider in LangChain.
- 20. Agenda ● Introduction ● LangChain ●RQle.ai LangChain extension ● TechType Rocket ● Conclusion 20 Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 21. TechType Rocket Struggling tobreak into the tech blogging world? With TechType Rocket, you'll be ready to: ● Publish high-quality tech blogs that resonate with your target audience. ● Establish yourself as a credible voice in the tech community. ● Build a loyal following eager to consume your insightful content. 21 Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 22. TechType Rocket 22 Taming theLLM Herd Effortless Multi-Model Integration with LangChain
- 23. Agenda ● Introduction ● LangChain ●RQle.ai LangChain extension ● TechType Rocket ● Conclusion 23 Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 24. Conclusion ● Streamlined integrationfor effortless use of various LLM providers by extending LangChain ● Quickly test different LLMs to check which one performs better ● TechType Rocket to generate blogs 24 Taming the LLM Herd Effortless Multi-Model Integration with LangChain
- 25.
- 26. 26 Taming the LLMHerd Effortless Multi-Model Integration with LangChain Contacts Email: Quentin.H.Reul@gmail.com LinkedIn: https://www.linkedin.com/in/quentinreul/ GitHub: https://github.com/RQledotai/rqle-ai-langchain-util
- 27. 27 Taming the LLMHerd Effortless Multi-Model Integration with LangChain Greater Chicago AI Community