I've walked through the nitty-gritty of leveraging Large Language Models (LLMs) for practical, business use cases. The combination of fine-tuning and RAG, supported by open-source models and frameworks like Langchain, ChromaDB, Ollama, and Streamlit, offers a robust solution to making LLMs work for you.
- Ensure poetry is installed for dependency management
- CD to application directory
- Run
poetry installto install all dependencies - Run
poetry run streamlit run .\langchain-rag-bot\app.py