Monday, January 29, 2024

LLM Structured Output with Local Haystack RAG and Ollama

›
Haystack 2.0 provides functionality to process LLM output and ensure proper JSON structure, based on predefined Pydantic class. I show how y...
Tuesday, January 23, 2024

JSON Output with Notus Local LLM [LlamaIndex, Ollama, Weaviate]

›
In this video, I show how to get JSON output from Notus LLM running locally with Ollama. JSON output is generated with LlamaIndex using the ...
Monday, January 15, 2024

FastAPI and LlamaIndex RAG: Creating Efficient APIs

›
FastAPI works great with LlamaIndex RAG. In this video, I show how to build a POST endpoint to execute inference requests for LlamaIndex. RA...
Monday, January 8, 2024

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic

›
This is Sparrow, our open-source solution for document processing with local LLMs. I'm running local Starling LLM with Ollama. I explain...
Sunday, December 17, 2023

From Text to Vectors: Leveraging Weaviate for local RAG Implementation with LlamaIndex

›
Weaviate provides vector storage and plays an important part in RAG implementation. I'm using local embeddings from the Sentence Transfo...
Monday, December 11, 2023

Enhancing RAG: LlamaIndex and Ollama for On-Premise Data Extraction

›
LlamaIndex is an excellent choice for RAG implementation. It provides a perfect API to work with different data sources and extract data. Ll...
Tuesday, December 5, 2023

Secure and Private: On-Premise Invoice Processing with LangChain and Ollama RAG

›
The Ollama desktop tool helps run LLMs locally on your machine. This tutorial explains how I implemented a pipeline with LangChain and Ollam...