Monday, February 26, 2024

LLM Agents with Sparrow

›
I explain new functionality in Sparrow - LLM agents support. This means you can implement independently running agents, and invoke them from...
Tuesday, February 20, 2024

Extracting Invoice Structured Output with Haystack and Ollama Local LLM

›
I implemented Sparrow agent with Haystack structured output functionality to extract invoice data. This runs locally through Ollama, using L...
Sunday, February 4, 2024

Local LLM RAG Pipelines with Sparrow Plugins [Python Interface]

›
There are many tools and frameworks around LLM, evolving and improving daily. I added plugin support in Sparrow to run different pipelines t...
Monday, January 29, 2024

LLM Structured Output with Local Haystack RAG and Ollama

›
Haystack 2.0 provides functionality to process LLM output and ensure proper JSON structure, based on predefined Pydantic class. I show how y...
Tuesday, January 23, 2024

JSON Output with Notus Local LLM [LlamaIndex, Ollama, Weaviate]

›
In this video, I show how to get JSON output from Notus LLM running locally with Ollama. JSON output is generated with LlamaIndex using the ...
Monday, January 15, 2024

FastAPI and LlamaIndex RAG: Creating Efficient APIs

›
FastAPI works great with LlamaIndex RAG. In this video, I show how to build a POST endpoint to execute inference requests for LlamaIndex. RA...
Monday, January 8, 2024

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic

›
This is Sparrow, our open-source solution for document processing with local LLMs. I'm running local Starling LLM with Ollama. I explain...