Andrej Baranovskij Blog

I show you how to keep your vLLM model loaded in FastAPI cache for much faster inference — without reloading it on every request.   

FastAPI Endpoint for Sparrow LLM Agent. I show how FastAPI endpoint is used in Sparrow to run LLM agent functionality from API client.   

I explain how to handle file upload with FastAPI and how to process the file by using Python temporary directory. Files placed into temporar...

FastAPI works great with LlamaIndex RAG. In this video, I show how to build a POST endpoint to execute inference requests for LlamaIndex. RA...

With ngrok you can host your FastAPI app from your computer. This can be a handy and cheaper option for some projects. In this video, I expl...

This tutorial explains how to integrate FastAPI backend with ChatGPT plugin implemented in Python. Backend stores data from ChatGPT in Mongo...

I show how to initialize a connection to MongoDB from FastAPI endpoint with a startup event. Before pushing it to MongoDB collection, new re...

PaddleOCR is a great tool to extract text data from docs, and it can group related words into a sentence. Such functionality can simplify ex...

FastAPI runs background tasks in a parallel thread, which prevents blocking app endpoints when a long task executes. I explain it in this vi...

To serve multiple concurrent users accessing FastAPI endpoint running Hugging Face API, you must start the FastAPI app with several workers....

Are you facing challenges with the time it takes to load large ML models in your backend API? This video presents a practical solution: util...

In this video, I demonstrate how to deploy a FastAPI backend API to Hugging Face Spaces using Docker. I cover creating a Dockerfile, setting...

Learn how to create a structured API using FastAPI. In this tutorial, we explore the benefits of FastAPI, its powerful code structuring capa...

I share a few tips and tricks on how to build a clean and readable REST API for larger apps with FastAPI framework. You will learn how to sp...

This video shows how to scale FastAPI REST endpoint running on Kubernetes Pod.  

Build It Yourself. In this video, I explain how you can build workflow running with FastAPI REST generic endpoints. The best thing about it,...

The goal of this video is to explain Skipper from MLOps user perspective, different blocks of Skipper and how they fit together. I show how ...

A simple tutorial about a complex thing - how to expose FastAPI app to the world on Kubernets with NGINX Ingress Controller. I explain the s...

This is a quick tutorial to show how to route traffic between Kubernetes Pods. Both Pods are running FastAPI endpoints. I show how to create...

Step-by-step tutorial where I explain and show how to run FastAPI app on Kubernetes Pod. I keep it simple. I explain when it makes sense to ...