Qwen2-VL Performance Boost

I share performance-boosting tips based on my experience using Qwen2-VL in production. 

 

Sparrow Parse Vision LLM FastAPI Endpoint

Sparrow provides an API for accessing the Sparrow Parse agent, allowing you to run document extraction workflows directly from your existing systems. It helps simplify how data is pulled from documents and integrated into your workflows. 

 

Sparrow Parse Invoice Query with Vision LLM

New Sparrow Agent - Sparrow Parse, works with Qwen2 Vision LLM. 

What it does: 

1. Accepts query with JSON schema, this helps to solve few things at once - provides JSON structure for LLM to generate response, and hints LLM what types to use for each response element 

2. Runs inference on your GPU of choice, either cloud or local GPU 

3. Validates JSON response, based on query schema