Tuesday, November 4, 2025
Qwen3-VL Accuracy Differences on Ollama vs MLX
I run couple of tests with structured data extraction using newest Qwen3-VL model on Mac Mini M4 Pro with 64GB. I discovered the same Qwen3-VL model with the same level of quantantization performs differently on Ollama vs. MLX. It seems model conversion step is crucial and we must evaluate model performance on different platforms before going to production.
Tuesday, October 21, 2025
Qwen3-VL New Models Comparison and Performance on Mac Mini M4
I run and compare newest Qwen3-VL models in Sparrow. Qwen3-VL models run fast and provide good accuracy.
Friday, October 10, 2025
Ollama Support in Sparrow and Update to Latest MLX
I explain whats new in Sparrow and what was updated in the recent version.
Tuesday, September 16, 2025
Ollama vs MLX Inference Speed on Mac Mini M4 Pro 64GB
MLX runs faster on first inference, but thanks to model caching or other optimizations by Ollama, second and next inference runs faster on Ollama.
Labels:
Sparrow,
Structured Data,
vLLM
Wednesday, September 10, 2025
Advanced Structured Data Processing in Sparrow
I added instruction and validation functionality into Sparrow. This allows to process business logic with document data directly through Sparrow query. For example, it allows to check if given fields are present in the document.
Labels:
Python,
Structured Data,
vLLM
Monday, September 1, 2025
My Experience with PyCharm AI Assistant
Explaining my experience with PyCharm AI Assistant. Showing example how code changes can be reviewed one by one, before they are accepted into your codebase.
Wednesday, August 27, 2025
Financial Table Structure Analysis with Computer Vision
Explaining new functionality I'm implementing in Sparrow to pre-process tables with grid structure. This greatly improves table data extraction by Vision LLMs.
Labels:
Computer Vision,
Python,
Structured Data
Subscribe to:
Posts (Atom)