Local AI use cases with Spring AI
Spring AI is a Java framework for calling AI models from Spring Boot apps. Its Ollama starter points an app at a local Ollama server through configuration alone.
Rebel BitesA 4B local model on a 4 GB laptop GPU as a PASS/FAIL test evaluator
Qwen3 4B Instruct in Ollama (Docker, WSL2) grades a Spring Boot app's root-cause answers against expected ones, returning a JSON verdict, with every speed and memory number measured on a 4 GB Quadro T1000.