# Rough Experiments with Llamafile and LLaVA 1.5

DevFeed: [Rough Experiments with Llamafile and LLaVA 1.5](<https://devfeed.tech/articles/rough-experiments-with-llamafile-and-llava-1-5-52820.md>)

Original publisher: [Read original article](<https://mtlynch.io/notes/llamafile-lava1.5/>)

Author: Michael Lynch

Published: 2023-12-02T00:00:00Z

Content type: opinion

Language: en

Sources: [Mtlynch](<https://devfeed.tech/sources/mtlynch-io.md>)

Topics: [llamafile](<https://devfeed.tech/topics/llamafile.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Server](<https://devfeed.tech/topics/server.md>), [JSON](<https://devfeed.tech/topics/json.md>), [ssh](<https://devfeed.tech/topics/ssh.md>), [Debian](<https://devfeed.tech/topics/debian.md>), [browser](<https://devfeed.tech/topics/browser.md>)

Tags: [chatbots](<https://devfeed.tech/tags/chatbots.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [json](<https://devfeed.tech/tags/json.md>), [llamafile](<https://devfeed.tech/tags/llamafile.md>), [llms](<https://devfeed.tech/tags/llms.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [server](<https://devfeed.tech/tags/server.md>), [ssh](<https://devfeed.tech/tags/ssh.md>), [vm](<https://devfeed.tech/tags/vm.md>)

## AI overview

An experiment using Llamafile and LLaVA 1.5 to extract information from live comedy posters. The author runs the model on a CPU-based Debian VM, accesses its web interface over SSH port forwarding, and finds that image recognition is slow, sometimes inaccurate, and unreliable at producing JSON.

## Source excerpt

I read Simon Willison's post about using Llamafile to experiment with open-source chatbots / LLMs. He made it sound so easy, so I decided to try it out. One of my longtime hobby projects is WanderJest, a site for finding live comedy. One of the challenges of that site is that the canonical information about an upcoming show is often the poster for it. Here's an example: I've been scraping this information by hand, but that's tedious and time-consuming.