LLMs and refusals

Posted by Dave Aitel via Dailydave on Jul 24[image: image.png]
Above: LLAMA3.1 8B-4Q test results via OLLAMA

So recently I’ve been doing a lot of work with LLMs handling arbitrary
unstructured data, and using them to generate structured data, which then
gets put into a graph database for graph algorithms to iterate on so you
can actually distill knowledge from a mass of nonsense.

But obviously this can get expensive via APIs, so like many of you, I set
up a server with a A6000 that…Daily DaveRead More