#llm #mlx #huggingface

TL;DR: Create a directory to hold Hugging Face data and set the environment variable HF_HOME to that directory's path.

For example:

mkdir /Volumes/externaldrive/huggingface
export HF_HOME='/Volumes/externaldrive/huggingface' 

You'll also want to set it in your .profile or .bashrc or wherever you set these things.

#python #llm #embeddings #release #simonwillison

I just released version 0.1 of a plugin for Simon Willison's llm called llm-questioncache. It lets you send questions to your default LLM with a system prompt that elicits short, to-the-point answers. It also maintains a cache of answers locally so that you only have to hit the LLM once for each bit of esoteric knowledge.