Ollama

Ollama is a lightweight framework for running LLMs locally. It provides a simple command-line interface to pull and run models like Llama 3 or Mistral.