SpudInference

SpudInference is a Local LLM Tool Menu that allows creating .gguf files, training datasets, and LoRA Adaptes using those datasets. The main goal is to attain GPU-competitive speeds on low-end CPUs.

---

Installation & Quickstart

# ~ Clone the repo and enter the directory. ~ #
git clone https://github.com/SpudWorks-Labs/SpudInference
cd SpudInference

# ~ Create a virtual environment and install dependencies. ~ #
python -m venv .name_of_env
source .name_of_env/bin/activate
pip install -r requirements.txt

# ~ Execute the program. ~ #
python src/main.py

---

Important Acknowledgements

Developed at SpudWorks Labs using collaborative "Human-in-the-Loop" AI workflow.