Prerequisites
Before submitting your question, please ensure the following:
Question Details
Powerinfer's server-side babble has occurred
My configuration is as follows
The commands I run are as follows
./build/bin/server -m /PowerInfer/path/ReluLLaMA-7B.powerinfer.gguf
Can someone explain to me why, or is that why the server side is not written right
Additional Context
It is worth noting that my reasoning works fine when running locally, but there is some gibberish on the server.
The commands I run on the command line are as follows
./build/bin/main -m /home/yswang/AI_LLM/PowerInfer/models/GGUF/ReluLLaMA-7B.powerinfer.gguf -n 128 -t 8 -p "Once upon a time"
Prerequisites
Before submitting your question, please ensure the following:
Question Details
Powerinfer's server-side babble has occurred
My configuration is as follows
The commands I run are as follows
Can someone explain to me why, or is that why the server side is not written right
Additional Context
It is worth noting that my reasoning works fine when running locally, but there is some gibberish on the server.
The commands I run on the command line are as follows
./build/bin/main -m /home/yswang/AI_LLM/PowerInfer/models/GGUF/ReluLLaMA-7B.powerinfer.gguf -n 128 -t 8 -p "Once upon a time"