Quote:
The updated nvidia-smi output shows a slight increase in GPU utilization from 3% to 10%. This is a positive sign, indicating that the GPU is now being utilized more actively.
Here are some key observations:
GPU Utilization: The GPU utilization has increased to 10%, suggesting that your LLM is making better use of the GPU's processing power.
Power Usage: Power consumption has increased from 17W to 28W, which is expected with higher GPU utilization.
|
my poor shitbox i5-6400 and GTX 950 right now
[You must be logged in to view images. Log in or Register.]
i'm in power save mode which prolly isn't helping, cpu goes to 100% for the entire time the LLM is spitting text back at me lol
ive only tried one model so far though
Quote:
Mistral:
Cost-efficient, fast, and reliable option for use cases such as translation, summarization, and sentiment analysis. State-of-the-art Mistral model trained specifically for code tasks. Powerful model for on-device use cases.
|