1× RTX 30608 GB VRAM
Nosana network, hosts worldwide
Details
Stock and price checked 10 min ago.
Self-service: you start it yourself, with no order or sales contact.
nvidia-3060
Full price
€0.04
per hour, whole instance, 1 GPU
mesolitica
llama2-embedding-1b-8k
feature extraction416.4K downloadsHugging Face
Cheapest GPU in stock that fits
A single GPU with at least 2.1 GB for inference.
View offer
GPU memory it needs (estimate)
Rule of thumb from the model's size. Real needs depend on batch size, context length and framework.
Inference (full precision)
2.1 GB
Inference (8-bit)
1.1 GB
Inference (4-bit)
0.5 GB
LoRA fine-tuning
2.3 GB
QLoRA (8-bit base)
1.1 GB
Full fine-tuning
8.5 GB