1× RTX 309024 GB VRAM
Nosana network, hosts worldwide
Details
Stock and price checked 10 min ago.
Self-service: you start it yourself, with no order or sales contact.
nvidia-3090
Full price
€0.17
per hour, whole instance, 1 GPU
Qwen
Qwen2.5-Coder-7B-Instruct
text generationapache-2.01.3M downloadsHugging Face
Cheapest GPU in stock that fits
A single GPU with at least 17 GB for inference.
View offer
GPU memory it needs (estimate)
Rule of thumb from the model's size. Real needs depend on batch size, context length and framework.
Inference (full precision)
17 GB
Inference (8-bit)
8.5 GB
Inference (4-bit)
4.3 GB
LoRA fine-tuning
18 GB
QLoRA (8-bit base)
9.2 GB
Full fine-tuning
68 GB