Documentation

Set up SharpMind anywhere.

The same Studio, the same model format, four places to run it. Start with the machine in front of you; add a GPU host when a fine-tune needs more memory. Every guide includes the errors you are likely to see and what they mean.

What works today

The support matrix.

This PC covers the Studio process and an optional Local Docker host on the same machine. A local NVIDIA GPU is used only when the GPU image and Docker runtime are present. A Compute host always brings its own device.

CapabilityThis PC / Local DockerCompute hostNotes
Chat with a packaged modelYesYesOne active model per process on a host.
OpenAI-style API—YesBearer token; /v1/chat/completions, models, files, training jobs.
Pretrain from scratchYes (CPU)Yes (CPU)The GPU engine refuses whole-weight training by design.
LoRA fine-tuneYes (GPU or CPU)Yes (GPU or CPU)GPU needs RMSNorm + RoPE/NoPE + gated FFN; otherwise the CPU retry runs.
SFT (assistant-only loss)Yes (GPU or CPU)Yes (GPU or CPU)Chat JSONL; the base supplies the tokenizer and template.
GPU inferenceWith a supported local GPUYes (GPU or CPU)Also covers LayerNorm and dense-GELU models.
Remote data and artifacts—YesUploads with progress; exports download back to Studio.
Version 1.1.0. The repository is the source of truth. The server image contract is stable; later releases may still adjust screens or flags.
FIVE-MINUTE PATH

Just want to see it run?

Build the app, pick a GGUF or .smm, and chat locally. No account and no host.

GPU PATH

Want a real fine-tune?

Rent an A16, add one SSH key, and let the Compute card install and deploy the GPU image.