[Guides]5 min read

Running a Topo node on a single 4090

You do not need a data center to serve inference. What a consumer GPU can run, how to stake and register a node, and what to expect in your first week.

Priya RamanHead of Developer Experience

The network was built so that a single consumer card can do useful work. A 24 GB RTX 4090 serves quantized open models up to roughly 32B parameters, plus embedding and image models, and the router only sends it traffic it can serve well.

What you need

  • An RTX 4090 with 24 GB of VRAM, on Linux with current NVIDIA drivers.
  • A stable connection with at least 100 Mbps upload and one open port.
  • A wallet on Base or Solana holding the minimum TOPO stake.
  • About 30 minutes for setup and the first verification round.

Register and serve

terminal
bash
curl -fsSL https://get.topolabs.ai | shtopo node init --gpu rtx-4090 --region eu-centraltopo node stake --amount 500 --wallet 0x8f3a…c21etopo node start

After the first round of sampled checks the node starts receiving live requests. Earnings accrue per token served and pay out daily in USDT. Keep the node online and its verification record clean, and the router sends it more traffic over time.