FULLMETAL
  • Introduction
  • 💰$BNTY Support
  • Getting an API Key
  • Managing Agents in Fullmetal
  • Installation Guides
    • Setting up an Node (Deploy a Node)
      • On a Browser
      • on a VM (node.js)
      • Serving Public Prompts
  • Examples
    • Fullmetal Chat Example
  • API Docs
    • Response on prompt
  • Contributions
    • Code of Conduct
Powered by GitBook
On this page
  1. Installation Guides

Setting up an Node (Deploy a Node)

A Node is a machine that hosts LLM and responds to the prompts it receives.

The node typically high-end computers with at least 8GB RAM/VRAM to run inference at a reasonable speed (>10 tokens per second).

Currently, there are two ways to host a Node

  • Browser Hosted (Recommended)

  • VM Hosted (Node.js)

PreviousManaging Agents in FullmetalNextOn a Browser

Last updated 2 months ago