On a Browser
When deploying a LLM on browser, Fullmetal uses WebLLM which is a modular, customizable JavaScript package that directly brings language model chats directly onto web browsers with hardware acceleration. You will see the Deploy a LLM page after log in or creating an account on the Fullmetal App and having your account activated

Steps to create an WEB-LLM agent
Select a model from dropdown

Click on Deploy Node button to load the model and create a node on fullmetal.

The browser will begin loading the model into its cache when you choose it and click the "load" button. Eventually, a node with the chosen model will be formed on Fullmetal and associated with your account.

After the model has fully loaded, you can see that a node has been generated for your account

Last updated