On a Browser
Last updated
Last updated
When deploying a LLM on browser, Fullmetal uses WebLLM which is a modular, customizable JavaScript package that directly brings language model chats directly onto web browsers with hardware acceleration. You will see the Deploy a LLM page after log in or creating an account on the Fullmetal App and having your account activated
Steps to create an WEB-LLM agent
Select a model from dropdown
Click on Deploy Node button to load the model and create a node on fullmetal.
The browser will begin loading the model into its cache when you choose it and click the "load" button. Eventually, a node with the chosen model will be formed on Fullmetal and associated with your account.
After the model has fully loaded, you can see that a node has been generated for your account and it can be seen on Connected Nodes page