on a Browser

When hosting a LLM on browser, Fullmetal uses WebLLM which is a modular, customizable JavaScript package that directly brings language model chats directly onto web browsers with hardware acceleration. You will see the Host LLM page after logging in or creating an account on the Fullmetal App and having your account activated

Steps to create an WEB-LLM agent

  • Select a model from dropdown

  • Click on Load button to load the model and create and agent on fullmetal.

  • The browser will begin loading the model into its cache when you choose it and click the "load" button. Eventually, an agent with the chosen model will be formed on Fullmetal and associated with your account.

  • After the model has fully loaded, you can see that an agent has been generated for your account and it can be seen on Agents page

Last updated