Gemini Nano Prompt API Demo

A starting point for a client-side, LLM in the browser, for online and offline Javascript use.

NOT YET FOR MOBILE, DO NOT TRY YET ON MOBILE!

By Jeremy Ellis uses at your own risk
Github for these gitpages at https://github.com/hpssjellis/my-examples-of-web-llm
Main Demo index at https://hpssjellis.github.io/my-examples-of-web-llm/public/index.html

This page demonstrates the core features of the Gemini Nano Prompt API (`LanguageModel` API) available in Chrome 138+. Ensure you have enabled the necessary flags. Copy the link below and paste it into your Chrome address bar: Copy - tab
Then search for "optimization-guide-on-device-model" and then search for "gemini-nano"

• #optimization-guide-on-device-model (set to Enabled BypassPrefRequirement)
• #prompt-api-for-gemini-nano (set to Enabled)
• #prompt-api-for-gemini-nano-multimodal-input(set to Enabled)
• #summarization-api-for-gemini-nano(set to Enabled)
• #writer-api-for-gemini-nano(set to Enabled)
• #rewriter-api-for-gemini-nano(set to Enabled)

The Gemini Nano model will download the first time you use it. That will be about 4.0 GB of download and will need about 20 GB saving space for the final folders.

Output:

No output yet. Click a button to begin.