Using GitHub Models in LobeChat

GitHub Models is a new feature recently launched by GitHub, designed to provide developers with a free platform to access and experiment with various AI models. GitHub Models offers an interactive sandbox environment where users can test different model parameters and prompts, and observe the responses of the models. The platform supports advanced language models, including OpenAI's GPT-4o, Meta's Llama 3.1, and Mistral's Large 2, covering a wide range of applications from large-scale language models to task-specific models.

This article will guide you on how to use GitHub Models in LobeChat.

Rate Limits for GitHub Models

Currently, the usage of the Playground and free API is subject to limits on the number of requests per minute, the number of requests per day, the number of tokens per request, and the number of concurrent requests. If you hit the rate limit, you will need to wait for the limit to reset before making further requests. The rate limits vary for different models (low, high, and embedding models). For model type information, please refer to the GitHub Marketplace.

Configuration Guide for GitHub Models

Step 1: Obtain a GitHub Access Token

• Log in to GitHub and open the Access Tokens page.
• Create and configure a new access token.

• Copy and save the generated token from the results returned.

• During the testing phase of GitHub Models, users must apply to join the waitlist in order to gain access.

• Please store the access token securely, as it will only be displayed once. If you accidentally lose it, you will need to create a new token.

Step 2: Configure GitHub Models in LobeChat

• Navigate to the Settings interface in LobeChat.
• Under Language Models, find the GitHub settings.

• Enter the access token you obtained.
• Select a GitHub model for your AI assistant to start the conversation.

You are now ready to use the models provided by GitHub for conversations within LobeChat.