gptstudio (development version)
gptstudio (development version)
UI updates
- The chat app has now a sidebar where users can see their conversation history, start new chats and change the settings. Because of this, the chat interface has more room for showing messages.
- All saved chats are created with a placeholder title that the user can edit later.
- We have a shorter welcome message, but we have added lots of tooltips to help with navigation.
Local models
We are happy to announce that we now support local models with ollama. By default we look for the ollama host in http://localhost:11434 but this can be customized by setting up the OLLAMA_HOST environmental variable. Be aware that you are in charge of maintaining your own ollama installation and models.
Perplexity Service
Perplexity AI now offers a wide range of models as part of their service. The current version includes the following models: sonar-small-chat, sonar-small-online, sonar-medium-chat, sonar-medium-online, codellama-70b-instruct, mistral-7b-instruct, mixtral-8x7b-instruct, pplx-7b-chat, pplx-70b-chat, pplx-7b-online, pplx-70b-online, llama-2-70b-chat, and codellama-34b-instruct. See Perplexity API documentation for more information on these models.
Cohere Service
Cohere is now available as another service. The current version includes the following models: command, command-light, command-nightly, and command-light-nightly. See Cohere’s docs for more on these models and capabilities.
Internal
- Reverted back to use an R6 class for OpenAI streaming (which now inherits from
SSEparser::SSEparser). This doesn’t affect how the users interact with the addins, but avoids a wider range of server errors. - Fixed a bug in retrieval of OpenAI models
- Fixed a bug in Azure OpenAI request formation.
- Fixed a bug in “in source” calls for addins.
- Fixed a bug that showed a “Connection refused” message in the viewer in unix platforms. Fix #179
- The chat addin no longer closes itself when an OpenAI api key is not detected.
- Converted from PALM to Google for Google AI Studio models.
- Updated Anthropic models with with their claude-3 update.
- More bug fixes with Azure OpenAI with request body structure and using token + api key.
- Any scrollbar now has 5px for width and height. This allows for more room when using the viewer panel.
- gptstudio now requires bslib v0.6.0 or greater, to take advantage of the sidebar styling.
- Updated anthropic API calls to use new messages endpoint.
- Fixed a bug in Anthropic chats to now include history.
Quality of Life Improvements and Documentation
- Chat in source now respects the model selection that you set using the Chat addin.
- A new function
gpstudio_sitrep()has been added to help with debugging and setup. - API checking is now done for each available service, including local models.
- New vignettes were added to setup each service.
gptstudio 0.3.1
- Better API checking to direct users to .Renviron to set API key to be persistent across sessions
gptstudio 0.3.0
Persistent Config File
We’ve introduced a configuration file that persists across sessions. Now, your preferred app settings will be loaded each time you launch the app, making it even more user-friendly.
Custom Prompt Selection
Further enhancing customization, we’ve added a “task” option that lets you choose the system prompt from options such as “coding”, “general”, “advanced developer”, and “custom”. The “custom” option allows you to replace the system prompt instructions entirely.
Expanded API Services
We’re excited to announce that our service now includes models from HuggingFace’s inference API, Anthropic’s claude models, and Google’s MakerSuite, and Azure OpenAI service broadening the range of AI solutions you can use.
S3 Class for API Services
In an effort to make future API additions easier, API calls now use S3 classes.
Real-time Streaming Updates
Inspired by Edgar Ruiz’s work on chattr, we’ve implemented real-time streaming without relying on R6, but this will receive more attention in the 0.4.0 release.
Model Selection Feature
The ChatGPT add-in now comes with an integrated model selection feature, enabling you to choose any chat completion model that matches either gpt-3.5 or gpt-4 in the model name.
Upgraded Add-ins
The add-ins for code commenting and spelling & grammar checking have been upgraded to use the chat/completions endpoint and now default to the gpt-3.5-turbo model. You can modify this default setting as needed.
Custom OpenAI Base Url
You now have the option to specify a different base url for the OpenAI API. A much-requested feature by our users, this addition helps in tailoring the API access to suit your needs.
Bug Fixes
We’ve addressed several issues in this update. Now, the “Spelling and Grammar” and “Comment your code” add-ins can successfully insert text in source. Also, installation issues related to the {stringr} package and compatibility with earlier versions of R have been resolved.
Improved Compatibility Checks
To ensure optimal user experience, we’re now using GitHub Actions to check compatibility with a wider range of R versions on Ubuntu.
We hope you enjoy the enhanced features and improved performance in this latest version. As always, your feedback is invaluable to us, so please keep it coming!
Translations
The ChatGPT addin can now speak German! Thanks to Mark Colley #107
gptstudio 0.2.0
Translations
The ChatGPT addin can now receive translations. If anyone wants to contribute with a new translation only needs to edit the translation file (“inst/translations/translation.json”). Currently supported languages are English and Spanish.
{httr2}
The requests are now handled with httr2 functions. This provides a more intuitive way to extend the functionality of the package, meaning that new request parameters to any endpoint are one pipe away from being implemented.
Stream chat completions
Instead of waiting for the full response to be received before showing it to the user, the chat app now streams the response generation in real time. This makes for shorter wait times and removes the need to use waiter.
Bug fixes
- The welcome message is no longer consumed by the chat history.
- Errors in requests now point to the OpenAI documentation.
- In the chat app, removed unnecessary whitespace in the first line of code chunks.
- In the chat app, the Enter key can now be used to send the user instruction as an alternative to clicking the “Send” button.
- In the chat app, the copy button is now added via JS instead of a previous fragile R implementation. (by @idavydov)
New look of the message history
Each individual message is now rounded and has an icon indicating whether it comes from the user or from the assistant. Each role has a different horizontal alignment and a slightly different background color.
Simplified user inputs
The prompt and buttons have been simplified to give the chat more room to expand.
Now the app has a settings button where the user can still choose its skill level and preferred style.
Welcome message with instructions
When the app starts (or history is cleared) the assistant greets the user with a random welcome message and instructions on how to use the app.
The chat can be adjusted vertically, horizontally and is scrollable
Limited to 800px width. The prompt input is always fixed to the bottom of the app.
The chat inherits the current rstudio theme
This makes it look more integrated with the IDE, giving the feel of what an extension does in VScode.