Queries and chats may also embrace uploaded photos with the photos
argument.
ollamar
The ollamar package deal begins up equally, with a test_connection()
perform to test that R can connect with a operating Ollama server, and pull("the_model_name")
to obtain the mannequin similar to pull("gemma3:4b") or pull("gemma3:12b")
.
The generate()
perform generates one completion from an LLM and returns an httr2_response
, which may then be processed by the resp_process()
perform.
library(ollamar) resp
Or, you possibly can request a textual content response immediately with a syntax similar to resp ). There's an choice to stream the textual content with
stream = TRUE
:
resp
ollamar has different performance, together with producing textual content embeddings, defining and calling instruments, and requesting formatted JSON output. See particulars on GitHub.
rollama was created by Johannes B. Gruber; ollamar by by Hause Lin.
Roll your personal
If all you need is a primary chatbot interface for Ollama, one simple choice is combining ellmer, shiny, and the shinychat package deal to make a easy Shiny app. As soon as these are put in, assuming you even have Ollama put in and operating, you possibly can run a primary script like this one:
library(shiny) library(shinychat) ui
That ought to open an especially primary chat interface with a mannequin hardcoded. For those who don’t decide a mannequin, the app gained’t run. You’ll get an error message with the instruction to specify a mannequin together with these you’ve already put in regionally.
I’ve constructed a barely extra strong model of this, together with dropdown mannequin choice and a button to obtain the chat. You possibly can see that code right here.
Conclusion
There are a rising variety of choices for utilizing giant language fashions with R, whether or not you wish to add performance to your scripts and apps, get assist together with your code, or run LLMs regionally with ollama. It’s value attempting a few choices to your use case to search out one that most closely fits each your wants and preferences.