New Open OnDemand Multitenant Apps for LLM classes

Today, we are announcing a new category of Open OnDemand apps involving LLMs that we hope will be useful for teachers and researchers. Multitenant Apps allow a teacher to start an Ollama server using a GPU on a node. Students can then easily connect to that LLM using a special Jupyter Notebook app, Multitenant Jupyter. This will allow an entire class to use the same LLM using just one GPU instead of requiring a GPU per student.

The Multitenant Ollama app can be thought of as a server program and Multitenant Jupyter as a client program. This is a new capability and we invite user feedback, questions, or requests for a demonstration at [email protected].