From the archive

LM Studio 0.3 adds local document chat and structured output

The desktop update brings document questions, automatic hardware settings, and a JSON-schema API to locally running models.

By Chat Overview Published Updated

LM Studio released version 0.3 with built-in document chat, a redesigned interface, and more developer tools for local language models. The app can run the model and process the supplied documents on the same computer.

Ask questions about a file

For a document that fits inside the model's context window, LM Studio adds the full text to the conversation. For larger files, it retrieves relevant passages instead. That makes the size of the document and the model's context capacity important to how a question is answered.

The update also configures model loading around the available CPU and graphics hardware, while retaining manual settings.

Local models for applications

The local server adds structured output using a JSON schema, useful when another program needs defined fields rather than free-form prose. A network-serving option lets other devices connect, extending the service beyond the local computer. The LM Studio profile covers model downloads, local chat, and its application endpoints.

Source