yujunjun/autogen
1
0
Fork 0
mirror of https://github.com/microsoft/autogen.git synced 2025-11-11 07:14:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
autogen/dotnet/website/articles/Consume-LLM-server-from-LM-Studio.md
Griffin Bassman 850377c74a
fix: Various fixes and cleanups to dotnet autogen core (#5242) 
Co-authored-by: Jack Gerrits <jack@jackgerrits.com>
Co-authored-by: Ryan Sweet <rysweet@microsoft.com>
2025-01-28 17:13:36 -05:00

1.2 KiB
Raw Permalink Blame History

Consume LLM server from LM Studio

You can use @AutoGen.LMStudio.LMStudioAgent from AutoGen.LMStudio package to consume openai-like API from LMStudio local server.

What's LM Studio

LM Studio is an app that allows you to deploy and inference hundreds of thousands of open-source language model on your local machine. It provides an in-app chat ui plus an openai-like API to interact with the language model programmatically.

Installation

  • Install LM studio if you haven't done so. You can find the installation guide here
  • Add AutoGen.LMStudio to your project.
<ItemGroup>
    <PackageReference Include="AutoGen.LMStudio" Version="AUTOGEN_LMSTUDIO_VERSION" />
</ItemGroup>

Usage

The following code shows how to use LMStudioAgent to write a piece of C# code to calculate 100th of fibonacci. Before running the code, make sure you have local server from LM Studio running on localhost:1234.

[!code-csharp] [!code-csharp]