LLamaSharp - .NET Binding for llama.cpp

https://github.com/SciSharp/LLamaSharp

 

The C#/.NET binding of llama.cpp. It provides APIs to inference the LLaMa Models and deploy it on local environment. It works on both Windows, Linux and MAC without requirment for compiling llama.cpp yourself. Its performance is close to llama.cpp.

Furthermore, it provides integrations with other projects such as BotSharp to provide higher-level applications and UI.

Documentation

• Quick start
• Tricks for FAQ
• Full documentation
• API reference
• Examples