# Local

- Kind: `class`
- Package: [Aspire.Hosting.Foundry](/reference/api/csharp/aspire.hosting.foundry.md)
- Version: `13.3.0-preview.1.26254.5`
- Namespace: `Aspire.Hosting.Foundry`
- Target framework: `net8.0`
- Source: [GitHub](https://github.com/microsoft/aspire/blob/5bd693ae1897dee5e2ce71c2cc08879c1c7eff51/src/Aspire.Hosting.Foundry/FoundryModel.cs)

Models available on Foundry Local.

## Definition

```csharp
namespace Aspire.Hosting.Foundry;

public static class Local
{
    // ...
}
```

## Fields

- [DeepseekR114b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#deepseekr114b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of DeepSeek-R1-Distill-Qwen-14B to enable local inference on Intel GPUs. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-14B for local inference on Intel GPUs. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [DeepSeek-R1-Distill-Qwen-14B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B) for details.
- [DeepseekR115b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#deepseekr115b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of DeepSeek-R1-Distill-Qwen-1.5B to enable local inference on Intel GPUs. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-1.5B for local inference on Intel GPUs. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) for details.
- [DeepseekR17b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#deepseekr17b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of DeepSeek-R1-Distill-Qwen-7B to enable local inference on Intel GPUs. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-7B for local inference on Intel GPUs. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B) for details.
- [GptOss20b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#gptoss20b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of gpt-oss-20b to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: Apache-2.0 - License Description: Use of this model is subject to the terms of the Apache License, Version 2.0, available at [http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0). - Model Description: This is a conversion of the gpt-oss-20b model for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Azure AI Foundry model [gpt-oss-20b](https://ai.azure.com/catalog/models/gpt-oss-20b) for details.
- [Mistral7bV02](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#mistral7bv02) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Mistral-7B-Instruct-v0.2 to enable local inference on Intel GPUs. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Mistral-7B-Instruct-v0.2 for local inference on Intel GPUs. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) for details.
- [NemotronSpeechStreamingEn06b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#nemotronspeechstreamingen06b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of nemotron-speech-streaming-en-0.6b to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is an optimized version of the nemotron-speech-streaming-en-0.6b model for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [nemotron-speech-streaming-en-0.6b](https://huggingface.co/nvidia/nemotron-speech-streaming-en-0.6b) for details.
- [Phi35Mini](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#phi35mini) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Phi-3.5-mini-instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the Phi-3.5-mini-instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) for details.
- [Phi3Mini128k](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#phi3mini128k) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Phi-3-Mini-128K-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the Phi-3-Mini-128K-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Phi-3-Mini-128K-Instruct](https://huggingface.co/microsoft/Phi-3-Mini-128K-Instruct) for details.
- [Phi3Mini4k](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#phi3mini4k) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Phi-3-Mini-4K-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the Phi-3-Mini-4K-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Phi-3-Mini-4K-Instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) for details.
- [Phi4](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#phi4) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Phi-4 to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the Phi-4 for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Phi-4](https://huggingface.co/microsoft/Phi-4) for details.
- [Phi4Mini](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#phi4mini) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Phi-4-mini-instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the Phi-4-mini-instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Phi-4-mini-instruct](https://huggingface.co/microsoft/Phi-4-mini-instruct) for details.
- [Phi4MiniReasoning](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#phi4minireasoning) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Phi-4-mini-reasoning to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: MIT - Model Description: This is a conversion of the Phi-4-mini-reasoning for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Phi-4-mini-reasoning](https://huggingface.co/microsoft/Phi-4-mini-reasoning) for details.
- [Qwen2505b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen2505b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen2.5-0.5B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen2.5-0.5B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) for details.
- [Qwen2514b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen2514b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen2.5-14B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen2.5-14B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct) for details.
- [Qwen2515b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen2515b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen2.5-1.5B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen2.5-1.5B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) for details.
- [Qwen2515bInstructTestVitisNpu](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen2515binstructtestvitisnpu) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` `obsolete` -- Qwen 2.5 1.5B Instruct model for AMD NPUs (test variant).
- [Qwen257b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen257b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen2.5-7B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen2.5-7B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) for details.
- [Qwen25Coder05b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen25coder05b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen2.5-Coder-0.5B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen2.5-Coder-0.5B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen2.5-Coder-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-0.5B-Instruct) for details.
- [Qwen25Coder14b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen25coder14b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen2.5-Coder-14B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen2.5-Coder-14B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen2.5-Coder-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct) for details.
- [Qwen25Coder15b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen25coder15b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen2.5-Coder-1.5B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen2.5-Coder-1.5B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen2.5-Coder-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct) for details.
- [Qwen25Coder7b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen25coder7b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen2.5-Coder-7B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen2.5-Coder-7B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen2.5-Coder-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct) for details.
- [Qwen306b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen306b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3-0.6B to enable local inference. This model uses KLD Gradient quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3-0.6B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B) for details.
- [Qwen314b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen314b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3-14B to enable local inference. This model uses GPTQ quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3-14B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3-14B](https://huggingface.co/Qwen/Qwen3-14B) for details.
- [Qwen317b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen317b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3-1.7B to enable local inference. This model uses KLD Gradient quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3-1.7B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3-1.7B](https://huggingface.co/Qwen/Qwen3-1.7B) for details.
- [Qwen34b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen34b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3-4B to enable local inference. This model uses KLD Gradient quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3-4B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3-4B](https://huggingface.co/Qwen/Qwen3-4B) for details.
- [Qwen3508b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen3508b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3.5-0.8B to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3.5-0.8B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B) for details.
- [Qwen352b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen352b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3.5-2B to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3.5-2B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3.5-2B](https://huggingface.co/Qwen/Qwen3.5-2B) for details.
- [Qwen354b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen354b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3.5-4B to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3.5-4B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3.5-4B](https://huggingface.co/Qwen/Qwen3.5-4B) for details.
- [Qwen359b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen359b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3.5-9B to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3.5-9B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B) for details.
- [Qwen38b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen38b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3-8B to enable local inference. This model uses KLD Gradient quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3-8B for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) for details.
- [Qwen3Embedding06b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen3embedding06b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- Qwen3 Embedding 0.6B Cuda Gpu This is the GPU (NVIDIA CUDA)-optimized variant of qwen3-embedding-0.6b, a text embedding model from the Qwen3 family developed by Alibaba Cloud and optimized by Microsoft. Model Details - Model Type: Text Embedding (ONNX) - Parameters: 0.6 billion - Context Length: 32K tokens - Embedding Dimension: Up to 1024 - Quantization: KLD Gradient quantization - Target Device: GPU (NVIDIA CUDA) - Execution Provider: CUDAExecutionProvider - Supported Languages: 100+ Intended Use This model is optimized for local execution on devices with GPU (NVIDIA CUDA) hardware acceleration using Foundry Local. Capabilities - Text retrieval and semantic search - Code retrieval - Text classification and clustering - Bitext mining - Multilingual and cross-lingual retrieval License This model is licensed under Apache 2.0. See [license details](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B/blob/main/LICENSE). Source - HuggingFace: [Qwen3-Embedding-0.6B](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B)
- [Qwen3Embedding8b](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen3embedding8b) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- Qwen3 Embedding 8B Cuda Gpu This is the GPU (NVIDIA CUDA)-optimized variant of qwen3-embedding-8b, a text embedding model from the Qwen3 family developed by Alibaba Cloud and optimized by Microsoft. Model Details - Model Type: Text Embedding (ONNX) - Parameters: 8 billion - Context Length: 32K tokens - Embedding Dimension: Up to 4096 - Quantization: KLD Gradient quantization - Target Device: GPU (NVIDIA CUDA) - Execution Provider: CUDAExecutionProvider - Supported Languages: 100+ Intended Use This model is optimized for local execution on devices with GPU (NVIDIA CUDA) hardware acceleration using Foundry Local. Capabilities - Text retrieval and semantic search - Code retrieval - Text classification and clustering - Bitext mining - Multilingual and cross-lingual retrieval License This model is licensed under Apache 2.0. See [license details](https://huggingface.co/Qwen/Qwen3-Embedding-8B/blob/main/LICENSE). Source - HuggingFace: [Qwen3-Embedding-8B](https://huggingface.co/Qwen/Qwen3-Embedding-8B)
- [Qwen3Vl2bInstruct](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen3vl2binstruct) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3-VL-2B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3-VL-2B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3-VL-2B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct) for details.
- [Qwen3Vl4bInstruct](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen3vl4binstruct) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3-VL-4B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3-VL-4B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3-VL-4B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct) for details.
- [Qwen3Vl8bInstruct](/reference/api/csharp/aspire.hosting.foundry/local/fields.md#qwen3vl8binstruct) : [FoundryModel](/reference/api/csharp/aspire.hosting.foundry/foundrymodel.md) `static` -- This model is an optimized version of Qwen3-VL-8B-Instruct to enable local inference. This model uses RTN quantization. Model Description - Developed by: Microsoft - Model type: ONNX - License: apache-2.0 - Model Description: This is a conversion of the Qwen3-VL-8B-Instruct for local inference. - Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model. Base Model Information See Hugging Face model [Qwen3-VL-8B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct) for details.