概述
A simple app that searches for all large language models deployed locally to the machine, by a range of well-known model service providers, and gathers some basic information about them, including type attributes, size and usage characteristics. Also includes a prompt playground for experimenting with ONNX Generative AI model prompts.
特性
Model providers: install status, and links
Local models: LLMs discovered locally, including metadata
Runtime: LLMs currently loaded in memory, and perf characteristics
API code-gen: generate C#, Javascript, Python, Rust for common commands
System: Local system and ONNX runtime info
Prompt playgound: experiment with ONNX Generative AI prompts & models
此版本中的新增功能
v1.2603.6
Updated NPU perf-counter logic.
v1.2603.5
Added a simple model metadata visualizer.
v1.2603.3
Improved extraction of DPAIS model metadata.
v1.2602.25
Added support for Dell Pro AI Studio.
v1.2602.23
Updated Foundry Local SDK codegen to latest Microsoft.AI.Foundry.Local APIs.
系统要求
适用平台：电脑
操作系统：Windows 10 版本 19041.0 或更高版本
来自商店的评价 (0)