如何在你的电脑本地部署“GPT-4” | Vicuna
作者:FancyPig | 发布时间: | 更新时间:
相关阅读
data-postsbox="{"id":34873,"title":"基于GPT-4可以完全自主完成任务? | AutoGPT | AGI开启新篇章","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/04/20230406035345488.jpg","cover_video":"https://v.pigsec.cn/AUTO-GPT-%20Autonomous%20GPT-4%21%20Mini%20AGI%20is%20HERE%21_ts.m3u8","views":4185,"comment_count":3,"category":"knowledge","is_forum_post":false}">{"id":34873,"title":"基于GPT-4可以完全自主完成任务? | AutoGPT | AGI开启新篇章","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/04/20230406035345488.jpg","cover_video":"https://v.pigsec.cn/AUTO-GPT-%20Autonomous%20GPT-4%21%20Mini%20AGI%20is%20HERE%21_ts.m3u8","views":4185,"comment_count":3,"category":"knowledge","is_forum_post":false}
data-postsbox="{"id":34638,"title":"最新开源语言模型 Vicuna | 媲美GPT-4 | 支持本地化私有部署","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/04/20230401081952354.png","cover_video":"https://v.pigsec.cn/Is%20Vicuna%20the%20ChatGPT%20Killer-_ts.m3u8","views":4805,"comment_count":14,"category":"knowledge","is_forum_post":false}">{"id":34638,"title":"最新开源语言模型 Vicuna | 媲美GPT-4 | 支持本地化私有部署","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/04/20230401081952354.png","cover_video":"https://v.pigsec.cn/Is%20Vicuna%20the%20ChatGPT%20Killer-_ts.m3u8","views":4805,"comment_count":14,"category":"knowledge","is_forum_post":false}
data-postsbox="{"id":34361,"title":"ChatGPT本地化 | 如何在你的电脑上部署开源GPT-3语言模型 | ChatGLM","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/03/20230326142701279.png","cover_video":"","views":5541,"comment_count":21,"category":"knowledge","is_forum_post":false}">{"id":34361,"title":"ChatGPT本地化 | 如何在你的电脑上部署开源GPT-3语言模型 | ChatGLM","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/03/20230326142701279.png","cover_video":"","views":5541,"comment_count":21,"category":"knowledge","is_forum_post":false}
data-postsbox="{"id":34010,"title":"ChatGPT本地化 | 如何在你的电脑上部署开源GPT-3语言模型 | LLaMA \u0026 Alpaca","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/03/20230321010140581.jpg","cover_video":"https://v.pigsec.cn/Install%20-ChatGPT-%20ON%20Your%20LOCAL%20Computer-%20LLaMA%20%26%20Alpaca_ts.m3u8","views":4833,"comment_count":11,"category":"knowledge","is_forum_post":false}">{"id":34010,"title":"ChatGPT本地化 | 如何在你的电脑上部署开源GPT-3语言模型 | LLaMA \u0026 Alpaca","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/03/20230321010140581.jpg","cover_video":"https://v.pigsec.cn/Install%20-ChatGPT-%20ON%20Your%20LOCAL%20Computer-%20LLaMA%20%26%20Alpaca_ts.m3u8","views":4833,"comment_count":11,"category":"knowledge","is_forum_post":false}
data-postsbox="{"id":32445,"title":"如何制作一个ChatGPT聊天页面 | ChatGPT国产化思路","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/02/20230216014624643.png","cover_video":"","views":92244,"comment_count":16,"category":"knowledge","is_forum_post":false}">{"id":32445,"title":"如何制作一个ChatGPT聊天页面 | ChatGPT国产化思路","author":"FancyPig","author_id":1,"cover_image":"https://static.pigsec.cn/wp-content/uploads/2023/02/20230216014624643.png","cover_video":"","views":92244,"comment_count":16,"category":"knowledge","is_forum_post":false}
data-postsbox="{"id":34544,"title":"一键拥有你自己的 ChatGPT 网页服务。| 界面非常好看的ChatGPT网页版","author":"Sec-Labs","author_id":10015,"cover_image":"","cover_video":"","views":1339,"comment_count":2,"category":"","is_forum_post":true}">{"id":34544,"title":"一键拥有你自己的 ChatGPT 网页服务。| 界面非常好看的ChatGPT网页版","author":"Sec-Labs","author_id":10015,"cover_image":"","cover_video":"","views":1339,"comment_count":2,"category":"","is_forum_post":true}
视频讲解
本期视频我们将分享两套本地化部署方案,教大家如何在本地使用Vicuna模型,它是基于ChatGPT的优质数据训练而成,因此效果已经达到了GPT-4的90%,并且可以本地私有化部署,支持GPU、CPU两种部署模式,最低仅需4G RAM。除此之外,我们还会为大家分享一些小技巧,让AI的回复可以不受到限制……
相关资料
- Vicuna 博客 https://vicuna.lmsys.org/
- Vicuna 官方Github地址 https://github.com/lm-sys/FastChat
- Vicuna 官方在线对话演示 https://chat.lmsys.org/
- oobabooga/text-generation-webui Github项目地址 https://github.com/oobabooga/text-generation-webui
- Vicuna GPTQ 13B模型下载 https://huggingface.co/anon8231489123/vicuna-13b-GPTQ-4bit-128g
- llama.cpp Github项目地址 https://github.com/ggerganov/llama.cpp
- Vicuna ggml 13B模型下载 https://huggingface.co/eachadea/ggml-vicuna-13b-4bit
- Vicuna 预设prompts下载 https://mega.nz/file/iEdBGC7K#Vj8w3IjGhhci71F-997FXFp0pMv8AzzRFvqvIAenqwM
- Vicuna bat文件下载 https://mega.nz/file/zVcURKgZ#NUJeRdKUz_wTFQc4GdFGRM50-zOkGlD1Djd75Xe06W4