在本地intel的CPU/GPU上运行大语言模型
能跑但不代表效果很好,可怜的AMD......
https://github.com/intel-analytics/ipex-llm
GitHub
GitHub - intel-analytics/ipex-llm: Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral…
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max)...
via MJJ出征 - Telegram Channel