Abstract: The emerging large language models (LLMs) such as ChatGPT and DeepSeek have shown great potential in almost all fields. However, the current centralized cloud deployment fashion makes it ...