TY - GEN
T1 - Research on Cloud-Edge Computing for LLM
AU - Park, Heejae
AU - Song, Seungyeop
AU - Wee, Seongryool
AU - Park, Laihyuk
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Large Language Models (LLMs) offer remarkable capabilities across various natural language processing (NLP) tasks. However, their high computational complexity and significant memory requirements during the training and inference stages hinder their practical application. Cloud-edge computing has emerged as a promising paradigm to overcome these limitations by enabling the collaborative execution of LLM inference across cloud and edge servers. This paper surveys recent research on cloud-edge collaborative frameworks for LLMs, with a focus on system architecture, optimization objectives, and learning-based offloading strategies.
AB - Large Language Models (LLMs) offer remarkable capabilities across various natural language processing (NLP) tasks. However, their high computational complexity and significant memory requirements during the training and inference stages hinder their practical application. Cloud-edge computing has emerged as a promising paradigm to overcome these limitations by enabling the collaborative execution of LLM inference across cloud and edge servers. This paper surveys recent research on cloud-edge collaborative frameworks for LLMs, with a focus on system architecture, optimization objectives, and learning-based offloading strategies.
KW - cloud-edge computing
KW - LLM
KW - task offloading
UR - https://www.scopus.com/pages/publications/105035066275
U2 - 10.1109/ICTC66702.2025.11388211
DO - 10.1109/ICTC66702.2025.11388211
M3 - Conference contribution
AN - SCOPUS:105035066275
T3 - International Conference on ICT Convergence
SP - 553
EP - 554
BT - 2025 16th International Conference on Information and Communication Technology Convergence, ICTC 2025
PB - IEEE Computer Society
T2 - 16th International Conference on Information and Communication Technology Convergence, ICTC 2025
Y2 - 14 October 2025 through 17 October 2025
ER -