Abstract

Although Large Language Models (LLMs) have demonstrated potential inprocessing graphs, they struggle with comprehending graphical structureinformation through prompts of graph description sequences, especially as thegraph size increases. We attribute this challenge to the uneven memoryperformance of LLMs across different positions in graph description sequences,known as ''positional biases''. To address this, we propose GraphInsight, anovel framework aimed at improving LLMs' comprehension of both macro- andmicro-level graphical information. GraphInsight is grounded in two keystrategies: 1) placing critical graphical information in positions where LLMsexhibit stronger memory performance, and 2) investigating a lightweightexternal knowledge base for regions with weaker memory performance, inspired byretrieval-augmented generation (RAG). Moreover, GraphInsight exploresintegrating these two strategies into LLM agent processes for composite graphtasks that require multi-step reasoning. Extensive empirical studies onbenchmarks with a wide range of evaluation tasks show that GraphInsightsignificantly outperforms all other graph description methods (e.g., promptingtechniques and reordering strategies) in understanding graph structures ofvarying sizes.