Abstract

Knowledge Editing (KE) enables the modification of outdated or incorrectinformation in large language models (LLMs). While existing KE methods canupdate isolated facts, they struggle to generalize these updates to multi-hopreasoning tasks that depend on the modified knowledge. Through an analysis ofreasoning circuits -- the neural pathways LLMs use for knowledge-basedinference, we observe that current layer-localized KE approaches, such as MEMITand WISE, which edit only single or a few model layers, struggle to effectivelyincorporate updated information into these reasoning pathways. To address thislimitation, we propose CaKE (Circuit-aware Knowledge Editing), a novel methodthat enables more effective integration of updated knowledge in LLMs. CaKEleverages strategically curated data, guided by our circuits-based analysis,that enforces the model to utilize the modified knowledge, stimulating themodel to develop appropriate reasoning circuits for newly integrated knowledge.Experimental results show that CaKE enables more accurate and consistent use ofupdated knowledge across related reasoning tasks, leading to an average of 20%improvement in multi-hop reasoning accuracy on MQuAKE dataset compared toexisting KE methods. We release the code and data inhttps://github.com/zjunlp/CaKE.