Cognitive Architectures for Language Agents

Recent efforts have augmented large language models (LLMs) with external resources (e.g., the Internet) or internal control flows (e.g., prompt chaining) for tasks requiring grounding or reasoning, leading to a new class of language agents. While these agents have achieved substantial empirical success, we lack a systematic framework to organize existing agents and plan future developments. In this paper, we draw on the rich history of cognitive science and symbolic artificial intelligence to propose Cognitive Architectures for Language Agents (CoALA). CoALA describes a language agent with modular memory components, a structured action space to interact with internal memory and external environments, and a generalized decision-making process to choose actions. We use CoALA to retrospectively survey and organize a large body of recent work, and prospectively identify actionable directions towards more capable agents. Taken together, CoALA contextualizes today's language agents within the broader history of AI and outlines a path towards language-based general intelligence.

Language Models canSolve Computer TasksLanguage Models can Solve Computer TasksReAct: SynergizingReasoning and Acting in…ReAct: Synergizing Reasoning and Acting in Language ModelsReflexion: an autonomousagent with dynamic…Reflexion: an autonomous agent with dynamic memory and self-reflectionLLM+P: Empowering LargeLanguage Models with…LLM+P: Empowering Large Language Models with Optimal Planning ProficiencyAutoGen: EnablingNext-Gen LLM…AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation FrameworkReasoning with LanguageModel is Planning with…Reasoning with Language Model is Planning with World ModelPlanBench: An ExtensibleBenchmark for Evaluatin…PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about ChangeAugmented LanguageModels: a SurveyAugmented Language Models: a SurveyA Real-World WebAgentwith Planning, Long…A Real-World WebAgent with Planning, Long Context Understanding, and Program SynthesisVoyager: An Open-EndedEmbodied Agent with…Voyager: An Open-Ended Embodied Agent with Large Language ModelsTeaching Large LanguageModels to Self-DebugTeaching Large Language Models to Self-DebugWebArena: A RealisticWeb Environment for…WebArena: A Realistic Web Environment for Building Autonomous AgentsGenerative AI Agents forKnowledge Work…Generative AI Agents for Knowledge Work Augmentation in FinanceTowards UnifiedAlignment Between…Towards Unified Alignment Between Agents, Humans, and EnvironmentLarge Language ModelBased Multi-agents: A…Large Language Model Based Multi-agents: A Survey of Progress and ChallengesRCAgent: Cloud RootCause Analysis by…RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language ModelsAgent-FLAN: DesigningData and Methods of…Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language ModelsA Multimodal FoundationAgent for Financial…A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and GeneralistDigital Life Project:Autonomous 3D Character…Digital Life Project: Autonomous 3D Characters with Social IntelligenceTaking AI WelfareSeriouslyTaking AI Welfare SeriouslyGenoMAS: A Multi-AgentFramework for Scientifi…GenoMAS: A Multi-Agent Framework for Scientific Discovery via Code-Driven Gene Expression AnalysisComfyBench: BenchmarkingLLM-based Agents in…ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI SystemsThe rise and potentialof large language model…The rise and potential of large language model based agents: a surveyLifelong Learning ofLarge Language Model…Lifelong Learning of Large Language Model Based Agents: A RoadmapCognitive Architecturesfor Language AgentsCognitive Architectures for Language AgentsEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.