What is memory in an AI agent?

Memory in an AI agent is information the agent stores so it can use that information later instead of treating every interaction or task as completely new.

Memory gives an agent continuity across steps, sessions, or tasks when previously learned information is still useful.

What can agent memory store?

Depending on the system, memory may contain:

• user preferences
• important facts learned earlier
• summaries of previous interactions
• past task outcomes
• recurring instructions
• useful observations
• successful strategies
• information about earlier events

The system should store only information that has a clear future use.

Example

Suppose a user repeatedly asks an agent to prepare reports.

The agent may remember:

Preference: Keep reports concise and include an executive summary.

On a future request, that memory can be retrieved and included in the agent's context.

The user does not need to repeat the same preference every time.

Memory is not the same as active context

Context is the information currently available to the model for the present decision.

Memory is information stored for possible future use.

A memory does not affect the current step until the system retrieves it and places the relevant information into context.

For example:

Stored memory: User prefers CSV exports.

Current context: The user asks for a downloadable data export, so that preference is retrieved and included.

Memory is not the same as workflow state

Agent state tracks the current condition and progress of an active workflow.

For example:

• current goal
• completed subtasks
• retry count
• current execution status

Memory usually captures information that may remain useful beyond the immediate execution.

For example:

• user preferences
• knowledge learned from previous tasks
• summaries of earlier experiences

State answers:

> Where is this workflow right now?

Memory answers:

> What useful information from the past might help now?

Memory can have different lifetimes

Some memories are useful only briefly.

Others may remain useful across many sessions.

Agent systems may therefore use different forms of memory, such as:

• short-term memory
• long-term memory
• working memory
• episodic memory
• semantic memory
• procedural memory

These memory types are covered in the following questions.

Memory should be retrieved selectively

An agent should not load every stored memory into every prompt.

Instead, the system should retrieve memories that are relevant to the current task.

For example, a memory about a user's preferred report format may be useful when creating a report but irrelevant when checking an API status.

Selective retrieval keeps context focused.

Memory should be updateable

Stored information can become outdated.

For example:

Old memory: User prefers weekly summaries.

Later:

New preference: User prefers daily summaries.

A reliable memory system should update, replace, or invalidate outdated information rather than continuing to use stale memory.

Memory can improve continuity

Without memory, an agent may repeatedly:

• ask the same questions
• forget user preferences
• repeat earlier mistakes
• ignore useful past outcomes

Memory helps the agent build on relevant previous information.

Memory should not be treated as automatically correct

Stored memories can be:

• outdated
• incomplete
• incorrect
• conflicting

An agent system may need to validate important memories against current information before relying on them.

This becomes especially important when the memory affects high-impact decisions.

In short

Memory in an AI agent is stored information from earlier interactions, tasks, or observations that can be retrieved and used later when relevant.

It gives the agent continuity over time, but useful memory systems must also decide what to store, what to retrieve, what to update, and what to forget.