如何添加断点¶
人在回路（HIL）交互对于自主系统至关重要。断点是一种常见的人在回路交互模式，它允许图在特定步骤停止，并在继续执行之前寻求人类批准（例如，对于敏感操作）。
断点建立在 LangGraph 检查点之上，检查点会在每个节点执行后保存图的状态。检查点保存在线程中，这些线程会保留图的状态，并且可以在图执行完成后访问。这使得图的执行可以在特定点暂停，等待人类批准，然后从最后一个检查点恢复执行。
安装设置¶
首先，我们需要安装所需的软件包。
接下来，我们需要为 Anthropic（我们将使用的大语言模型）设置 API 密钥。
import getpass
import os
def _set_env(var: str):
if not os.environ.get(var):
os.environ[var] = getpass.getpass(f"{var}: ")
_set_env("ANTHROPIC_API_KEY")
为 LangGraph 开发设置 LangSmith
注册 LangSmith，以便快速发现问题并提升你的 LangGraph 项目的性能。LangSmith 允许你使用跟踪数据来调试、测试和监控使用 LangGraph 构建的大语言模型应用程序 — 请 点击此处 了解更多关于如何开始使用的信息。
简单用法¶
让我们来看看它的非常基础的用法。
下面，我们要做两件事：
1) 我们使用 interrupt_before 在指定步骤之前指定断点。
2) 我们设置一个检查点器来保存图的状态。
from typing_extensions import TypedDict
from langgraph.graph import StateGraph, START, END
from langgraph.checkpoint.memory import MemorySaver
from IPython.display import Image, display
class State(TypedDict):
input: str
def step_1(state):
print("---Step 1---")
pass
def step_2(state):
print("---Step 2---")
pass
def step_3(state):
print("---Step 3---")
pass
builder = StateGraph(State)
builder.add_node("step_1", step_1)
builder.add_node("step_2", step_2)
builder.add_node("step_3", step_3)
builder.add_edge(START, "step_1")
builder.add_edge("step_1", "step_2")
builder.add_edge("step_2", "step_3")
builder.add_edge("step_3", END)
# Set up memory
memory = MemorySaver()
# Add
graph = builder.compile(checkpointer=memory, interrupt_before=["step_3"])
# View
display(Image(graph.get_graph().draw_mermaid_png()))
我们为检查点器创建一个线程 ID。
我们运行到步骤 3，这是由 interrupt_before 定义的。
在用户输入/批准之后，我们恢复执行，通过使用 None 调用图。
# Input
initial_input = {"input": "hello world"}
# Thread
thread = {"configurable": {"thread_id": "1"}}
# Run the graph until the first interruption
for event in graph.stream(initial_input, thread, stream_mode="values"):
print(event)
try:
user_approval = input("Do you want to go to Step 3? (yes/no): ")
except:
user_approval = "yes"
if user_approval.lower() == "yes":
# If approved, continue the graph execution
for event in graph.stream(None, thread, stream_mode="values"):
print(event)
else:
print("Operation cancelled by user.")
{'input': 'hello world'}
---Step 1---
---Step 2---
``````output
Do you want to go to Step 3? (yes/no): yes
``````output
---Step 3---
智能体¶
在智能体的场景中，断点对于手动批准某些智能体操作很有用。
为了说明这一点，我们将构建一个相对简单的执行工具调用的 ReAct 风格智能体。
我们将在调用 action 节点之前添加一个断点。
# Set up the tool
from langchain_anthropic import ChatAnthropic
from langchain_core.tools import tool
from langgraph.graph import MessagesState, START
from langgraph.prebuilt import ToolNode
from langgraph.graph import END, StateGraph
from langgraph.checkpoint.memory import MemorySaver
@tool
def search(query: str):
"""Call to surf the web."""
# This is a placeholder for the actual implementation
# Don't let the LLM know this though 😊
return [
"It's sunny in San Francisco, but you better look out if you're a Gemini 😈."
]
tools = [search]
tool_node = ToolNode(tools)
# Set up the model
model = ChatAnthropic(model="claude-3-5-sonnet-20240620")
model = model.bind_tools(tools)
# Define nodes and conditional edges
# Define the function that determines whether to continue or not
def should_continue(state):
messages = state["messages"]
last_message = messages[-1]
# If there is no function call, then we finish
if not last_message.tool_calls:
return "end"
# Otherwise if there is, we continue
else:
return "continue"
# Define the function that calls the model
def call_model(state):
messages = state["messages"]
response = model.invoke(messages)
# We return a list, because this will get added to the existing list
return {"messages": [response]}
# Define a new graph
workflow = StateGraph(MessagesState)
# Define the two nodes we will cycle between
workflow.add_node("agent", call_model)
workflow.add_node("action", tool_node)
# Set the entrypoint as `agent`
# This means that this node is the first one called
workflow.add_edge(START, "agent")
# We now add a conditional edge
workflow.add_conditional_edges(
# First, we define the start node. We use `agent`.
# This means these are the edges taken after the `agent` node is called.
"agent",
# Next, we pass in the function that will determine which node is called next.
should_continue,
# Finally we pass in a mapping.
# The keys are strings, and the values are other nodes.
# END is a special node marking that the graph should finish.
# What will happen is we will call `should_continue`, and then the output of that
# will be matched against the keys in this mapping.
# Based on which one it matches, that node will then be called.
{
# If `tools`, then we call the tool node.
"continue": "action",
# Otherwise we finish.
"end": END,
},
)
# We now add a normal edge from `tools` to `agent`.
# This means that after `tools` is called, `agent` node is called next.
workflow.add_edge("action", "agent")
# Set up memory
memory = MemorySaver()
# Finally, we compile it!
# This compiles it into a LangChain Runnable,
# meaning you can use it as you would any other runnable
# We add in `interrupt_before=["action"]`
# This will add a breakpoint before the `action` node is called
app = workflow.compile(checkpointer=memory, interrupt_before=["action"])
display(Image(app.get_graph().draw_mermaid_png()))
API Reference: tool
与智能体进行交互¶
现在我们可以与智能体进行交互了。
我们看到它在调用工具之前停止了，因为在 action 节点之前设置了 interrupt_before。
from langchain_core.messages import HumanMessage
thread = {"configurable": {"thread_id": "3"}}
inputs = [HumanMessage(content="search for the weather in sf now")]
for event in app.stream({"messages": inputs}, thread, stream_mode="values"):
event["messages"][-1].pretty_print()
API Reference: HumanMessage
================================[1m Human Message [0m=================================
search for the weather in sf now
==================================[1m Ai Message [0m==================================
[{'text': "Certainly! I'll search for the current weather in San Francisco for you. Let me use the search function to find this information.", 'type': 'text'}, {'text': None, 'type': 'tool_use', 'id': 'toolu_011ezBx5hKKjVJwqnECNPyyC', 'name': 'search', 'input': {'query': 'current weather in San Francisco'}}]
现在，我们可以在不提供输入的情况下再次调用智能体以继续执行。
这将按要求运行工具。
在输入中使用 None 来运行一个被中断的图意味着 像中断没有发生一样继续执行。
=================================[1m Tool Message [0m=================================
Name: search
["It's sunny in San Francisco, but you better look out if you're a Gemini \ud83d\ude08."]
==================================[1m Ai Message [0m==================================
Based on the search results, I can provide you with information about the current weather in San Francisco:
The weather in San Francisco right now is sunny.
It's worth noting that the search result includes a playful reference to astrology, suggesting that Geminis should "look out." However, this is likely just a humorous addition and not related to the actual weather conditions.
Is there anything else you'd like to know about the weather in San Francisco or any other location?