Motörhead 记忆服务器
Motörhead 是一个用 Rust 实现的记忆服务器。它会在后台自动处理增量摘要，并允许无状态的应用程序。
设置
请参考 Motörhead 的说明来在本地运行服务器。
from langchain.memory.motorhead_memory import MotorheadMemory
from langchain import OpenAI, LLMChain, PromptTemplate
template = """You are a chatbot having a conversation with a human.
{chat_history}
Human: {human_input}
AI:"""
prompt = PromptTemplate(
input_variables=["chat_history", "human_input"], template=template
)
memory = MotorheadMemory(
session_id="testing-1", url="http://localhost:8080", memory_key="chat_history"
)
await memory.init()
# loads previous state from Motörhead 🤘
llm_chain = LLMChain(
llm=OpenAI(),
prompt=prompt,
verbose=True,
memory=memory,
)
llm_chain.run("hi im bob")
[1m> Entering new LLMChain chain...[0m
Prompt after formatting:
[32;1m[1;3mYou are a chatbot having a conversation with a human.
Human: hi im bob
AI:[0m
[1m> Finished chain.[0m
' Hi Bob, nice to meet you! How are you doing today?'
llm_chain.run("whats my name?")
[1m> Entering new LLMChain chain...[0m
Prompt after formatting:
[32;1m[1;3mYou are a chatbot having a conversation with a human.
Human: hi im bob
AI: Hi Bob, nice to meet you! How are you doing today?
Human: whats my name?
AI:[0m
[1m> Finished chain.[0m
' You said your name is Bob. Is that correct?'
llm_chain.run("whats for dinner?")
[1m> Entering new LLMChain chain...[0m
Prompt after formatting:
[32;1m[1;3mYou are a chatbot having a conversation with a human.
Human: hi im bob
AI: Hi Bob, nice to meet you! How are you doing today?
Human: whats my name?
AI: You said your name is Bob. Is that correct?
Human: whats for dinner?
AI:[0m
[1m> Finished chain.[0m
" I'm sorry, I'm not sure what you're asking. Could you please rephrase your question?"