Skip to main content

Adding a timeout

By default, LangChain will wait indefinitely for a response from the model provider. If you want to add a timeout, you can pass a timeout option, in milliseconds, when you call the model. For example, for OpenAI:

npm install @langchain/openai
import { OpenAI } from "@langchain/openai";

const model = new OpenAI({ temperature: 1 });

const resA = await model.invoke(
"What would be a good company name a company that makes colorful socks?",
{ timeout: 1000 } // 1s timeout

console.log({ resA });
// '\n\nSocktastic Colors' }

API Reference:

Help us out by providing feedback on this documentation page: