LLMGenerationOptions

When the signal is aborted, the provider will attempt to cancel the underlying HTTP request and the stream will terminate with an abort error. Use isAbortError() from @/core/errors to detect cancellation in error handling.

Example

const controller = new AbortController();

const stream = client.stream({
  model: "claude-3-5-sonnet-20241022",
  messages: [{ role: "user", content: "Tell me a long story" }],
  signal: controller.signal,
});

// Cancel after 5 seconds
setTimeout(() => controller.abort(), 5000);

try {
  for await (const chunk of stream) {
    process.stdout.write(chunk.text);
  }
} catch (error) {
  if (isAbortError(error)) {
    console.log("\nRequest was cancelled");
  } else {
    throw error;
  }
}

stopSequences?

optional stopSequences: string[]

Defined in: core/options.ts:9

temperature?

optional temperature: number

Defined in: core/options.ts:7

topP?

optional topP: number

Defined in: core/options.ts:8