Fireworks

caution

You are currently on a page documenting the use of Fireworks models as text completion models. Many popular models available on Fireworks are chat completion models.

You may be looking for this page instead.

tip

See this section for general instructions on installing integration packages.

npm

npm install @langchain/community

Yarn

yarn add @langchain/community

pnpm

pnpm add @langchain/community

You can use models provided by Fireworks AI as follows:

import { Fireworks } from "@langchain/community/llms/fireworks";

const model = new Fireworks({
  temperature: 0.9,
  // In Node.js defaults to process.env.FIREWORKS_API_KEY
  apiKey: "YOUR-API-KEY",
});

API Reference:

• Fireworks from @langchain/community/llms/fireworks

Behind the scenes, Fireworks AI uses the OpenAI SDK and OpenAI compatible API, with some caveats:

• Certain properties are not supported by the Fireworks API, see here.
• Generation using multiple prompts is not supported.