Class CheerioWebBaseLoader

constructor

• new CheerioWebBaseLoader(webPath, fields?): CheerioWebBaseLoader

• Parameters

  • webPath: string

  • Optional fields: WebBaseLoaderParams

  Returns CheerioWebBaseLoader

caller

timeout

webPath

Optional selector

Optional textDecoder

load

• load(): Promise<Document<Record<string, any>>[]>

• Extracts the text content from the loaded document using the selector and creates a Document instance with the extracted text and metadata. It returns an array of Document instances.

  Returns Promise<Document<Record<string, any>>[]>

  A Promise that resolves to an array of Document instances.

scrape

• scrape(): Promise<CheerioAPI>

• Fetches the web document from the webPath and loads it using Cheerio. It returns a CheerioAPI instance.

  Returns Promise<CheerioAPI>

  A Promise that resolves to a CheerioAPI instance.

Static _scrape

• _scrape(url, caller, timeout, textDecoder?): Promise<CheerioAPI>

• Parameters

  • url: string

  • caller: AsyncCaller

  • timeout: undefined | number

  • Optional textDecoder: TextDecoder

  Returns Promise<CheerioAPI>

Static imports

• imports(): Promise<{
      load: ((content, options?, isDocument?) => CheerioAPI);
  }>

• A static method that dynamically imports the Cheerio library and returns the load function. If the import fails, it throws an error.

  Returns Promise<{
      load: ((content, options?, isDocument?) => CheerioAPI);
  }>

  A Promise that resolves to an object containing the load function from the Cheerio library.