SerpApi For Web Search
Load and process data from web search results.
Last updated
Load and process data from web search results.
Last updated
The SerpApi For Web Search loader enables you to fetch and process web search results using the SerpApi service. This loader transforms search results into structured documents that can be easily integrated into your workflow, making it ideal for applications requiring real-time web search data.
Real-time web search results
Text splitting capabilities
Customizable metadata handling
Multiple output formats
API key authentication
Efficient document processing
Connect Credential: SerpApi API key credential
Query: The search query to execute
Text Splitter: A text splitter to process the extracted content
Additional Metadata: JSON object with additional metadata to add to documents
Omit Metadata Keys: Comma-separated list of metadata keys to exclude
Format: key1, key2, key3.nestedKey1
Use * to remove all default metadata except custom metadata
Document: Array of document objects containing:
metadata: Search result metadata
pageContent: Search result content
Text: Concatenated string of all search results' content
Each document contains:
pageContent: The main content from the search result
metadata:
Default search result metadata
Custom metadata (if specified)
Filtered metadata (based on omitted keys)
Two ways to customize metadata:
Additional Metadata
Add new metadata fields via JSON
Merged with existing metadata
Useful for adding custom tracking or categorization
Omit Metadata Keys
Remove unwanted metadata fields
Comma-separated list of keys to exclude
Support for nested key removal
Use * to remove all default metadata
Provide specific search queries for better results
Use text splitters for large search results
Customize metadata to match your needs
Consider rate limits when making multiple queries
Handle search results appropriately based on size
Requires SerpApi API key
Respects API rate limits
Real-time search results
Memory-efficient processing
Error handling for API requests
Supports both document and text output formats