Scraping API
https://scraping-api.datafuel.ai/api/v1
Help centerOpenAPI spec

Availability

Which task types and engines accept new work

GET/config/capabilities

List task types and engines with their on/off state

Answered from memory and cacheable for 30 seconds. A switch made by an operator reaches every API replica within CAPABILITIES_REFRESH_INTERVAL (30 s by default).

Request
cURL
curl https://scraping-api.datafuel.ai/api/v1/config/capabilities
Response
{
  "modules": [
    {
      "name": "crawl",
      "enabled": true
    },
    {
      "name": "llm_scraping",
      "enabled": true
    },
    {
      "name": "map",
      "enabled": true
    },
    {
      "name": "serp",
      "enabled": true
    },
    {
      "name": "unlocker",
      "enabled": true
    }
  ],
  "engines": [
    {
      "name": "openai",
      "enabled": true
    },
    {
      "name": "gemini",
      "enabled": true
    },
    {
      "name": "google_ai_mode",
      "enabled": false,
      "reason": "temporarily unavailable"
    },
    {
      "name": "perplexity",
      "enabled": true
    },
    {
      "name": "copilot",
      "enabled": true
    }
  ]
}