POST
/
api
/
aibot
/
scrape
Crawl websites to discover internal links
curl --request POST \
  --url https://app.livechatai.com/api/aibot/scrape \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "url": "https://.....",
  "sitemapUrl": "https://.....sitemap.xml",
  "streaming": false,
  "limit": 100
}'

Authorizations

​
Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json

Scraping configuration

The body is of type object.

Response

200

Successfully scraped website and retrieved internal links