420032: Knowledge source rate limit exceeded

The web crawler received a 429 Too Many Requests response when attempting to access the target URL during knowledge ingestion. The target server is rate limiting or throttling requests from the crawler.

• The target site has rate limits that the crawler exceeded
• The site detected automated crawling and blocked further requests
• Too many pages were crawled in a short time period
• The target site's API or CDN has request quotas
• Anti-bot protection is limiting crawler access

• Reduce the crawl depth to limit the number of pages crawled
• Increase the crawl period to spread requests over a longer time
• Contact the target site administrator to allowlist Twilio's crawler
• If rate limiting persists, download the content manually and upload as files
• The crawler will automatically retry on the next scheduled crawl period
• Review the knowledge source error details in the Twilio Console