Automatic knowledge re-sync
Keep website-based RAG sources fresh by scheduling recurring crawl jobs.
Queue due sources
Knowledge sources can be marked for daily, weekly or monthly re-sync. Run php bin/queue-knowledge-sync.php 50 from Cron to create due crawl jobs.
Process jobs
The normal crawler worker processes queued jobs: php bin/process-crawls.php 25.
Production recommendation
Schedule the sync queue first and the crawler worker shortly after it. Monitor failed crawl jobs and review important pricing or policy sources after automatic updates.