Can crawling be done on a set schedule?

Yes, scheduled crawling is available for Enterprise level customers.