ideally, we could automate the following tasks and have the server run them periodically (once a day or once a week, depending on the task):
- scraping users and projects (once a month?)
- update the active column on ks_projects (once a day)
- searching for duplicate records (users and projects) and then consolidating their information and cleaning them out (once a week, or maybe just once)
- rescore the users, generate new clusters (once a month)
- [maybe others]
ideally, we could automate the following tasks and have the server run them periodically (once a day or once a week, depending on the task):