Audit with CSV feed now showing 0 URLs

[sfrozman]

Describe the bug
Today I noticed that a couple of my WordPress RED sites which were showing URLs with blockers are now showing zero URLs.

To Reproduce
Steps to reproduce the behavior:

1. Go to https://app.equalify.uic.edu/audits/350654b89b724e3b8361f0179d84fef9
2. Check the Remote CSV URL which still has 87 URLs
3. View the Audit Report on step 1 and chart both show ~330 blockers which matches first scan on May 1
4. However it now says 0 or 0 URLs in this audit have blockers and the Audit page preview of that specific audit also shows zeros.

Expected behavior
Assuming nothing was fixed on the site and rules have not changed, I would expect to still see 330 after latest scan which was today.

Screenshots

Desktop (please complete the following information):

• OS: [Win11]
• Browser [chrome]

Additional context
Wondering if the site was down for some reason when the most recent scan was completed? If that is the case, would it have zero URLs or does the code realize that the CSV was not available to try again later or mark as a failed scan?

[sfrozman]

https://app.equalify.uic.edu/audits/f9c4cd5d58c34bfdb46cb24a095bde8a
and
https://app.equalify.uic.edu/audits/cad82dc051414ef4b492667a1187e499
are showing the same symptoms as the one explained above.
These monthly scans all show as last running at the same minute.

[azdak]

Hey @sfrozman - we did a fairly major database refactor over the weekend (which should improve performance dramatically) but it did involve some data migration, which looks like may have caused something to go wrong here. We're currently investigating, and will keep you posted.

[heythisischris]

Hi @sfrozman- we've fixed the underlying issue and recovered your data. It was caused by an issue with our CSV sync script.

All 3 audits restored from a pre-incident RDS snapshot. Refresh and you should see correct numbers again!

[sfrozman]

I happened to notice another one which only shows 4 URLs instead of ~34.
Could you see if it is a similar situation?
https://app.equalify.uic.edu/audits/7cee5a16094449708f165f1d6c97b042
This also shows 17 instead of 53
https://app.equalify.uic.edu/audits/46f069e28c7942b5a56d11de4b82a78b
This was showing 18 instead of 108 URLs, so I thought I would try to just use the scan now feature after which it went to 0 URLs even thought I just manually confirmed the 108 URLs by opening the feed URL in Excel to see how many exist.

[sfrozman]

Sorry forgot to include the 3rd link for the 108 URLs:
https://app.equalify.uic.edu/audits/d10e39e760104536a0c2b2095ed14a2f

[sfrozman]

Another interesting behavior was that after the manual scan, which said it was complete was showing a chart with a point on May 1, then back to zero.... then back to a somewhat lower number and then back to zero. Then it changed after a minute or two and shows the numbers for the 18 URLs. I just tried clicking on the sync button next to the feed URL and it refreshed to the 108 URLs. I would suggest that the scan now option should do that automatically to make sure no content is missed.

[heythisischris]

Hi @sfrozman, we are still investigating the underlying issue with the audits you've provided. We'll respond with a fix as soon as it's available!

[sfrozman]

Thanks for the update. I just found another issue which may/may not be related. I created a new audit of a fairly small site. It shows ~65 URLs in the CSV feed. It claims that it was scanned and only has blockers in 3 URLs which all happen to be PDF.... no HTML blockers. https://app.equalify.uic.edu/audits/d9cdb7ce6ebb4bdeaa8ff607eb86f748 Unless someone fixed all of the blockers on the UIC RED platform which would be amazing.