500 Internal Server Errors on specific books and major API sync issues

[rokibulroni]

Hello Sunnah.com Team, Assalamu Alaikum,

Thank you for your incredible work in making the Hadith collections accessible. While browsing and using the platform, I have encountered a few serious issues regarding broken pages on the website, as well as significant missing data in the official API.

I am listing the exact issues below so they can be investigated:

1. 500 Internal Server Error (Broken Pages)

When trying to read certain books within specific collections, the website completely crashes and returns a 500 Internal Server Error. The pages do not load at all.

Here are the exact URLs that are currently broken:

• Mustadrak al-Hakim (Book 29): https://sunnah.com/hakim/29
• Musannaf 'Abd ar-Razzaq (Book 3): https://sunnah.com/abdurrazzaq/3
• Musannaf Ibn Abi Shayba (Book 2): https://sunnah.com/ibnabishayba/2
• Sunan al-Kubra lil-Bayhaqi (Book 2 & 3): https://sunnah.com/bayhaqi/2 and https://sunnah.com/bayhaqi/3

Steps to reproduce: Just open any of the links above in a web browser, and you will see the Cloudflare/Server 500 error page instead of the Hadith text.

---

2. API is Outdated and Missing Thousands of Hadiths

The official API (api.sunnah.com/v1/collections) seems to be severely outdated compared to the live website. If a developer uses the API, they miss out on a massive amount of data that is already published on your frontend.

A. Partially Missing Hadiths in API:
The /collections endpoint reports significantly lower totals than what is actually published on the website.

• Sahih al-Bukhari (bukhari): Website has more hadiths; API only provides 7,167 (Missing ~110).
• Jami' at-Tirmidhi (tirmidhi): API provides 3,975 (Missing ~78 compared to expected 4053).
• Al-Adab Al-Mufrad (adab): API provides 1,185 (Missing ~141).
• Mishkat al-Masabih (mishkat): API provides 5,015 (Missing ~304).

B. Completely Missing Collections in API:
The API returns totalAvailableHadith: 0 for many collections that are completely readable on the live website. Developers cannot fetch them via the API:

• darimi (Sunan ad-Darimi)
• ibnkhuzayma (Sahih Ibn Khuzayma)
• ibnhibban (Sahih Ibn Hibban)
• hakim (Mustadrak al-Hakim)
• abdurrazzaq (Musannaf 'Abd ar-Razzaq)
• ibnabishayba (Musannaf Ibn Abi Shayba)
• daraqutni (Sunan ad-Daraqutni)
• bayhaqi (Sunan al-Kubra lil-Bayhaqi)
• nasaikubra (Sunan al-Kubra an-Nasai)
• nawawi40 (40 Hadith Nawawi)
• virtues (100 Virtues)

Expected Behavior:

1. The 500 error pages for Hakim, Abdur Razzaq, and Ibn Abi Shayba should load the hadiths correctly.
2. The official API endpoints should be synchronized with the live website database so that all hadiths and new collections are accessible via API.

Thank you very much for looking into these issues. Jazakumullahu Khairan!

[mha6]

Wa`alaykum ussalam warahmatullah

Thank you for raising these issues.

The first issue is already on our radar. The main issue is the size of those pages - some of those books contain upwards of 6,000 ahadith. We need to figure out a nice way to paginate it or load on demand or something. We expect to fix this soon in sha Allah.

As for the second issue, early on we made a decision to only vend "verified" hadith through the API because once that data leaves our website, we cannot issue corrections to it if needed. Most importantly the verification revolves around ensuring the hadith unit is complete, is tagged to the correct chapter, and has the correct reference number. For the newer collections, we have not performed that manual verification yet.

However, we should have the complete set of hadith for al-Bukhari, Tirmidhi, and al-Adab al-Mufrad. Could you drop a comment here letting us know which book or set of hadith are missing?

[rokibulroni]

Hello Dear Sunnah Support,

Thank you for the prompt and detailed response. It's great to hear that the pagination fix for the larger collections is already planned.

Regarding the missing hadith counts in Sahih al-Bukhari, Jami' at-Tirmidhi, and Al-Adab Al-Mufrad, we identified the discrepancy by comparing the totals displayed on the website with the values returned by the /v1/collections endpoint.

Examples

Collection	Website Total	API totalAvailableHadith
Sahih al-Bukhari	7,563	7,167
Jami' at-Tirmidhi	3,956	3,975 (probably)

This suggests that the hadith records themselves may already exist in the database, while the metadata exposed through the /v1/collections endpoint has not been synchronized with the latest verified collection totals shown on the website.

Updating the totalAvailableHadith values to match the current collection counts would help eliminate confusion for API consumers and ensure consistency between the website and API responses.

Thank you again for your continued work on this project and for providing such a valuable resource for the Ummah.

May Allah reward you and your team for your efforts.