Can't load pages that require JavaScript to access the site

[braden-seaborn]

When trying to clean the HTML document that requires the execution of JavaScript (example: canvas.tamu.edu), the Metaprogram returns this JSON object:

{"error":"JavaScript is required to access this site"}

JSDOM can be used to execute JavaScript for a page to resolve this issue.

[braden-seaborn]

I'm currently trying to implement a fix using JSDOM to simulate a headless browser to execute the JavaScript. So far it is not working. I'll continue to try to solve this issue as I work on the metaprogram. The issue comes from when trying to clean the HTML. Current attempted solution:

const dom = new JSDOM(rawHTML, {
        runScripts: "dangerously",
        resources: "usable",
        pretendToBeVisual: true
    });

    // Wait for the scripts to finish executing
    await new Promise<void>((resolve) => {
        dom.window.document.addEventListener("load", () => resolve());
    });

    const document = dom.window.document;
    const tempDiv = document.createElement("div");
    tempDiv.innerHTML = document.body.innerHTML;