Authorship markup ends after table in "Sleep disorder"

[ragesoss]

Whocolor authorship spans only show up until the table in the in the Risks section of "Sleep disorder" on en.wiki.

• https://en.wikipedia.org/wiki/Sleep_disorder
• https://api.wikiwho.net/en/whocolor/v1.0.0-beta/Sleep%20disorder/

The table markup seems normal in most respects, but it does include values like "<.001". Maybe those are tripping up the parser?

[faflo]

You are exactly right, it trips up the parser, we are trying to fix it, not only for that instance but more generally.

[ragesoss]

Here's another example with a different bit of markup that's tripping it up: https://en.wikipedia.org/wiki/Small_heath_(butterfly)

Here, it seems to be the <small> tags within a bullet list.

I see that's one of the tags added in @dkeske's commit, so I guess that'll be part of the fix too.

[bitnik]

I merged @dkeske 's commit and WhoColor API uses it right now. It fixes parser for "Sleep_disorder" but not for "Small_heath_(butterfly)".

We didn't really have time to test this commit. Let's see if it breaks sth which was working before or not.

[ragesoss]

Nice. That fixed my tool's visualization for 'Sleep disorder': https://dashboard.wikiedu.org/courses/University_of_Wisconsin-Eau_Claire/Epidemiology_ENPH_450_(Fall_2017)/articles?showArticle=46966

And here's still-broken 'Small heath (butterfly)', for reference: https://dashboard.wikiedu.org/courses/Washington_University_in_St_Louis/Behavioral_Ecology_(Fall)/articles?showArticle=50885371

I did some spot checking on other articles, and didn't notice any regressions.

[ragesoss]

I've gone through more of the recent instances reported by users where the authorship markup wasn't complete, and all of them appear to be fixed. Small heath (butterfly) is the only one left I know of that isn't working as expected (aside from references, which mostly don't work).

[fivefilters]

Another example of the parser seeming to fail half way through: https://en.wikipedia.org/wiki/Peter_Oborne

The part in extended_html where the HTML is no longer marked up with editor tokens:

<span class=\"editor-token token-editor-124152\" id=\"token-2838\">into</span> 
<span class=\"editor-token token-editor-124152\" id=\"token-2839\">the</span> 
<span class=\"editor-token token-editor-124152\" id=\"token-2840\">tradition</span> 
<span class=\"editor-token token-editor-124152\" id=\"token-2841\">of</span> 
[<a href=\"/wiki/Robert_Walpole\" title=\"Robert Walpole\">Robert</a>] Walpole and [<a href=\"/wiki/David_Lloyd_George\" title=\"David Lloyd George\">David</a>] Lloyd George\", who greatly enriched themselves in office, although Blair's \"exploitation of the office of prime minister came after he left Downing Street\".<sup id=\"cite_ref-19\" class=\"reference\"><a href=\"#cite_note-19\">[19]</a></sup></p>

The wikitext if it helps:

into the tradition of <nowiki>[</nowiki>[[Robert Walpole|Robert]]<nowiki>]</nowiki> Walpole and <nowiki>[</nowiki>[[David Lloyd George|David]]<nowiki>]</nowiki> Lloyd George", who greatly enriched themselves in office, although Blair's "exploitation of the office of prime minister came after he left Downing Street".<ref>{{cite news|last=Oborne|first=Peter|url=http://www.newstatesman.com/culture/2015/03/who-wants-be-millionaire-peter-oborne-tony-blair|title=Who wants to be a millionaire? Peter Oborne on Tony Blair|work=New Statesman|date=19 March 2015|accessdate=22 February 2017}}</ref>

[ragesoss]

Here's another one: https://en.wikipedia.org/wiki/Colorectal_cancer

It stops at the first reference here, and there are a few additional editor tokens much later in the document. Maybe a problem related to the self-closing named ref?

Field defects are important in progression to colon cancer.<ref name="intechopen" /><ref>{{cite journal | vauthors = Bernstein C, Bernstein H, Payne CM, Dvorak K, Garewal H | title = Field defects in progression to gastrointestinal tract cancers | journal = Cancer Letters | volume = 260 | issue = 1–2 | pages = 1–10 | date = February 2008 | pmid = 18164807 | pmc = 2744582 | doi = 10.1016/j.canlet.2007.11.027 }}</ref><ref>{{cite journal | vauthors = Nguyen H, Loustaunau C, Facista A, Ramsey L, Hassounah N, Taylor H, Krouse R, Payne CM, Tsikitis VL, Goldschmid S, Banerjee B, Perini RF, Bernstein C | title = Deficient Pms2, ERCC1, Ku86, CcOI in field defects during progression to colon cancer | journal = Journal of Visualized Experiments | issue = 41 | pages = 1931 | date = July 2010 | pmid = 20689513 | pmc = 3149991 | doi = 10.3791/1931 }} [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3149991/ 28 minute video }}</ref>

[wikiwho]

Thanks, acknowledged!

…

On 4. Dec 2018, at 20:57, Sage Ross ***@***.***> wrote: Here's another one: https://en.wikipedia.org/wiki/Colorectal_cancer <https://en.wikipedia.org/wiki/Colorectal_cancer> It stops at the first reference here, and there are a few additional editor tokens much later in the document. Maybe a problem related to the self-closing named ref? Field defects are important in progression to colon cancer.<ref name="intechopen" /><ref>{{cite journal | vauthors = Bernstein C, Bernstein H, Payne CM, Dvorak K, Garewal H | title = Field defects in progression to gastrointestinal tract cancers | journal = Cancer Letters | volume = 260 | issue = 1–2 | pages = 1–10 | date = February 2008 | pmid = 18164807 | pmc = 2744582 | doi = 10.1016/j.canlet.2007.11.027 }}</ref><ref>{{cite journal | vauthors = Nguyen H, Loustaunau C, Facista A, Ramsey L, Hassounah N, Taylor H, Krouse R, Payne CM, Tsikitis VL, Goldschmid S, Banerjee B, Perini RF, Bernstein C | title = Deficient Pms2, ERCC1, Ku86, CcOI in field defects during progression to colon cancer | journal = Journal of Visualized Experiments | issue = 41 | pages = 1931 | date = July 2010 | pmid = 20689513 | pmc = 3149991 | doi = 10.3791/1931 }} [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3149991/ 28 minute video }}</ref> — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#11 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AKMhFpMFvv2xojyrDTbZeFK--8muP3-Fks5u1tOOgaJpZM4RThey>.

[Niharika29]

FYI, I found the markup broken on https://en.wikipedia.org/wiki/Austria