You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Spotted while smoke-testing GROBID on two papers as preconditions for #16:
Historical (1982 NSE OCR'd, 28 refs): 0 references have DOIs (pre-DOI era).
Modern (Raj et al. 2022, Annals of Nuclear Energy, 38 refs): only 1 reference has an extractable DOI.
Both cases break the planned DOI-only matching strategy in #16. Pre-DOI literature is unmatched by definition; modern papers fail because GROBID's reference parser doesn't reliably extract DOI strings from the printed bibliography even when the cited works do have DOIs (Crossref-style enrichment isn't part of processFulltextDocument).
If we ship #16 with DOI-only matching, the citation graph will be sparse for both ends of the corpus — exactly the regimes where it would be most useful. ORPHEUS-relevant historical literature on collision probabilities, transport approximations, etc. won't link at all.
GROBID 0.8.1 has consistent per-paper output but the DOI-extraction recall in references is the documented weak point. Crossref reverse-lookup by reference text is an option (POST /works?query.bibliographic=...) but adds an external dependency and quota.
Spotted while smoke-testing GROBID on two papers as preconditions for #16:
Both cases break the planned DOI-only matching strategy in #16. Pre-DOI literature is unmatched by definition; modern papers fail because GROBID's reference parser doesn't reliably extract DOI strings from the printed bibliography even when the cited works do have DOIs (Crossref-style enrichment isn't part of
processFulltextDocument).Implication for #16
If we ship #16 with DOI-only matching, the citation graph will be sparse for both ends of the corpus — exactly the regimes where it would be most useful. ORPHEUS-relevant historical literature on collision probabilities, transport approximations, etc. won't link at all.
Sketch of fuzzy fallback
For each parsed reference:
dedupvenue-canonicalization (if any).Acceptance
citations.fuzzy_match(ref, doi_to_id, title_to_id, ...)that returns an item_id or None.citations.buildas a fallback when DOI lookup misses.Notes
/works?query.bibliographic=...) but adds an external dependency and quota.monogr/titlewhenanalytic/titleis empty) makes title-based fuzzy matching meaningfully more robust on historical references.