From 0e170aaac54f691771085fac207a560b0b8835e9 Mon Sep 17 00:00:00 2001 From: Curtis Chong Date: Mon, 13 Apr 2026 14:28:38 -0400 Subject: [PATCH 1/2] Update link to point to abstract --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 5c29e93..5dd9387 100644 --- a/README.md +++ b/README.md @@ -3,7 +3,7 @@ [![PyPI](https://img.shields.io/pypi/v/litxbench?logo=pypi&logoColor=white)](https://pypi.org/project/litxbench) [![LitXAlloy](https://img.shields.io/endpoint?url=https://radical-ai.github.io/litxbench/litxalloy-badge.json)](https://radical-ai.github.io/litxbench) -LitXBench is a benchmark to evaluate LLMs on extracting material information synthesized in research papers. Read the preprint [here](https://arxiv.org/pdf/2604.07649). +LitXBench is a benchmark to evaluate LLMs on extracting material information synthesized in research papers. Read the preprint [here](https://arxiv.org/abs/2604.07649).

LitXBench Principles for Accurate Extraction and Benchmarking. (1) To accurately capture a material’s properties, measurements must be linked to its processing lineage, rather than just its composition. (2) Categorical values should be mapped to canonical values to disambiguate similar values, as multiple papers may reference different properties with the same term. (3) Extracted materials are more editable and auditable when represented as code, reducing errors in the benchmark. From b5f90ccfced716714c2ce315712267775a3a2885 Mon Sep 17 00:00:00 2001 From: Curtis Chong Date: Mon, 13 Apr 2026 14:30:13 -0400 Subject: [PATCH 2/2] update more to abstract --- docs/_templates/sidebar/explorer-link.html | 2 +- docs/index.rst | 4 ++-- docs/user/introduction.rst | 2 +- 3 files changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/_templates/sidebar/explorer-link.html b/docs/_templates/sidebar/explorer-link.html index a6b0862..5db2e92 100644 --- a/docs/_templates/sidebar/explorer-link.html +++ b/docs/_templates/sidebar/explorer-link.html @@ -10,7 +10,7 @@ GitHub

  • - Paper + Paper
    • diff --git a/docs/index.rst b/docs/index.rst index 4e80e45..c59b425 100644 --- a/docs/index.rst +++ b/docs/index.rst @@ -10,7 +10,7 @@ LitXBench @@ -209,7 +209,7 @@ LitXBench diff --git a/docs/user/introduction.rst b/docs/user/introduction.rst index ab9f85b..1b7ccda 100644 --- a/docs/user/introduction.rst +++ b/docs/user/introduction.rst @@ -6,7 +6,7 @@ It ships with **LitXAlloy**, a dense benchmark of 1426 measurements from 19 allo with evaluation tools to measure how well an extraction method captures the materials, processes, and measurements reported in a paper. -| `GitHub `_ | `PyPI `_ | `Paper `_ | +| `GitHub `_ | `PyPI `_ | `Paper `_ | Installation ------------