Skip to content

Update separate eval-predictions repo with results#611

Merged
de-code merged 4 commits into
mainfrom
push-to-separate-eval-predictions-repo
May 26, 2026
Merged

Update separate eval-predictions repo with results#611
de-code merged 4 commits into
mainfrom
push-to-separate-eval-predictions-repo

Conversation

@de-code
Copy link
Copy Markdown
Collaborator

@de-code de-code commented May 26, 2026

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 26, 2026

ScienceBeam Parser Evaluation

biorxiv

sciencebeam-parser:main-2d2f428d-20260526.1632: 9 docs | sciencebeam-parser:pr-611-8d79368a-20260526.1841: 9 docs

Field (method) Type sciencebeam-parser:main-2d2f428d-20260526.1632 sciencebeam-parser:pr-611-8d79368a-20260526.1841 Δ sciencebeam-parser:main-2d2f428d-20260526.1632
title (exact) string 0.941 0.941 +0.000
title (levenshtein) string 0.941 0.941 +0.000
title (edit_sim) string 0.944 0.944 +0.000
abstract (levenshtein) string 0.364 0.364 +0.000
abstract (edit_sim) string 0.541 0.541 +0.000
author_full_names (levenshtein) partial_ulist 0.962 0.962 +0.000
author_full_names (edit_sim) partial_ulist 0.926 0.926 +0.000
affiliation_text (levenshtein) partial_ulist 0.907 0.907 +0.000
affiliation_text (edit_sim) partial_ulist 0.891 0.891 +0.000
keywords (levenshtein) partial_ulist 0.000 0.000 +0.000
keywords (edit_sim) partial_ulist 0.000 0.000 +0.000
body_section_titles (levenshtein) partial_list 0.819 0.819 +0.000
body_section_titles (edit_sim) partial_list 0.764 0.764 +0.000
acknowledgement (levenshtein) string 0.875 0.875 +0.000
acknowledgement (edit_sim) string 0.871 0.871 +0.000
first_reference_text (levenshtein) string 0.875 0.875 +0.000
first_reference_text (edit_sim) string 0.870 0.870 +0.000
reference_title (levenshtein) partial_list 0.291 0.291 +0.000
reference_title (edit_sim) partial_list 0.343 0.343 +0.000
reference_doi (levenshtein) partial_ulist 0.860 0.860 +0.000
reference_doi (edit_sim) partial_ulist 0.775 0.775 +0.000

@de-code de-code marked this pull request as ready for review May 26, 2026 20:00
@de-code de-code merged commit 56a2d45 into main May 26, 2026
7 checks passed
@de-code de-code deleted the push-to-separate-eval-predictions-repo branch May 26, 2026 20:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant