Skip to content

Generate training data: match an author's name in whichever spelling the page sets it - #789

Merged
de-code merged 2 commits into
mainfrom
header-correspondence-block
Nov 2, 2026
Merged

de-code merged 2 commits into
mainfrom
header-correspondence-block

Conversation

@de-code

@de-code de-code commented Nov 2, 2026 •

Copy link
Copy Markdown
Collaborator

part of https://github.com/eLifePathways/ScienceBeam2.0/issues/205

A page may set an author's name with the middle names cut to initials, Ana B. Rivera where the deposit declares Ana Beatriz Rivera. A repeat is
accepted only where every character of the declared name is there, so in the
generated header data a name set that way stayed background while the
identifier beside it carried a label. The data knew the ORCID belonged to
someone and could not say who, which is the shape a reader asked about.

An author declared with more than one given name is now looked for under the
shortened spelling as well as the declared one, and GROBID gives that
spelling a byline of its own. It costs nothing on a page that sets the names
out in full, and shortening the middle names is how a page fits a long author
list beside anything else, so what it is worth grows with the corpus.

A line of ORCIDs sets `Ana B. Rivera` where the deposit declares `Ana Beatriz
Rivera`, the same name with the middle one cut to an initial.  A repeat is
accepted only where every character of the declared name is there, so names
set that way were background while the identifiers beside them each carried a
label.  GROBID gives that spelling a byline of its own.

An author declared with more than one given name is now offered in the
shortened spelling as well, keeping the first given name in full, and is
looked for under it after the declared one.  Over what the name itself has
not already taken, because the two spellings share most of their characters
and the shortened one would otherwise be found inside the byline the declared
one holds.

The other three corpora are byte-identical.
The fixtures and the prose explaining them quoted authors, titles and
references lifted from the corpora, which names real people in a public
repository to make a point that invented names make just as well.

Every shape each test turns on is unchanged: the initials separated by a dot,
the surname the gap fill bridges, the reference split across a page break.
@de-code de-code self-assigned this Nov 2, 2026
@de-code
de-code merged commit 52eb176 into main Nov 2, 2026
6 checks passed
@de-code
de-code deleted the header-correspondence-block branch November 2, 2026 14:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant