Data

Exchange formats

JSON Lines is the stored format. mcparser align import and mcparser align export convert to and from Pharaoh/Ugarit text (0-0S 1-2P, one line per pair, 0- or 1-based) and YAML (sent_id: 1-1S 2-3P); see MCParser’s documentation. Gold standards that come as raw text plus links (for example the Greek-Latin one) need the tokens of the parsed CoNLL-U files, which can differ from the gold’s tokens. Map the gold’s tokens onto the parsed words by character position (a link goes to every parsed word that overlaps the gold token) and keep the segmentation fixed afterwards.

Alignments from an earlier LLM run (for example the old Ephesians YAML) are silver: use them as read-only evidence, not as gold.

The translation table

Code (the rules, the prompt evidence, the lexicon export) counts translations with TranslationTable: for every lemma of every aligned source, which lemmas of the other source its words are linked to, built in one pass over the sets. A word’s lemma falls back to its form. Counts are kept per sentence, so the sentence being aligned is always left out of its own evidence. Agents can ask the same question through the MCP tool translation_candidates.