Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: Ibnsaid syntax trees #173

Open
wants to merge 54 commits into
base: feature/tlg2022-alignments
Choose a base branch
from
Open

WIP: Ibnsaid syntax trees #173

wants to merge 54 commits into from

Conversation

jacobwegner
Copy link
Contributor

No description provided.

jchill-git and others added 30 commits June 22, 2023 13:58
@jchill-git
Base Texts Omar Ibn Said
d01a1f0
@jchill-git
Move Ibn Said to data library
3bb6b7c
@jchill-git
git ignore venv
05fdb05
@jchill-git
Update default view
39db923
@jacobwegner
Update widget-reader package to enable RTL support for Arabic
741f10b
@jacobwegner
Update scaife-viewer-atlas for Arabic
0ad3bce
@jchill-git
Add files via upload
5bedd02
@jchill-git
Fixed English punctuation
59b2de9
@jchill-git
Section headings
b6b906d
@jchill-git
Adding "section" to line schema
6d80b3d
@jchill-git
Fixed error in English lines
a99ddbd
@jchill-git
Add files via upload
000d717
@jchill-git
Co-authored-by: Jacob Wegner <[email protected]>
f824ed5
@jchill-git
Include pages as section breaks
c0082ee
@jchill-git
Merge remote-tracking branch 'refs/remotes/upstream/feature/ibnsaid' …
cea524b 
…into feature/ibnsaid
@jchill-git
Fixed when section break coincides with page break
af2fc7f
@jchill-git
Merge branch 'feature/ibnsaid' of https://github.com/scaife-viewer/be…
5c2e490 
…yond-translation-site into feature/ibnsaid
@jchill-git
ibn said token annotation metadata file
d49baf7
@jchill-git
Initial token annotations
ede4b93
@jchill-git
Merge remote-tracking branch 'refs/remotes/upstream/feature/ibnsaid' …
53f3b15 
…into feature/ibnsaid
@jchill-git
Updating annotation heading
015d068
@jacobwegner
Merge branch 'main' into ibnsaid-tokenizer
dd0dc67 
# Conflicts:
#	backend/requirements.txt
@jacobwegner
Enable RTL support for Interlinear display
b659db1
@jacobwegner
Customize hookset for tokenization override
9c95887
@jacobwegner
Add initial syntax tree file to Git
4eb9c94
@jacobwegner
Add ogl-pdl-annotations conversion JSON
d38f63d
@jacobwegner
Add references comment
d62eb98
@jacobwegner
Manually resolve references
4deb9b4
@jacobwegner
Update JSON with references
6ed3ad5
@jacobwegner
Test improved extractor
93c1806
jacobwegner
jacobwegner commented Jan 3, 2024
View reviewed changes
Copy link
Contributor Author

@jacobwegner jacobwegner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jtauber and @jchill-git: For when you connect and get additional annotations / treebanks ingested, I tried to leave several "breadcrumbs".

backend/data/annotations/syntax-trees/amedsaid1831.dw042.perseus-eng1.json
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file is created from scaife_stack_atlas/extractors/extract_hilleary_treebanks.py

backend/data/token-overrides/amedsaid1831.dw042.perseus-ara1.csv Outdated
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added a file sent by @jchill-git in 05e5c5669eda41e75f7fb578157305d679c743be and modified it:

Update the OVERRIDES mapping to point to the file.

backend/data/raw/ibnsaid/amedsaid1831.dw042.perseus-eng1.conllu Outdated
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See changes via https://github.com/scaife-viewer/beyond-translation-site/commits/ibnsaid-syntax-trees/backend/data/raw/ibnsaid/amedsaid1831.dw042.perseus-eng1.conllu.

I added a references string as comment to each syntax tree. Multiple references would be separated via a | delimiter.

@jacobwegner jacobwegner changed the base branch from main to feature/tlg2022-alignments January 3, 2024 18:46
jacobwegner
jacobwegner commented Jan 3, 2024
View reviewed changes
Copy link
Contributor Author

@jacobwegner jacobwegner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Breadcrumbs for Valeria's annotations

backend/data/annotations/text-alignments/boano-balex-word-alignment.json
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See scaife_stack_atlas/extractors/extract_boano_bellum_word_alignments.py and 676cff9

backend/scaife_stack_atlas/extractors/download_files_from_ugarit.py Outdated
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Used to populate the data for scaife_stack_atlas/extractors/extract_boano_bellum_word_alignments.py

backend/data/annotations/syntax-trees/phi0428.phi001.dll-ed-lat1.json
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See scaife_stack_atlas/extractors/extract_boano_treebanks.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@jacobwegner @jchill-git @scaife-viewer-service-account