german-brazilian-newspapers-dataset_2
The GBN Dataset consists German-Brazilian historical newspapers, along with their digital and binarized images and ground truth files.
https://github.com/lemmbraalemao-dpb/german-brazilian-newspapers-dataset_2
Science Score: 44.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (4.6%) to scientific vocabulary
Keywords
Keywords from Contributors
Repository
The GBN Dataset consists German-Brazilian historical newspapers, along with their digital and binarized images and ground truth files.
Basic Info
- Host: GitHub
- Owner: Lemmbraalemao-DPB
- License: cc-by-sa-4.0
- Default Branch: main
- Homepage: https://tboenig.github.io/German-Brazilian-Newspapers-Dataset_2
- Size: 555 MB
Statistics
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
- Releases: 7
Topics
Metadata Files
README.md
German-Brazilian-Newspapers-Dataset Part 2
The GBN Dataset consists from four different German-Brazilian historical newspapers, along with their digital and binarized images and ground truth files. The GBN-Dataset Corpus consists of two parts. The parts are designated numerically. German-Brazilian-Newspapers-Dataset_1 = Part 1, German-Brazilian-Newspapers-Dataset_2 = Part 2. It is a dataset created for evaluation of layout analysis methods.
Metadata
- Language:
- deu
- Format:
- Page-XML
- Time:
- 1863-1880
- GT Type:
- data_structure
- License:
- PublicDomainMark 1.0
- Project:
- German-Brazilian Newspapers (GBN)
- Project-URL:
- https://web.inf.ufpr.br/vri/databases/gbn/
Sources
The volume of transcriptions:
| TxtRegion | ImgRegion | LineDrawRegion | GraphRegion | TabRegion | ChartRegion | SepRegion | MathRegion | ChemRegion | MusicRegion | AdRegion | NoiseRegion | UnkownRegion | CustomRegion | TextLine | Page |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1967 | 0 | 0 | 95 | 0 | 0 | 467 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 34 |
List of transcriptions
| document | TxtRegion | ImgRegion | LineDrawRegion | GraphRegion | TabRegion | ChartRegion | SepRegion | MathRegion | ChemRegion | MusicRegion | AdRegion | NoiseRegion | UnkownRegion | CustomRegion | TextLine | Page |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| KolonieZeitung | 752 | 57 | 256 | 17 | ||||||||||||
| DerPionier | 1215 | 38 | 211 | 17 |
About
The GBN Dataset (German-Brazilian historical Newspapers Dataset)
The GBN Dataset (Part 1 and Part 2)[1] consists of 102 page images from eight different German-Brazilian historical newspapers, along with their binarized images and ground files. It is a dataset created for evaluation of layout analysis methods.
Complex layouts, poor preservation conditions of the paper, old spelling, different font sizes and the presence of multiple languages in the same page are some of the challenges of historical newspaper layout analysis that are present in the GBN Dataset. There are also pages with a slightly transparent paper and some blurs, which makes the dataset more challenging.
The dataset samples belong to the dbp digital collection from the dokumente.br initiative which has as one of the goals to digitally reconstruct the complete collection of these newspapers.
The pages of eight different newspaper titles were scanned at 600 dpi and are available in PNG format. The following table shows the composition and distribution of these images from the dataset.
| Newspaper Title | Publishing date | Script | Language | Image size (in pixels) |
| “Der Gemeindebote” | 1935-1938 | Fraktur | German | 3850 x 5480 |
| “Der Jugendfreund” | 1911-1917 | Fraktur | German | from 2650 x 3950 to 5320 x 8050 |
| “Der Pioner” | 1888-1891 | Fraktur / Latin | Portuguese / German | 7100 x 10590 |
| “Der Sandwirt” | 1934-1940 | Fraktur | German | 4250 x 6020 |
| “Evangelissch-Lutherisches Kirchenblatt” | 1916-1919 | Fraktur | German | 2590 x 3690 |
| “Kolonie Zeitung” | 1863-1889 | Fraktur / Latin | Portuguese / German |
5470 x 7010 6700 x 8400 7050 x 9300 |
| “Gemeindeblatt” | 1938 | Fraktur | German | 3850 x 5870 |
| “Heimatbote” | 1936 | Fraktur | German | 3850 x 5480 |
The GBN Dataset is composed of:
- grayscale images of the pages;
- ground truth files for each of them (XML PAGE[2]).
The XML PAGE files were produced with the Aletheia software and contain the geometric representation of different classes (e.g. text, image, graphic or separator regions) of each region of the page.
How to obtain the origin Dataset
The GBN dataset is released for academic research only and is free to researchers from educational or research institutes for non-commercial purposes.
Training GBN v1.0 Dataset: training-GBNv1.zip
References
- Araujo, A. B. “Análise de layout de página em jornais históricos germano-brasileiros,” Federal University of Paraná, Curitiba, 2019. https://acervodigital.ufpr.br/handle/1884/63706
- Pletschacher, S. and Antonacopoulos, A. “The PAGE (Page Analysis and Ground-Truth Elements) Format Framework,” in IEEE 20th International Conference on Pattern Recognition (ICPR), 2010, pp. 257–260.
Contact
Please contact Alessandra Belézia Araujo (alessandra.belezia@ufpr.br) with questions or comments.
Owner
- Name: Lemmbraalemao-DPB
- Login: Lemmbraalemao-DPB
- Kind: organization
- Website: https://lemmbraalemao.ufpr.br/
- Repositories: 2
- Profile: https://github.com/Lemmbraalemao-DPB
Citation (CITATION.cff)
cff-version: 1.2.0
title: German-Brazilian-Newspapers-Dataset Part 2
message: If you use this dataset, please cite it using the metadata from this file.
type: dataset
authors:
- given-names: Alessandra
family-names: Belézia Araujo
orcid: 0000-0001-5993-288X
- given-names: Matthias
family-names: Boenig
orcid: 0000-0003-4615-4753
repository-code: 'https://github.com/tboenig/German-Brazilian-Newspapers-Dataset_2'
url: 'https://github.com/tboenig/German-Brazilian-Newspapers-Dataset_2'
abstract: |-
The GBN Dataset consists from four different German-Brazilian historical newspapers, along with their digital and binarized images and ground truth files. The GBN-Dataset Corpus consists of two parts. The parts are designated numerically. German-Brazilian-Newspapers-Dataset_1 = Part 1, German-Brazilian-Newspapers-Dataset_2 = Part 2. It is a dataset created for evaluation of layout analysis methods.
keywords:
- ocr-d
- repository
- segmentation
- ground-truth
- data_structure
license: PublicDomainMark 1.0
commit: t1.1.5
version: 6_t1.1.5
date-released: '2024-2-8'
GitHub Events
Total
Last Year
Committers
Last synced: 10 months ago
Top Committers
| Name | Commits | |
|---|---|---|
| Matthias Boenig | m****g@g****t | 14 |
| github-actions[bot] | 4****] | 9 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 10 months ago
All Time
- Total issues: 0
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 0
- Total pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels
Dependencies
- JamesIves/github-pages-deploy-action v4.4.1 composite
- actions/checkout v3 composite
- mikefarah/yq master composite
- ncipollo/release-action v1 composite
- thedoctor0/zip-release master composite
- JamesIves/github-pages-deploy-action v4.4.1 composite
- actions/checkout v4 composite
- mikefarah/yq master composite
- ncipollo/release-action v1 composite
- thedoctor0/zip-release master composite