
Security News
TypeScript is Porting Its Compiler to Go for 10x Faster Builds
TypeScript is porting its compiler to Go, delivering 10x faster builds, lower memory usage, and improved editor performance for a smoother developer experience.
Document Layout Analysis with Deep Learning and Heuristics
:warning: Development is currently focused on achieving the best possible quality of results for a wide variety of historical documents and therefore processing can be very slow. We aim to improve this, but contributions are welcome.
Python 3.8-3.11
with Tensorflow 2.12-2.15
on Linux are currently supported.
For (limited) GPU support the CUDA toolkit needs to be installed.
You can either install from PyPI
pip install eynollah
or clone the repository, enter it and install (editable) with
git clone git@github.com:qurator-spk/eynollah.git
cd eynollah; pip install -e .
Alternatively, you can run make install
or make install-dev
for editable installation.
Pre-trained models can be downloaded from qurator-data.de or huggingface.
🚧 Work in progress
In case you want to train your own model, have a look at sbb_pixelwise_segmentation
.
The command-line interface can be called like this:
eynollah \
-i <single image file> | -di <directory containing image files> \
-o <output directory> \
-m <directory containing model files> \
[OPTIONS]
The following options can be used to further configure the processing:
option | description |
---|---|
-fl | full layout analysis including all steps and segmentation classes |
-light | lighter and faster but simpler method for main region detection and deskewing |
-tab | apply table detection |
-ae | apply enhancement (the resulting image is saved to the output directory) |
-as | apply scaling |
-cl | apply contour detection for curved text lines instead of bounding boxes |
-ib | apply binarization (the resulting image is saved to the output directory) |
-ep | enable plotting (MUST always be used with -sl , -sd , -sa , -si or -ae ) |
-ho | ignore headers for reading order dectection |
-si <directory> | save image regions detected to this directory |
-sd <directory> | save deskewed image to this directory |
-sl <directory> | save layout prediction as plot to this directory |
-sp <directory> | save cropped page image to this directory |
-sa <directory> | save all (plot, enhanced/binary image, layout) to this directory |
If no option is set, the tool performs layout detection of main regions (background, text, images, separators and marginals). The best output quality is produced when RGB images are used as input rather than greyscale or binarized images.
🚧 Work in progress
Eynollah ships with a CLI interface to be used as OCR-D processor.
In this case, the source image file group with (preferably) RGB images should be used as input like this:
ocrd-eynollah-segment -I OCR-D-IMG -O SEG-LINE -P models
Any image referenced by @imageFilename
in PAGE-XML is passed on directly to Eynollah as a processor, so that e.g.
ocrd-eynollah-segment -I OCR-D-IMG-BIN -O SEG-LINE -P models
uses the original (RGB) image despite any binarization that may have occured in previous OCR-D processing steps
Please check the wiki.
If you find this tool useful in your work, please consider citing our paper:
@inproceedings{hip23rezanezhad,
title = {Document Layout Analysis with Deep Learning and Heuristics},
author = {Rezanezhad, Vahid and Baierer, Konstantin and Gerber, Mike and Labusch, Kai and Neudecker, Clemens},
booktitle = {Proceedings of the 7th International Workshop on Historical Document Imaging and Processing {HIP} 2023,
San José, CA, USA, August 25-26, 2023},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
year = {2023},
pages = {73--78},
url = {https://doi.org/10.1145/3604951.3605513}
}
FAQs
Document Layout Analysis
We found that eynollah demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
TypeScript is porting its compiler to Go, delivering 10x faster builds, lower memory usage, and improved editor performance for a smoother developer experience.
Research
Security News
The Socket Research Team has discovered six new malicious npm packages linked to North Korea’s Lazarus Group, designed to steal credentials and deploy backdoors.
Security News
Socket CEO Feross Aboukhadijeh discusses the open web, open source security, and how Socket tackles software supply chain attacks on The Pair Program podcast.