owocr

OwOCR

Command line client for several Japanese OCR providers derived from Manga OCR.

Installation

This has been tested with Python 3.11 and 3.12. Newer/older versions might work. It can be installed with pip install owocr

Usage

Basic usage is comparable to Manga OCR as in, owocr keeps scanning for images and performing text recognition on them. Similarly, by default it will read images from the clipboard and write text back to the clipboard (or optionally, read images from a folder and/or write text to a .txt file if you specify -r=<folder path> or -w=<txt file path>).

Additionally:

• Scanning the clipboard takes basically zero system resources on macOS and Windows
• Supports reading images and/or writing text to a websocket with the -r=websocket and/or -w=websocket parameters (the port is 7331 by default, and is configurable in the config file)
• Supports reading images from a Unix domain socket (/tmp/owocr.sock) on macOS and Linux with -r=unixsocket
• Supports capturing the screen directly, or a portion of the screen or a specific window with -r=screencapture. By default it will read from the entire main screen every 3 seconds, but you can change it to screenshot a different screen or a portion of a screen (with a set of screen coordinates x,y,width,height) or just a specific window (with the window title). You can also change the delay between screenshots or specify a keyboard combo if you don't want screenshots to be taken periodically. Refer to the config file or to owocr --help for more details about the screen capture settings
• You can pause/unpause the image processing by pressing "p" or terminate the script with "t" or "q" inside the terminal window
• You can switch between OCR providers pressing their corresponding keyboard key inside the terminal window (refer to the list of keys in the providers list below)
• You can start the script paused with the -p option or with a specific provider with the -e option (refer to owocr -h for the list)
• Holding ctrl or cmd at any time will pause image processing temporarily, or you can specify keyboard combos in the config file to pause/unpause and switch the OCR provider from anywhere (refer to the config file or owocr -h)
• You can enable notifications in the config file or with -n to show the text with a native OS notification. Important for macOS users: if you use Python from brew, you need to enter this command in your terminal before the first notification: codesign -f -s - $(brew --cellar python)/3.*/Frameworks/Python.framework (works on Ventura/Sonoma). Older macOS versions might require Python to be installed from the official website. Nothing can be done about this unfortunately.
• Optionally, you can speed up the online providers by installing fpng-py: pip install fpng-py (requires setting up a developer environment on most operating systems/Python versions)
• Optionally, you can improve filtering of non-Japanese text for screen capture by installing transformers and sentencepiece: pip install transformers sentencepiece
• A config file (which will be automatically created in user directory/.config/owocr_config.ini, on Windows user directory is the C:\Users\yourusername folder) can be used to configure the script, as an example to limit providers (to reduce clutter/memory usage) as well as specifying provider settings such as api keys etc. A sample config file is also provided here
• For systems where text can be copied to the clipboard at the same time as images, if *ocr_ignore* is copied with an image, the image will be ignored (mostly useful for devs making their own sender tool)

Supported providers

Local providers

• Manga OCR: refer to the readme for installation ("m" key)
• EasyOCR: refer to the readme for installation ("e" key)
• RapidOCR: refer to the readme for installation ("r" key)
• Apple Vision framework: this will work on macOS Ventura or later. In my experience, the best of the local providers for horizontal text ("a" key)
• Apple Live Text (VisionKit framework): this will work on macOS Ventura or later. It should be the same as Vision except that in Sonoma Apple added vertical text reading ("d" key)
• WinRT OCR: this will work on Windows 10 or later if winocr (pip install winocr) is installed. It can also be used by installing winocr on a Windows virtual machine and running the server there (winocr_serve), and installing requests (pip install requests) and specifying the IP address of the Windows VM/machine in the config file ("w" key)

Cloud providers

• Google Lens: Google Vision in disguise (no need for API keys!), however it needs to download a couple megabytes of data for each request. You need to install pyjson5 and requests (pip install pyjson5 requests) ("l" key)
• Google Vision: you need a service account .json file named google_vision.json in user directory/.config/ and installing google-cloud-vision (pip install google-cloud-vision) ("g" key)
• Azure Image Analysis: you need to specify an api key and an endpoint in the config file and to install azure-ai-vision-imageanalysis (pip install azure-ai-vision-imageanalysis) ("v" key)

Acknowledgments

This uses code from/references these projects:

• Viola for working on the Google Lens implementation and helping with the pyobjc VisionKit code!
• @ronaldoussoren for helping with the pyobjc VisionKit code
• Manga OCR
• ocrmac for the Apple Vision framework API
• NadeOCR for the Google Vision API
• ccylin2000_lipboard_monitor for the Windows clipboard polling code