pyeio
Short for Py
thon E
asy I
nput O
utput, pyeio
is a python library meant to simplify file IO processes.
This is currently very unstable, but the idea is to capture as much functionality as possible, consolidate it, simplify it, minimize dependencies (further down the line) and optimize stuff with rust.
In addition to a python library, it also comes with a CLI - currently very restricted but somewhat optimized, intended to replicate functionality found across other system utilities and CLIs.
For instance, to count the number of lines in a 15 GB items.jsonl
file one could run:
wc -l items.jsonl
Which takes 12.03s to run (on my machine). Alternatively:
eio wc -l items.jsonl
Which runs in 1.14s.
I suspect things will be very unstable for another few months.