Multithreaded compression/decompression library with python bindings?

[Thomas Nyberg]

Btw if anyone knows a better way to handle this sort of thing, I'm all
ears. Given my current implementation I could use any compression that
works with stdin/stdout as long as I could sort out the waiting on the
subprocess. In fact, bzip2 is probably more than I need...I've half used
it out of habit rather than anything else.

I do personally really like the convenience of this compressed tar
archive format since I can just grab the files and run `tar xf filename`
in a terminal and get them all back again, but if there's an entirely
different and better way which allows me to stream in my fashion, I'm
certainly curious to hear about it.

Cheers,
Thomas