15:39:21flip768yeah, the threads hang, waiting for 0 bytes of data coming in
15:39:42flip768so with a few times you can either block all threads or crash the machine with OOM
15:42:51stassats`doesn't hunchentoot spin 100 threads at the most or something like that?
15:43:30stassats`and, well, anything can stop sending data
19:11:45|3b|flip768: that comment is about decompressing from a stream, 3bz decompresses from normal files reasonably quickly using mmap. 3bz doesn't currently have an API for reading the decompressed data as a stream, but that does sound useful, will consider adding that at some point
19:13:21|3b|from the profile you pasted, it looks like mostly gray-stream overhead, not sure if i'd be able to avoid that if i added it to 3bz though
19:15:24|3b|does seem to be lots of room for improvement in that profile at least