parallel compression and decompression

I've selected a chunk size of 8000 bytes rather arbitrarily, but it
seems to work just fine. The bigger problem is that the simplified
final fraction makes the running fraction in decompression's foldl
more complicated as time goes on, making it around 50 times slower
than compression. It takes just under an hour to decompress the
Great Gatsby.
This commit is contained in:
Jack Wines 2024-12-23 08:29:31 -05:00
parent 791fff6107
commit 46749895bc
Signed by: Jack
SSH key fingerprint: SHA256:AaP2Hr/e3mEjeY+s9XJmQqAesqEms8ENRhwRkpO0WUk
3 changed files with 106 additions and 40 deletions

View file

@ -53,7 +53,9 @@ executable compress
optparse-generic,
vector,
nonempty-containers,
primes
witch,
monad-par,
monad-par-extras
default-language:
GHC2021
other-modules:
@ -63,8 +65,9 @@ executable compress
Compress.PrefixTree
Data.HuffmanTree
Compress.Arithmetic
Data.WordyMap
ghc-options:
-threaded
-fprof-auto
-fprof-late
"-with-rtsopts=-p -hc"
"-with-rtsopts=-p -hc -B -N -qa"