Best Compression Methods for 'Specific' Games. Q&A

[KaktoR]

WRC Generations - The FIA WRC Official Game

lz4f,l10

CHUNK_1.PKG

Compressed 1 file, 230,225,845 => 356,636,013 bytes. Ratio 154.91%
Compression time: cpu 0.25 sec/real 5.90 sec = 4%. Speed 39.00 mB/s
All OK

[KaktoR]

The Entropy Centre

zlib. There is a key but however it seems you don't need it at all.

[KaktoR]

Are you sure?

xtool:reflate:d1:ue4,k0x72463A7B70FA819E286295CF74C280AC7C928D0BCB349CF811CAF1AE27780A41
Compressed 1 file, 11,896,018,323 => 22,955,933,549 bytes. Ratio 192.97%
Compression time: cpu 6.00 sec/real 496.69 sec = 1%. Speed 23.95 mB/s
All OK

xtool:reflate
Compressed 1 file, 11,896,018,323 => 23,008,806,166 bytes. Ratio 193.42%
Compression time: cpu 5.69 sec/real 566.02 sec = 1%. Speed 21.02 mB/s
All OK

[Masquerade]

FModel gave me this output for most files

[KaktoR]

Maybe it's the xtool plugin. I will test with ue4d

[Wanterlude]

Originally Posted by Masquerade

You will need the key. Most files are compressed + encrypted.

The Entropy Centre (v.1.0.7) (GOG)

xtool(zlib)+srep+lolz - 7.83 GB
ue4d+xtool(zlib)+srep+lolz - 7.92 GB

zlib
Compressed 1 file, 11,896,018,323 => 22,940,077,806 bytes. Ratio 192.84%
Compression time: cpu 9.69 sec/real 157.83 sec = 6%. Speed 75.37 mB/s

ue4d+zlib
Compressed 1 file, 11,896,018,323 => 22,517,092,816 bytes. Ratio 189.28%
Compression time: cpu 166.56 sec/real 266.32 sec = 63%. Speed 44.67 mB/s

[Masquerade]

Sorry for that mix up and thanks for the corrections KaktoR and Waterlude

[kuyhaa]

HARVESTELLA

kraken+zlib+ue4

key

0xAA07B9EF2AD5A0F2C1299355B0760B2808F11038753D5959 D5CA0923A6EE44A5

Harvestella-WindowsNoEditor.ucas

Streams: 190379/194399194420
Time: 00:09:15 (02:01:43)
Memory: 520 MB (520 MB)

100.0%
Errorlevel=0

Compressed 1 file, 10,680,406,976 => 26,584,688,310 bytes. Ratio 248.91%
Compression time: cpu 195.23 sec/real 857.13 sec = 23%. Speed 12.46 mB/s
All OK

[dixen]

Sackboy: A Big Adventure (2nd repack)

*.pak - XTool v0.65 + unreal.dll + SREP + LOLZ

Compressed 20 files, 56,772,715,077 => 19,317,821,479 bytes. Ratio 34.03%
Compression time: cpu 159.44 sec/real 18183.77 sec = 1%. Speed 3.12 mB/s
All OK

Test

Tested 20 files, 19,317,821,479 => 56,772,715,077 bytes. Ratio 34.03%
Testing time: cpu 6.55 sec/real 263.93 sec = 2%. Speed 215.11 mB/s
All OK

No used precompress function, decrypt .pak only

[Razor12911]

Burnout Paradise Remastered

-mxzlib+srep+fl2

Compressed 8,468 files, 7,752,954,658 => 3,415,874,982 bytes. Ratio 44.06%
Compression time: cpu 5.81 sec/real 237.31 sec = 2%. Speed 32.67 mB/s

7,21 GB >> 3.18 GB

Need For Speed Hot Pursuit Remastered

-m0

UI\MOVIES
UI\MOVIES_4K

Use store compression, bpk fails on a lot of videos


-mxzlib+srep+fl2

Compressed 20,498 files, 15,721,041,999 => 3,315,144,330 bytes. Ratio 21.09%
Compression time: cpu 12.61 sec/real 277.57 sec = 5%. Speed 56.64 mB/s

on the rest of the files

34.8 GB >> 23.2 GB w/ 4K videos
22,2 GB >> 10.7 GB w/o 4K videos

[KaktoR]

DOOM Eternal

I made some tests but couldn't find the correct oodle library. Maybe someone find this usefull.

gameresources_0_2.streamdb

oo2core_4_win64_v3 712/1283 Ratio 126.48%
oo2core_6_win64    312/1283 Ratio 101.85%
oo2core_7_win64_v1 650/1283 Ratio 148.50%
oo2core_7_win64_v2 710/1283 Ratio 126.35%
oo2core_7_win64_v3 650/1283 Ratio 148.50%
oo2core_7_win64_v4 759/1283 Ratio 168.52%
oo2core_7_win64_v5 712/1283 Ratio 126.48%
oo2core_7_win64_v6 650/1283 Ratio 148.50%
oo2core_8_win64_v1 759/1283 Ratio 168.52%
oo2core_8_win64_v2 710/1283 Ratio 126.35%
oo2core_8_win64_v3 712/1283 Ratio 126.48%
oo2core_8_win64_v4 759/1283 Ratio 168.52%
oo2core_8_win64    759/1283 Ratio 168.52% (Days Gone (Special Libraries))
oo2core_9_win64_v1 710/1283 Ratio 126.35%
oo2core_9_win64_v2 45/1283  Ratio 100.08%

Side note: The suspicion is obvious that "oo2core_4_win64_v3" is in fact at least "oo2core_7_win64". Stream count, Ratio and file size speaks for itself I think. But I have only tested on this single sample and this should not be used as an evidence at all. Libraries from this post.

[Razor12911]

Doom Eternal uses two libraries on this file however I'm not sure if this applies to the whole game.

oo2core_7_win64.dll -> 283 MB > 421 MB (691/1332)
oo2core_8_win64.dll -> 283 MB > 479 MB (790/1332)

For some reasons, streams that can be processed 7 cannot be processed by 8 and visa versa.

However if you precompress the game using both libraries one after the other you get

283 MB > 421 MB > 614 MB

The second pass using oo2core_8_win64.dll processed the remaining streams (640/640).

This is part of the reason I added --oodle= parameter in xtool, to allow you to specify exactly what library you want to use.

[External compressor:doom7]
header    = 0
packcmd   = xtool.exe precomp -mkraken,l6,n256 -c32mb -t50p --oodle=oo2core_7_win64.dll - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p --oodle=oo2core_7_win64.dll - - <stdin> <stdout>

[External compressor:doom8]
header    = 0
packcmd   = xtool.exe precomp -mkraken,l6,n256 -c32mb -t50p --oodle=oo2core_8_win64.dll - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p --oodle=oo2core_8_win64.dll - - <stdin> <stdout>

Your arc.ini then looks like this then you run the method

-mdoom7+doom8

[KaktoR]

HARVESTELLA

 09:53:02 - Selected ARC/DS method for Data1a-01.bin was: xtool:mue4,k0xAA07B9EF2AD5A0F2C1299355B0760B2808F11038753D5959D5CA0923A6EE44A5:mkraken,l5:9+srep+4x4:lzma
 09:53:02 - Selected ARC/DS method for Data1b-01.bin was: srep+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 10:39:44 - Overall input size: 10.65 GB
 10:39:44 - Overall output size: 8.45 GB (Ratio 79.31%)
 10:39:44 - Overall conversion time: 00:46:40
-------------------------------------------------------------------------------------------------------------------------------------------
 10:49:06 - Overall decompression time: 00:08:08
 10:49:06 - All files have been successfully extracted!

Use oo2core_9_win64 in attachment to get all streams.

PS: You can use reflate on pak file to get additional ~20mb inflation.

[panker1992]

Elden Ring is also one more game that uses 2 different oodle libraries to have 100% coverage of streams.

its best to create a massive batch to process combinations of libraries

[Masquerade]

Originally Posted by panker1992

Elden Ring is also one more game that uses 2 different oodle libraries to have 100% coverage of streams.

Which libraries are best for this game?