Best Compression Methods for 'Specific' Games. Q&A

[KaktoR]

Stellaris
v3.6.0, incl all DLC, Soundtrack

 15:22:36 - Selected ARC/DS method for Data1a-01.bin was: xtool:mreflate+msc_tak+oggre
 15:22:36 - Selected ARC/DS method for Data1b-01.bin was: msc_tak
 15:22:36 - Selected ARC/DS method for Data1c-01.bin was: oggre
 15:22:36 - Selected ARC/DS method for Data1d-01.bin was: xtool:db:-dedup=3+lolz:d128m:mtt1:mt12:mc1023
 15:22:36 - Selected ARC/SPLIT method for Data1e-01.bin was: xtool:db:-dedup=3+lolz:d128m:mtt1:mt12:mc1023/$mp3pack=mpzmt/$deflatepack=xtool:mpreflate:mpng:d1:db:-dedup=3+lolz:d128m:mtt1:mt12:mc1023/$textpack=xtool:db:-dedup=3+lzma:a1:mfbt4:256m:fb273:mc1000000000:lc8
-----------------------------------------------------------------------------------------
 16:48:10 - Overall input size: 16.69 GB
 16:48:10 - Overall output size: 6.46 GB (Ratio 38.71%)
 16:48:10 - Overall conversion time: 01:25:32

Data1a = *.zip
Data1b = *.wav
Data1c = *.ogg
Data1d = *.dds
Data1e = rest of the files

[KaktoR]

Mount & Blade II Bannerlord

Seems like tpac files use lz4hc level 12. On this level you will get low streams but output is much bigger then with other levels.

Compressed 1 file, 7,120,255 => 14,068,315 bytes. Ratio 197.58%
Compression time: cpu 0.00 sec/real 30.88 sec = 0%. Speed 0.23 mB/s
All OK

However it is slow af

[KaktoR]

Assassin's Creed Valhalla
v1.6.2, 1 language, all DLC

 10:59:07 - Selected ARC/DS method for Data1a-01.bin was: xtool:manvil:8+xtool:db:-dedup=3+4x4:lzma
 10:59:07 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:-dedup=3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 16:29:11 - Overall input size: 143.49 GB
 16:29:11 - Overall output size: 50.14 GB (Ratio 34.94%)
 16:29:11 - Overall conversion time: 05:29:24

[kj911]

Sorry from bumping the old post.

Originally Posted by JRD!

Here is: dlz_v0.2.2b.7z

The "dlz_unpack.exe" file its works?? Required special commands or any from decompression natively packed any data in used dlz_x86/64 executables without FreeArc? (aka ex: Bink_(un)pack or oggre_enc/dec...) Tested from Win XP x32 and Win7 SP1 x64 and crashing now. The CLS filter its works with FreeArc/Unarc usage.

[KaktoR]

The Callisto Protocol

Compressed 2 files, 6,558,206,036 => 13,302,561,746 bytes. Ratio 202.84%
Compression time: cpu 2.78 sec/real 243.09 sec = 1%. Speed 26.98 mB/s
All OK

reflate
0x1958456F8B54A02D25DF32327C57C9D20DFCF7E948967D08 CFB48E8EBC65BEEB

Edit: Seems like you don't need the key. Without the key the output is the same.

[L33THAK0R]

Originally Posted by Gehrman

Is there a way to control memory usage during decompression in SREP.exe?

LAST MINUTE EDIT: Just realized you're talking about using xtool's srep functionality, so not sure if this is useful at all

I use the following settings in my "CLS.ini" file, I do use the CLS version of Srep for decompression so not sure if that would have any impact if you're using a non-CLS package.

[Srep]
Bufsize=24m
transfer_ReadBufSize=512k
transfer_WriteBufSize=512k
Memory=60%-2048m
TempPath={app}

[Srep_new]
Bufsize=24m
transfer_ReadBufSize=512k
transfer_WriteBufSize=512k
Memory=60%-2048m
TempPath={app}

[abror]

please tell me the best compress method for gta 5 game. I am using Cesar82 Diskpan Gui

[Cesar82]

Originally Posted by abror

please tell me the best compress method for gta 5 game. I am using Cesar82 Diskpan Gui

DiskSpan GUI has compression preset in DATABASE for this game, just load the preset.

[KaktoR]

Anno 1800
v16.0, incl all DLC, all languages, artbook, ost

 21:12:27 - Selected ARC/DS method for Data1a-01.bin was: xtool:mflac+xtool:mpreflate+xtool:db:-dedup=3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 21:12:27 - Selected ARC/SPLIT method for Data1b-01.bin was: xtool:db:dedup=3+razor_mtx/$mp3pack=mpzmt
-----------------------------------------------------------------------------------------
 23:12:09 - Overall input size: 86.73 GB
 23:12:09 - Overall output size: 31.42 GB (Ratio 36.23%)
 23:12:09 - Overall conversion time: 01:59:41

>> Unpacking finished successfully!

Edit: Method changed from "reflate" to "preflate" because of crc errors on file data13.rda

[Masquerade]

@KaktoR
You can patch out the bink videos with XTool erase and squeeze the size down with bpk too

[KaktoR]

@Masquerade
I know. bk2 files are spread all over inside many files and I for myself are just to lazy to do it

[abror]

Originally Posted by Cesar82

DiskSpan GUI has compression preset in DATABASE for this game, just load the preset.

thank you, do you know how to make the game install process not take long.
I have compressed the gta 5 game using the method that is in the database but during install (unpack) it takes very long around 5-7 hours

[KaktoR]

Halo The Master Chief Collection
v1.3065.0.0 (7th December 2022), ripped multiplayer

 17:02:27 - Selected ARC/DS method for Data1a-01.bin was: bpk+xtool:db:-dedup=3
 17:02:27 - Selected ARC/DS method for Data1b-01.bin was: xtool:c128mb:mpreflate:db:-dedup=3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 17:02:27 - Selected ARC/DS method for Data1c-01.bin was: xtool:db:-dedup=3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
-----------------------------------------------------------------------------------------
 19:06:36 - Overall input size: 103.82 GB
 19:06:36 - Overall output size: 64.34 GB (Ratio 61.97%)
 19:06:36 - Overall conversion time: 02:04:07

>> Unpacking finished successfully!

---

Data1b:
halo1\prebuild\shaders_2_cache\prebuild\*.sdc
halo2\prebuild\shaders_2_cache\prebuild\*.sdc
halo2\preload\paks\*.pck
halo2\h2_maps_win64_dx11\*.map
halo2\h2_maps_win64_dx11\textures.dat
halo3\maps\*.map
halo3odst\maps\*.map
halo4\maps\*.map
haloreach\maps\*.map
mcc\Content\Paks\*.pak
data\ui\Screens\*.gfx

With reflate you will get a crc error on "MCC-WindowsNoEditor.pak" file. Seems there are lz4 streams too but couldn't process any of them properly (also look in "Data\ui\texturepacks" folder). With old xtool the output is same as reflate option (~1gb smaller) but I prefer speed

128mb chunk size is the sweet spot here. However you will get some additional mb on 256mb.

bpk output is 22.5 GB, with srep 21.5 GB (many video stream duplicates).

[KaktoR]

Crisis Core - Final Fantasy VII - Reunion

pak/ucas -> kraken
Use oo2core v2.9.6

Edit: Ok seems like zlib/reflate is in there too. What a weird mess I made, sorry

pakchunk0-WindowsNoEditor.pak

156mb -> 175mb (kraken) -> 199mb (reflate)

Edit 2:
pakchunk1-WindowsNoEditor.pak has no kraken streams, but only reflate.

Edit 3:
pakchunk5-WindowsNoEditor.pak, pakchunk6-WindowsNoEditor.pak -> seems like only usm video
pakchunk4-WindowsNoEditor.pak -> sounds

[Masquerade]

Crisis Core - Final Fantasy VII - Reunion UCAS contains encrypted Kraken streams but the UnrealDB creator does not work for this game and requires an update.