Best Compression Methods for 'Specific' Games. Q&A

[KaktoR]

Originally Posted by darkwolves

WWE 2K19
the oodle precompressor from Razor12911 was used in this repack
https://fileforums.com/showthread.php?t=102453

method
converted all bk2 to bik with a bk2 file extension so the game recognizes it
and to avoid bpk compression errors bitrate is the same so the video is lossless due to that
oo2reck+srep+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd1:mtt 1:mt4:d100m:tt4 h14:fba4096:mc1023:bc8:blr8:bm
on main game files
bpk on bk2 files
original size 44gb
repack size 29.gb

I know this is old but... I took a look on this and was surprised that you have precompressed this game with such a method.

I used the same as you did and after 3 hours I was into 30%... still precompression stage of course.

I know this game is old and no ass will repack this ever anymore but whatever.

So I looked up the game files and came to the following conclusion:
The game is shipped with oo2core_6_win64.dll which is v2.6.0 but some of the game files were compressed with a different oodle version, namely v2.5.3. You cannot precompress some of the files with shipped library. You will get 0 streams precompressed, plus it takes a long time.
So I wrote a quick xtool plugin.
I think all the files are compressed with kraken level6 (I am not in the mood to look up over 20k files, so I assume all the files are compressed with kraken level6).


Some examples.

-mwwe2k19
Streams: 809 / 809
Time: 00:00:26 (CPU 00:02:24)

Size: 353 MB >> 0,99 GB

Done!!!

-mkraken:l6
Streams: 498 / 802
Time: 00:01:33 (CPU 00:08:07)

Size: 353 MB >> 921 MB

Done!!!

-mkraken
Compressed 109 files, 1,866,438,656 => 3,240,060,056 bytes. Ratio 173.60%
Compression time: cpu 1.50 sec/real 327.79 sec = 0%. Speed 5.69 mB/s
All OK

-mwwe2k19
Compressed 109 files, 1,866,438,656 => 3,327,328,916 bytes. Ratio 178.27%
Compression time: cpu 1.69 sec/real 166.69 sec = 1%. Speed 11.20 mB/s
All OK

I said that some of the files are packed with a different oodle version, namely v2.5.3.
So you have to use two libraries at once to get probably all the streams.

Example:

xtool:mwwe2k19:oodleoo2core_5_win64.dll:core_2.5.3+xtool:mwwe2k19:oodleoo2core_6_win64.dll:core_2.6.0

Compressed 1 file, 746,374,144 => 4,560,712,728 bytes. Ratio 611.05%
Compression time: cpu 0.88 sec/real 96.40 sec = 1%. Speed 7.74 mB/s
All OK

xtool:mkraken:oodleoo2core_5_win64.dll:core_2.5.3+xtool:mkraken:oodleoo2core_6_win64.dll:core_2.6.0

Compressed 1 file, 746,374,144 => 3,790,919,089 bytes. Ratio 507.91%
Compression time: cpu 1.05 sec/real 296.24 sec = 0%. Speed 2.52 mB/s
All OK

I did not tested this with the full game. If anyone wants to dig deeper then there you go.

Edit: I guess it's better to first use the higher library, then the lower (2.6.0 -> 2.5.3).

[Stream1]
Name=wwe2k19
Codec=kraken:l6
BigEndian=0
Signature=0x4E4B524B
Structure=Signature(4),DSize(4),CSize(4),OodleHdr(2),Stream
StreamOffset=-2
CompressedSize=CSize
DecompressedSize=DSize
Condition1=OodleHdr = 0x068C
Condition2=CSize > 64

Edit:

 23:28:40 - Selected ARC/DS method for Data1a-01.bin was: xtool:c32mb:mkak,wwe2k19:oodleoo2core_6_win64.dll:core_2.6.0+xtool:mkak,wwe2k19:oodleoo2core_5_win64.dll:core_2.5.3:dd3:l10,d128mb
 23:28:40 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p
 23:28:40 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb
-----------------------------------------------------------------------------------------------------------------------------------------
 02:46:23 - Overall input size: 57,32 GB
 02:46:23 - Overall output size: 32,91 GB (Ratio 57.41%)
 02:46:23 - Overall conversion time: 03:17:40

Processed wwise too.
Install time was 1h40min

[wrathma]

i am trying to compress this ue4 game released on 2024 called The Black Within, but using xtool with oodle 2.9.11-12 cant decompress all streams. also i dont think the pak is encrypted. here is a 200mb sample+game exe if anyone would like to help me with it.

XTool is created by Razor12911

Version 0.9.4

Streams: 535 / 1991
Time: 00:01:53 (CPU 00:14:18)

Size: 200 MB >> 211 MB

Done!!!

edit: even tho it was released in 2024 it uses a old oodle version from 2021. using oodle 2.9.5 decompresses all streams.

[dixen]

It worked with oo2core_8_win64.dll

Version 0.9.5

Streams: 1987 / 1991
Time: 00:00:28 (CPU 00:02:44)

Size: 200 MB >> 363 MB

100%
Errorlevel=0
Compressed 1 file, 209,715,200 => 380,252,220 bytes. Ratio 181.32%
Compression time: cpu 0.25 sec/real 31.96 sec = 1%. Speed 6.56 mB/s
All OK

[wrathma]

Originally Posted by dixen

It worked with oo2core_8_win64.dll

yeah i tried every oodle dll from 2.9.5 to 2.9.12, only 2.9.5 can decompress all 1991 detected streams.

XTool is created by Razor12911

Version 0.9.4

Streams: 1991 / 1991
Time: 00:00:25 (CPU 00:02:54)

Size: 200 MB >> 363 MB

Done!!!

[KaktoR]

UE4 games mostly use 2.9.5 if they are compressed with oodle, while UE5 use a variety of different libraries, mostly 2.9.10.

[dixen]

Starfield - Terrain01.ba2


3.9 GB >> 95 GB..Hm
Bug?

[KaktoR]

GRID Legends

 16:33:28 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzstd,l22:zstd_145:dd3:l10,d128mb
 16:33:28 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p
 16:33:28 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb
-----------------------------------------------------------------------------------------------------------------------------------------
 19:27:25 - Overall input size: 35,41 GB
 19:27:25 - Overall output size: 26,67 GB (Ratio 75.32%)
 19:27:25 - Overall conversion time: 02:53:55

There is still room for improvement.
Installation time will take a long time (over 1 hour) due to high zstd level.

[Dunnowho69]

https://gofile.io/d/PM6spx

This is from RE9. Can anyone share the best compression method for this ? Thanks in advance

[dixen]

Originally Posted by Dunnowho69

https://gofile.io/d/PM6spx

This is from RE9. Can anyone share the best compression method for this ? Thanks in advance

-mxtool:zstd:l11+gdeflate (libzstd.dll v1.44).
Needed Xtool 0.9.5

[hwang4]

got this !

"ERROR: general (de)compression error in srep:m3f" how do i fix it ? thx for help!

[KaktoR]

Avatar Frontiers of Pandora
Nothing ripped.
Extracted and processed wwise audio aswell as bink videos.

 21:47:06 - Selected ARC/DS method for Data1a-01.bin was: xtool:mmermaid:core_2.9.10:lib_2:dd3:l10,d128mb
 21:47:06 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p
 21:47:06 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb
-----------------------------------------------------------------------------------------------------------------------------------------
 04:58:41 - Overall input size: 149,17 GB
 04:58:41 - Overall output size: 93,02 GB (Ratio 62.36%)
 04:58:41 - Overall conversion time: 07:11:31

Install time was about 1 hour

[Toximan69]

Pragmata
Compression same like RE9, like in dixen's post

-mxtool:zstd:l11+gdeflate (libzstd.dll v1.44).
Needed Xtool 0.9.5

Game size: 34.65 GB
Compression size: 26.5 GB

[KaktoR]

Crimson Desert
Looks like there is no worth mentioning compression.
Extracted and processed Wwise audio

 09:53:27 - Selected ARC/DS method for Data1a-01.bin was: xtool:dd3:l10,d128mb
-----------------------------------------------------------------------------------------------------------------------------------------
 12:39:04 - Overall input size: 126,09 GB
 12:39:04 - Overall output size: 73,57 GB (Ratio 58.35%)
 12:39:04 - Overall conversion time: 02:45:36

[wareck]

work in progress ...

Data1.bin (*.pak excepted pakchunk10-Windows.pak pakchunk16-Windows.pak)

xtool:mkraken:core_2.9.5:dd3+LOLZ_NORMAL

and maybe better with aes :

xtool:c32mb:d1:mue4,k0xA896068444F496956900542A215 367688B49B19C2537FCD2743D8585BA1EB128+xtool:mkrake n:9:dd3+LOLZ_NORMAL

For data2 and data3:
pakchunk10-Windows.pak have a lot of small wem files. not very efficient with wemtool.
better to compress with razor than lolz.

xtool:mkraken:core_2.9.5:dd3+razor_mtx

pakchunk16-Windows.pak is several bink2 videos who are not compressible with binkpack.
easy way is to again use razor

xtool:mkraken:core_2.9.5:dd3+razor_mtx

I'm working on extract bk2 form this .pak to makes a process with lolz and bk2 with other compressor.
but due to AES i cant' use xtool/ringi/mesa to extract/recover files.
I'm working with a bms script in attachment

[KaktoR]

Try quickbms reimport -w -r