Best Compression Methods for 'Specific' Games. Q&A - Page 219

KaktoR · #**3271** 09-11-2022, 09:11

Quote:

Originally Posted by Masquerade

Which libraries are best for this game?

Code:

v2.8.14
1267/1413

v2.5.5 / v2.5.2 / v2.5.0
132/134
_____________
1399/1413

I can't get more. I have tested the first 200mb from Data0.bdt

Code:

200 -> 355 -> 366

Edit: Here is another test for Data3.bdt

Code:

v2.8.14
15077/18312

v2.5.5 / v2.5.2 / v2.5.0
2566/2641
_____________
17643/18312
_____________
669 streams left

---

2.47 GB -> 4.35 GB -> 4.51 GB

Maybe you get more out of it using n# option

dixen · #**3272** 09-11-2022, 13:19

F.I.S.T.: Forged In Shadow Torch

Tests

XZlib+Reflate (-d3 -c32mb)
21.2 gb > 39 gb

unreal.dll+Xzlib+Reflate (-d3 c128mb)
21.2 gb > 65 gb

AES Key

Code:

0xEABBDBD5A27C73D8CDAE3179A36C9EB793C3C61188A5763FBC35ACD155D0C604

KaktoR · #**3273** 09-11-2022, 14:54

Halo Infinite
Winter Update (8th November 2022)

Code:

 14:02:46 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken,l4,n64:8+srep+4x4:lzma
 14:02:46 - Selected ARC/DS method for Data1b-01.bin was: xtool:mreflate+srep+4x4:lzma
 14:02:46 - Selected ARC/DS method for Data1c-01.bin was: srep+4x4:lzma
-----------------------------------------------------------------------------------------
 16:25:26 - Overall input size: 44.02 GB
 16:25:26 - Overall output size: 31.19 GB (Ratio 70.86%)
 16:25:26 - Overall conversion time: 02:22:21

KaktoR · #**3274** 10-11-2022, 04:07

ELDEN RING
v1.07

Code:

 09:30:58 - Selected ARC/DS method for Data1a-01.bin was: xtool1+xtool2+srep+4x4:lzma
 09:30:58 - Selected ARC/DS method for Data1b-01.bin was: srep+lzma_sdk
-----------------------------------------------------------------------------------------
 11:55:14 - Overall input size: 45.07 GB
 11:55:14 - Overall output size: 36.75 GB (Ratio 81.54%)
 11:55:14 - Overall conversion time: 02:21:24

Oodle libraries used: v2.5.5 (xtool1) + v2.8.14 (xtool2)

xtool options: l6,n64

L33THAK0R · #**3275** 10-11-2022, 09:46

Does anyone know how BMP detection under MSC works? Got a few titles I'm working on that mainly use BMP images for texture assets, however MSC seems to skip over the majority of files. I had a brief trawl through some posts here but searching with shorter search terms is a massive pain in the arse and didnt yield a lot of information.

Masquerade · #**3276** 10-11-2022, 10:08

Maybe the thread on Krinkels.org may help you?

KaktoR · #**3277** 11-11-2022, 15:26

Saints Row (2022)
v1.1.6.4392638

Code:

 21:38:42 - Selected ARC/DS method for Data1a-01.bin was: xtool:mlz4f,l9:lz4_192+srep+4x4:lzma
 21:38:42 - Selected ARC/DS method for Data1b-01.bin was: srep+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 23:25:52 - Overall input size: 44.08 GB
 23:25:52 - Overall output size: 25.51 GB (Ratio 57.88%)
 23:25:52 - Overall conversion time: 01:47:08

KaktoR · #**3278** 13-11-2022, 14:03

Wolfenstein II The New Colossus

Code:

 15:56:42 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken:5+srep+4x4:lzma
 15:56:42 - Selected ARC/DS method for Data1b-01.bin was: bpk
 15:56:42 - Selected ARC/DS method for Data1c-01.bin was: srep+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 21:50:55 - Overall input size: 58.80 GB
 21:50:55 - Overall output size: 43.14 GB (Ratio 73.37%)
 21:50:55 - Overall conversion time: 05:53:20

Notes:
- Majority of *.resources files using level 4, majority of *.texdb and *.cache using level 5. I was too lazy to sort them out properly so I didn't use the l# option for xtool.
- On many files I didn't got all kraken streams, I checked with every library I have and even used different libraries with --oodle= option like with Elden Ring but to no avail.
- *.pages files using lz4hc but most likely weak compression, but couldn't get all streams (overall about half of streams), so I decided to just compress them with srep+lzma.

dixen · #**3279** 15-11-2022, 10:40

Somerville (Steam version)

*.wem, *.bnk - srep+razorMT
6.3 gb> 1.6 gb

Rest files - srep+lolz
3.7 gb > 430 mb

Install time - 1 min.

Masquerade · #**3280** 17-11-2022, 10:08

Unlike it's original variant, paks in Crysis 3 Remastered are not encrypted. They are just standard zip files and can be precompressed with xtool:

Code:

Compressed Animations.pak, 144,174,121 => 229,174,364 bytes. Ratio 158.96%

KaktoR · #**3281** 17-11-2022, 12:34

Is anyone here working with xtool's --dedup option?

I made many tests since yesterday and I think this will replace srep command entirely, at least for me.

Code:

xtool+srep+4x4:lzma
Compressed 27 files, 4,594,892,800 => 2,346,970,567 bytes. Ratio 51.08%
Compression time: cpu 3.69 sec/real 921.49 sec = 0%. Speed 4.99 mB/s
All OK

15min 23sec

Code:

xtool+4x4:lzma
Compressed 27 files, 4,594,892,800 => 2,346,861,976 bytes. Ratio 51.08%
Compression time: cpu 2.69 sec/real 660.86 sec = 0%. Speed 6.95 mB/s
All OK

11min 02sec

--dedup=(1..5)
srep.exe must be present next to xtool.exe for compression and decompression (no cls-srep required)

KaktoR · #**3282** 18-11-2022, 05:40

Here is another test. You can use xtool without any precompression too.

Code:

xtool+4x4:lzma
Compressed 7,383 files, 31,661,584,708 => 8,601,282,118 bytes. Ratio 27.17%
Compression time: cpu 16.39 sec/real 1506.53 sec = 1%. Speed 21.02 mB/s
All OK

28min

Code:

srep+4x4:lzma
Compressed 7,383 files, 31,661,584,708 => 8,601,527,510 bytes. Ratio 27.17%
Compression time: cpu 24.27 sec/real 2312.41 sec = 1%. Speed 13.69 mB/s
All OK

38min

Code:

[External compressor:xtool]
header    = 0
default   = -c64mb -t100p
packcmd   = "{compressor}.exe" precomp { -moption} --dbase --dedup=3 - - <stdin> <stdout>
unpackcmd = "{compressor}.exe" decode -t100p - - <stdin> <stdout>

KaktoR · #**3283** 18-11-2022, 08:54

Crysis 2 Remastered

Code:

 14:52:34 - Selected ARC/DS method for Data1a-01.bin was: oggre
 14:52:34 - Selected ARC/DS method for Data1b-01.bin was: xtool+4x4:lzma
 14:52:34 - Selected ARC/DS method for Data1c-01.bin was: xtool:mcrysis2remastered+4x4:lzma
 14:52:34 - Selected ARC/DS method for Data1d-01.bin was: xtool+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 16:53:20 - Overall input size: 53.76 GB
 16:53:20 - Overall output size: 34.79 GB (Ratio 64.72%)
 16:53:20 - Overall conversion time: 02:00:44

Data1a
GameCrysis2\music.pak
GameCrysis2\music_chk0.pak

Data1b
GameCrysis2\Video*.pak

Data1c
*.pak (excl 1a+1b)

Data1d
rest of the files

Thanks to Masquerade for database file

Masquerade · #**3284** 18-11-2022, 14:57

For Spiderman Miles Morales, use XTool Spidey plugin with liblz4 v1.9.4 to get all streams.

KaktoR · #**3285** 18-11-2022, 15:43

Edit: Have mixed up with another title

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 15:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 07:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 08:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 18:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 22:27

The Following 2 Users Say Thank You to KaktoR For This Useful Post:
L0v3craft (21-06-2024), Masquerade (09-11-2022)

The Following User Says Thank You to dixen For This Useful Post:
Wanterlude (10-11-2022)

The Following 3 Users Say Thank You to KaktoR For This Useful Post:
Gehrman (25-11-2022), JustFun (11-12-2022), ScOOt3r (10-11-2022)

The Following 6 Users Say Thank You to KaktoR For This Useful Post:
dixen (10-11-2022), Gehrman (25-11-2022), JustFun (11-12-2022), Masquerade (10-11-2022), ScOOt3r (10-11-2022), Wanterlude (10-11-2022)

The Following 5 Users Say Thank You to KaktoR For This Useful Post:
Cesar82 (12-11-2022), Gehrman (25-11-2022), JustFun (11-12-2022), ScOOt3r (12-11-2022), Wanterlude (11-04-2024)

The Following 7 Users Say Thank You to KaktoR For This Useful Post:
Danziel123 (14-11-2022), dixen (13-11-2022), Gehrman (25-11-2022), JustFun (11-12-2022), L0v3craft (16-11-2022), ScOOt3r (14-11-2022), Wanterlude (14-11-2022)

The Following 4 Users Say Thank You to dixen For This Useful Post:
fabrieunko (15-11-2022), Gehrman (25-11-2022), JustFun (11-12-2022), L0v3craft (16-11-2022)

The Following 4 Users Say Thank You to Masquerade For This Useful Post:
fabrieunko (18-11-2022), Gehrman (25-11-2022), KaktoR (17-11-2022), L0v3craft (18-11-2022)

The Following 2 Users Say Thank You to KaktoR For This Useful Post:
Fak Eid (06-09-2023), Masquerade (17-11-2022)

The Following 2 Users Say Thank You to KaktoR For This Useful Post:
Gehrman (25-11-2022), ScOOt3r (18-11-2022)

The Following 5 Users Say Thank You to KaktoR For This Useful Post:
fabrieunko (18-11-2022), Gehrman (18-11-2022), JustFun (11-12-2022), L0v3craft (18-11-2022), Prettyboy099 (18-11-2022)

The Following 4 Users Say Thank You to Masquerade For This Useful Post:
emadmoner (19-11-2022), L0v3craft (18-11-2022), ScOOt3r (18-11-2022), Wanterlude (18-11-2022)