Best Compression Methods for 'Specific' Games. Q&A - Page 200

KaktoR · #**2986** 17-05-2022, 09:54

I need some (technical) information here.

Code:

xtool+msc+oggre
Compressed 1 file, 132,903,091 => 72,589,354 bytes. Ratio 54.62%
Compression time: cpu 0.08 sec/real 31.37 sec = 0%. Speed 4.24 mB/s
All OK

Extracting 1 file, 132,903,091 bytes. Processed  88%
ERROR: general (de)compression error in msc
Stream:# is not supported by this version of the library

Code:

xtool+oggre+msc
Compressed 1 file, 132,903,091 => 104,121,513 bytes. Ratio 78.34%
Compression time: cpu 0.13 sec/real 33.31 sec = 0%. Speed 3.99 mB/s
All OK

Extracted 1 file, 104,121,513 => 132,903,091 bytes. Ratio 78.34%
Extraction time: cpu 7.17 sec/real 9.96 sec = 72%. Speed 13.34 mB/s
All OK

kj911 · #**2987** 17-05-2022, 10:07

Kaktor: Trying probable two step compressions methods, don't work?? First archive use xtool+msc only and pack again the new arc file use oggre. FreeArc anomalies, bug, not the msc/srep or any packers.

L33THAK0R · #**2988** 17-05-2022, 21:32

Hi all,

Been looking into Sleeping Dogs, and after a bit of discussion with some more experienced/technical tool engineers, I've got to say I'm quite intrigued. It uses a very aggressive "LZ" algorithm, with a given ".BIG" (archive format for the title in question) decompressing to over twice its original size! It also seems the WWise ".pck" files used for audio within the title have the potential for additional gains using "OGGRE"/"MSC". Unfortunately for the former I don't possess the skill-set (yet) to adapt the provided compression/decompression algorithm to be able to parse inputs for use with a chain of compressors, but none the less I think its still interesting enough for others to see.

Attached is a tool suite for processing the aforementioned ".BIG" archives, as well as a sample archive.

kj911 · #**2989** 20-05-2022, 08:08

Splinter Cell: Pandora Tomorrow v1.31 with Online+Maps Patch (Hungarian version!)

Results sizes its compressed only, without archive header. (Compressed directory size.)

Data files (more extensions with *.uax files):

992 file, 1 065 351 100 byte

Code:

xZLib+msc+srep:m3f:a0+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d160m:fba4096:oh14:ldc0:tt32:mc1023

Results: 235 257 168 byte

Sound1 (MAPS.LM0/SM0, 2 file only):

Code:

srep:m3f:l32:a0+msc+4x4+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d160m:fba4096:tt16:mc1023

Results: 64 141 713 byte

Sound1 notes: MSC with tak=9 and raw=2/bmp=0 options! Others its defaults. (wav/mp3=1 ...)

Sound2 (*.hxb/hxc, *.LS0, *.SP0)

12 files, 192 933 113 byte

Code:

tta+lzp:3:64m:h22:d64mb+4x4 (without 2 small files, smaller than 6kB: tta+lzma:ultra:bt4:273:mc1023)

Results: 108 008 108 byte

Sound3 (*.SS0)

27 files, 250 086 228 byte

Code:

lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d128m:fba4096:tt32:mc1023

Results: 165 027 167 byte

Binaries (*.exe/dll)

62 files, 41 353 387 byte

Code:

rep+exe2+delta+lzma:ultra:mc384

Results: 10 422 472 byte

This Lossy parts:

Untouched videos size: 454 103 532 byte
Recompressed videos size: 200 621 456 byte

Code:

bpk+rep:64mb+lzp:128mb:3:h22:d256mb

Results: 143 422 866 byte

2006.894MB --> 692.649MB (34.513% ratio)

Masquerade · #**2990** 24-05-2022, 13:26

Dolmen

*.PAK
Code:
```
oo2recm+srep+lolz
```
*.MP4
Code:
```
srep
```
Everything else:
Code:
```
srep+razor
```

Use this oodle core.

7.3GB ---> 5.7GB [Game + 60FPS + 30FPS videos]

6.8GB ---> 5.1GB [Game + 60 FPS videos]

6.6GB ---> 5GB [Game + 30 FPS videos]

kj911 · #**2991** 26-05-2022, 14:58

Please test the sample archive, from decompression. Packed with SREP+MSC method. MSC use WAV/RAW/MP3=1 options and SREP 3.92 with -m3f:l32 switches. And TAK 2.3.1 version. Any methods, its few percentage worse ratios. (LOLZ not tested.) Decompression resources, its minimized, don't required arc/cls.ini files. Tested in use Arc.exe/ini files and any combinations its ok from WinXP machine.

1. Download the sample, and unpack to any blank dirs.
2. Run bat file and see results.
3. Move *.sha file to "Unpacked" dirs and checking use TC or any apps.

Thanks.

abror · #**2992** 30-05-2022, 01:27

Hai,

I'm trying to compress WWE 2K22 with Diskpan GUI by Cesar82 and it's been running for more than 5 hours. It's written in the top left corner 46:20:09

Is that normal?

Compress method : xtool:mkraken:9+srep_new:1+lolz

Masquerade · #**2993** 30-05-2022, 02:09

Quote:

Originally Posted by abror

Hai,

I'm trying to compress WWE 2K22 with Diskpan GUI by Cesar82 and it's been running for more than 5 hours. It's written in the top left corner 46:20:09

Is that normal?

Compress method : xtool:mkraken:9+srep_new:1+lolz

This game is encrypted + uses Oodle Hydra compression so you will get nowhere using xtool kraken.

abror · #**2994** 30-05-2022, 04:09

Quote:

Originally Posted by Masquerade

This game is encrypted + uses Oodle Hydra compression so you will get nowhere using xtool kraken.

is the method below correct?

xtool:mhydra:9+srep_new:1+lolz

in Diskpan GUI, Hydra is only in Xtool or should I replace it with oodle selkie from razor?

If something goes wrong please tell me

Or can you tell me the compression method so I can copy-paste?

Masquerade · #**2995** 30-05-2022, 04:12

The Sims 4 [Deluxe Edition] (v1.88.228.1020 + All DLCs + Soundtrack)

Code:

xzlib+srep+lolz/$mp3=mpz

50.1GB ---> 30.5GB

Masquerade · #**2996** 30-05-2022, 04:22

Quote:

Originally Posted by abror

is the method below correct?

No. This game is encrypted. You cannot precompress any data without decrypting it first. Of which, is an incredibly horrid task for not much compression gain. Oodle cocecs are extremely efficient in their compression.

Quote:

Originally Posted by abror

oodle selkie from razor?

Selkie and Hydra are completely different compression algos.

This graphic is slightly outdated since the Oodle family now includes LZNA and Hydra which do not appear on the above, but the image still illustrates my point.

kj911 · #**2997** 30-05-2022, 04:38

Quote:

Originally Posted by 78372

GTA SanAndreas

Everything in audio\streams folder *ONLY*

Method : oggrenc+srep

Original Size = 1.09GB
Compressed size = 981MB

Its really?? Game version? v1.00 or v1.01 or v2.0?? EU or USA versions? Trying compress v1.00 files, use this srep only compression get ~2% size ratio from compression. Use last LOLZ, reduced 1.10GB to 1.07GB size. (1 125 783kB) Use oggre v0.11 only have ~12MB size reduction. Combined with LOLZ in best results: 1 117 004kB size. This audio files encypted? (Retail DVD version.) Used older OGGRE_Enc version than v0.11??

Input size: 1 187 289 114 byte (Files creation date: 2005.02.10/11.)

Any tips, idea? And best methods from SFX folder compression?

UPDATE: My "SFX" and "streams" folder CRC's hash files added.

L33THAK0R · #**2998** 30-05-2022, 05:53

Quote:

Originally Posted by kj911

Its really?? Game version? v1.00 or v1.01 or v2.0?? EU or USA versions? Trying compress v1.00 files, use this srep only compression get ~2% size ratio from compression. Use last LOLZ, reduced 1.10GB to 1.07GB size. (1 125 783kB) Use oggre v0.11 only have ~12MB size reduction. Combined with LOLZ in best results: 1 117 004kB size. This audio files encypted? (Retail DVD version.) Used older OGGRE_Enc version than v0.11??

Input size: 1 187 289 114 byte (Files creation date: 2005.02.10/11.)

Any tips, idea? And best methods from SFX folder compression?

UPDATE: My "SFX" and "streams" folder CRC's hash files added.

Might just be the files you've got, when I repacked the GTA series way back when I got similar gains with oggre + srep + lolz

kj911 · #**2999** 30-05-2022, 06:08

L33THAKOR: Did you get a similar result for you too? Max. ~35-42MB size reductions?
Whats differences? 78732 packed 981MB vs. my ~1.07GB (1091MB) archive.

New results with original files (not unpacked the game streams files):

srep+oogre+lolz: 1 121 406kB
oggre+srep+lolz: 1 116 863kB

The streams files unpacked via SAAT tools to *.OGG files.

Compress srep:m3f:l64 only: 1 099 616 kB (with l32: 1 095 842kB)
LZMA2/d26/lp0/pb0 --> 1 080 775kB
CAB/LZX:21 --> 1 079 857kB (better than LZMA2, LOL. Use PowerArc 7.00 CL version.)
LOLZ: 1 077 415kB

The SAAT exported OGG files reimported to original fileformats, totally lossless!! New created files (AA, ADVERTS, more..) no difference than original ones.

Testing now lolz and oggre compress its *.OGG files.

oggre:s3: 1 008 556kB (crunched again use srep:l32 --> 1 006 685kB)
oggre:s3+lolz: 1 006 630kB (yes, very minimally better than srep-ed versions.)

Note: All srep compressions, use -m3f defaults switches.

Conclusions? Make packed archive with WinXP compatible decompressors, use LOLZ only. Get better ratio and x64 systems? Use oggre+srep+lolz methods. (or and use SAAT tools from recreating original streams files, after decompression.)

Alternative ways, testing now, use OGG rehuffing, with ~2-3% or higher, taken from input/compressed size savings from *.OGG files packing without OGGRE.

KaktoR · #**3000** 30-05-2022, 12:57

Sniper Elite 5

Code:

 20:57:01 - Selected ARC/DS method for Data1b-01.bin was: srep_new:1+lzma2:d96m:fb273:lc4:mc1000000
 20:57:01 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzlib+srep_new:1+lzma2:d96m:fb273:lc4:mc1000000
-------------------------------------------------------------------------------------------------------------------------------------------
 23:24:34 - Overall input size: 76.51 GB
 23:24:34 - Overall output size: 46.48 GB (Ratio 60.76%)
 23:24:34 - Overall conversion time: 02:27:26

Data1a = *.pc and *.asr files

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 14:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 06:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 07:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 17:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 21:27

The Following User Says Thank You to KaktoR For This Useful Post:
Razor12911 (18-05-2022)

The Following User Says Thank You to L33THAK0R For This Useful Post:
Gehrman (24-05-2022)

The Following 2 Users Say Thank You to kj911 For This Useful Post:
Gehrman (24-05-2022), JustFun (06-10-2022)

The Following 4 Users Say Thank You to Masquerade For This Useful Post:
fabrieunko (26-05-2022), Gehrman (24-05-2022), JustFun (06-10-2022), ScOOt3r (28-05-2022)

The Following User Says Thank You to Masquerade For This Useful Post:
JustFun (06-10-2022)