FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

KaktoR 17-05-2022 09:54

I need some (technical) information here.

Code:

xtool+msc+oggre
Compressed 1 file, 132,903,091 => 72,589,354 bytes. Ratio 54.62%
Compression time: cpu 0.08 sec/real 31.37 sec = 0%. Speed 4.24 mB/s
All OK

Extracting 1 file, 132,903,091 bytes. Processed  88%
ERROR: general (de)compression error in msc
Stream:# is not supported by this version of the library

Code:

xtool+oggre+msc
Compressed 1 file, 132,903,091 => 104,121,513 bytes. Ratio 78.34%
Compression time: cpu 0.13 sec/real 33.31 sec = 0%. Speed 3.99 mB/s
All OK

Extracted 1 file, 104,121,513 => 132,903,091 bytes. Ratio 78.34%
Extraction time: cpu 7.17 sec/real 9.96 sec = 72%. Speed 13.34 mB/s
All OK


kj911 17-05-2022 10:07

Kaktor: Trying probable two step compressions methods, don't work?? First archive use xtool+msc only and pack again the new arc file use oggre. FreeArc anomalies, bug, not the msc/srep or any packers.

L33THAK0R 17-05-2022 21:32

Sleeping Dogs (Original / Definitive Edition)
 
2 Attachment(s)
Hi all,

Been looking into Sleeping Dogs, and after a bit of discussion with some more experienced/technical tool engineers, I've got to say I'm quite intrigued. It uses a very aggressive "LZ" algorithm, with a given ".BIG" (archive format for the title in question) decompressing to over twice its original size! It also seems the WWise ".pck" files used for audio within the title have the potential for additional gains using "OGGRE"/"MSC". Unfortunately for the former I don't possess the skill-set (yet) to adapt the provided compression/decompression algorithm to be able to parse inputs for use with a chain of compressors, but none the less I think its still interesting enough for others to see.

Attached is a tool suite for processing the aforementioned ".BIG" archives, as well as a sample archive.

kj911 20-05-2022 08:08

Splinter Cell: Pandora Tomorrow v1.31 with Online+Maps Patch (Hungarian version!)

Results sizes its compressed only, without archive header. (Compressed directory size.)

Data files (more extensions with *.uax files):

992 file, 1 065 351 100 byte
Code:

xZLib+msc+srep:m3f:a0+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d160m:fba4096:oh14:ldc0:tt32:mc1023
Results: 235 257 168 byte

Sound1 (MAPS.LM0/SM0, 2 file only):

Code:

srep:m3f:l32:a0+msc+4x4+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d160m:fba4096:tt16:mc1023
Results: 64 141 713 byte

Sound1 notes: MSC with tak=9 and raw=2/bmp=0 options! Others its defaults. (wav/mp3=1 ...)

Sound2 (*.hxb/hxc, *.LS0, *.SP0)

12 files, 192 933 113 byte
Code:

tta+lzp:3:64m:h22:d64mb+4x4 (without 2 small files, smaller than 6kB: tta+lzma:ultra:bt4:273:mc1023)
Results: 108 008 108 byte

Sound3 (*.SS0)

27 files, 250 086 228 byte
Code:

lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d128m:fba4096:tt32:mc1023
Results: 165 027 167 byte

Binaries (*.exe/dll)

62 files, 41 353 387 byte
Code:

rep+exe2+delta+lzma:ultra:mc384
Results: 10 422 472 byte

This Lossy parts:

Untouched videos size: 454 103 532 byte
Recompressed videos size: 200 621 456 byte

Code:

bpk+rep:64mb+lzp:128mb:3:h22:d256mb
Results: 143 422 866 byte

2006.894MB --> 692.649MB (34.513% ratio)

Masquerade 24-05-2022 13:26

Dolmen
  • *.PAK
    Code:

    oo2recm+srep+lolz
  • *.MP4
    Code:

    srep
  • Everything else:
    Code:

    srep+razor

Use this oodle core.

7.3GB ---> 5.7GB [Game + 60FPS + 30FPS videos]

6.8GB ---> 5.1GB [Game + 60 FPS videos]

6.6GB ---> 5GB [Game + 30 FPS videos]

kj911 26-05-2022 14:58

Reversed compression switches
 
1 Attachment(s)
Please test the sample archive, from decompression. Packed with SREP+MSC method. MSC use WAV/RAW/MP3=1 options and SREP 3.92 with -m3f:l32 switches. And TAK 2.3.1 version. Any methods, its few percentage worse ratios. (LOLZ not tested.) Decompression resources, its minimized, don't required arc/cls.ini files. Tested in use Arc.exe/ini files and any combinations its ok from WinXP machine.

1. Download the sample, and unpack to any blank dirs.
2. Run bat file and see results.
3. Move *.sha file to "Unpacked" dirs and checking use TC or any apps.

Thanks.

abror 30-05-2022 01:27

1 Attachment(s)
Hai,

I'm trying to compress WWE 2K22 with Diskpan GUI by Cesar82 and it's been running for more than 5 hours. It's written in the top left corner 46:20:09

Is that normal?

Compress method : xtool:mkraken:9+srep_new:1+lolz

https://i.postimg.cc/nrgymYrK/Capture.png

Masquerade 30-05-2022 02:09

Quote:

Originally Posted by abror (Post 497049)
Hai,

I'm trying to compress WWE 2K22 with Diskpan GUI by Cesar82 and it's been running for more than 5 hours. It's written in the top left corner 46:20:09

Is that normal?

Compress method : xtool:mkraken:9+srep_new:1+lolz

This game is encrypted + uses Oodle Hydra compression so you will get nowhere using xtool kraken.

abror 30-05-2022 04:09

Quote:

Originally Posted by Masquerade (Post 497050)
This game is encrypted + uses Oodle Hydra compression so you will get nowhere using xtool kraken.

is the method below correct?

xtool:mhydra:9+srep_new:1+lolz

in Diskpan GUI, Hydra is only in Xtool or should I replace it with oodle selkie from razor?

If something goes wrong please tell me

Or can you tell me the compression method so I can copy-paste?

Masquerade 30-05-2022 04:12

The Sims 4 [Deluxe Edition] (v1.88.228.1020 + All DLCs + Soundtrack)

Code:

xzlib+srep+lolz/$mp3=mpz
50.1GB ---> 30.5GB

Masquerade 30-05-2022 04:22

Quote:

Originally Posted by abror (Post 497051)
is the method below correct?

No. This game is encrypted. You cannot precompress any data without decrypting it first. Of which, is an incredibly horrid task for not much compression gain. Oodle cocecs are extremely efficient in their compression.
Quote:

Originally Posted by abror (Post 497051)
oodle selkie from razor?

Selkie and Hydra are completely different compression algos.

http://www.radgametools.com/images/o...pical_vbar.png

This graphic is slightly outdated since the Oodle family now includes LZNA and Hydra which do not appear on the above, but the image still illustrates my point.

kj911 30-05-2022 04:38

1 Attachment(s)
Quote:

Originally Posted by 78372 (Post 468838)
GTA SanAndreas

Everything in audio\streams folder *ONLY*

Method : oggrenc+srep

Original Size = 1.09GB
Compressed size = 981MB

Its really?? Game version? v1.00 or v1.01 or v2.0?? EU or USA versions? Trying compress v1.00 files, use this srep only compression get ~2% size ratio from compression. Use last LOLZ, reduced 1.10GB to 1.07GB size. (1 125 783kB) Use oggre v0.11 only have ~12MB size reduction. Combined with LOLZ in best results: 1 117 004kB size. This audio files encypted? (Retail DVD version.) Used older OGGRE_Enc version than v0.11??

Input size: 1 187 289 114 byte (Files creation date: 2005.02.10/11.)

Any tips, idea? And best methods from SFX folder compression?

UPDATE: My "SFX" and "streams" folder CRC's hash files added.

L33THAK0R 30-05-2022 05:53

Quote:

Originally Posted by kj911 (Post 497054)
Its really?? Game version? v1.00 or v1.01 or v2.0?? EU or USA versions? Trying compress v1.00 files, use this srep only compression get ~2% size ratio from compression. Use last LOLZ, reduced 1.10GB to 1.07GB size. (1 125 783kB) Use oggre v0.11 only have ~12MB size reduction. Combined with LOLZ in best results: 1 117 004kB size. This audio files encypted? (Retail DVD version.) Used older OGGRE_Enc version than v0.11??

Input size: 1 187 289 114 byte (Files creation date: 2005.02.10/11.)

Any tips, idea? And best methods from SFX folder compression?

UPDATE: My "SFX" and "streams" folder CRC's hash files added.

Might just be the files you've got, when I repacked the GTA series way back when I got similar gains with oggre + srep + lolz

kj911 30-05-2022 06:08

L33THAKOR: Did you get a similar result for you too? Max. ~35-42MB size reductions?
Whats differences? 78732 packed 981MB vs. my ~1.07GB (1091MB) archive. :confused:

New results with original files (not unpacked the game streams files):

srep+oogre+lolz: 1 121 406kB
oggre+srep+lolz: 1 116 863kB

The streams files unpacked via SAAT tools to *.OGG files.

Compress srep:m3f:l64 only: 1 099 616 kB (with l32: 1 095 842kB)
LZMA2/d26/lp0/pb0 --> 1 080 775kB
CAB/LZX:21 --> 1 079 857kB (better than LZMA2, LOL. Use PowerArc 7.00 CL version.)
LOLZ: 1 077 415kB

The SAAT exported OGG files reimported to original fileformats, totally lossless!! New created files (AA, ADVERTS, more..) no difference than original ones.

Testing now lolz and oggre compress its *.OGG files.

oggre:s3: 1 008 556kB (crunched again use srep:l32 --> 1 006 685kB)
oggre:s3+lolz: 1 006 630kB (yes, very minimally better than srep-ed versions.)

Note: All srep compressions, use -m3f defaults switches.

Conclusions? Make packed archive with WinXP compatible decompressors, use LOLZ only. Get better ratio and x64 systems? Use oggre+srep+lolz methods. (or and use SAAT tools from recreating original streams files, after decompression.)

Alternative ways, testing now, use OGG rehuffing, with ~2-3% or higher, taken from input/compressed size savings from *.OGG files packing without OGGRE.

KaktoR 30-05-2022 12:57

Sniper Elite 5

Code:

20:57:01 - Selected ARC/DS method for Data1b-01.bin was: srep_new:1+lzma2:d96m:fb273:lc4:mc1000000
 20:57:01 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzlib+srep_new:1+lzma2:d96m:fb273:lc4:mc1000000
-------------------------------------------------------------------------------------------------------------------------------------------
 23:24:34 - Overall input size: 76.51 GB
 23:24:34 - Overall output size: 46.48 GB (Ratio 60.76%)
 23:24:34 - Overall conversion time: 02:27:26

Data1a = *.pc and *.asr files



All times are GMT -7. The time now is 03:28.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com