Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #2986  
Old 17-05-2022, 09:54
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,577
Thanks: 942
Thanked 5,833 Times in 2,153 Posts
KaktoR is on a distinguished road
I need some (technical) information here.

Code:
xtool+msc+oggre
Compressed 1 file, 132,903,091 => 72,589,354 bytes. Ratio 54.62%
Compression time: cpu 0.08 sec/real 31.37 sec = 0%. Speed 4.24 mB/s
All OK

Extracting 1 file, 132,903,091 bytes. Processed  88%
ERROR: general (de)compression error in msc
Stream:# is not supported by this version of the library
Code:
xtool+oggre+msc
Compressed 1 file, 132,903,091 => 104,121,513 bytes. Ratio 78.34%
Compression time: cpu 0.13 sec/real 33.31 sec = 0%. Speed 3.99 mB/s
All OK

Extracted 1 file, 104,121,513 => 132,903,091 bytes. Ratio 78.34%
Extraction time: cpu 7.17 sec/real 9.96 sec = 72%. Speed 13.34 mB/s
All OK
__________________
Haters gonna hate
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
Razor12911 (18-05-2022)
Sponsored Links
  #2987  
Old 17-05-2022, 10:07
kj911 kj911 is offline
Registered User
 
Join Date: Apr 2010
Location: world
Posts: 80
Thanks: 44
Thanked 24 Times in 16 Posts
kj911 is on a distinguished road
Kaktor: Trying probable two step compressions methods, don't work?? First archive use xtool+msc only and pack again the new arc file use oggre. FreeArc anomalies, bug, not the msc/srep or any packers.
Reply With Quote
  #2988  
Old 17-05-2022, 21:32
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 230
Thanks: 80
Thanked 21 Times in 17 Posts
L33THAK0R is on a distinguished road
Sleeping Dogs (Original / Definitive Edition)

Hi all,

Been looking into Sleeping Dogs, and after a bit of discussion with some more experienced/technical tool engineers, I've got to say I'm quite intrigued. It uses a very aggressive "LZ" algorithm, with a given ".BIG" (archive format for the title in question) decompressing to over twice its original size! It also seems the WWise ".pck" files used for audio within the title have the potential for additional gains using "OGGRE"/"MSC". Unfortunately for the former I don't possess the skill-set (yet) to adapt the provided compression/decompression algorithm to be able to parse inputs for use with a chain of compressors, but none the less I think its still interesting enough for others to see.

Attached is a tool suite for processing the aforementioned ".BIG" archives, as well as a sample archive.
Attached Files
File Type: rar Sleeping Dogs Fuckery.rar (884.3 KB, 17 views)
File Type: rar sample_big_file.rar (45.99 MB, 4 views)
Reply With Quote
The Following User Says Thank You to L33THAK0R For This Useful Post:
Gehrman (24-05-2022)
  #2989  
Old 20-05-2022, 08:08
kj911 kj911 is offline
Registered User
 
Join Date: Apr 2010
Location: world
Posts: 80
Thanks: 44
Thanked 24 Times in 16 Posts
kj911 is on a distinguished road
Splinter Cell: Pandora Tomorrow v1.31 with Online+Maps Patch (Hungarian version!)

Results sizes its compressed only, without archive header. (Compressed directory size.)

Data files (more extensions with *.uax files):

992 file, 1 065 351 100 byte
Code:
xZLib+msc+srep:m3f:a0+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d160m:fba4096:oh14:ldc0:tt32:mc1023
Results: 235 257 168 byte

Sound1 (MAPS.LM0/SM0, 2 file only):

Code:
srep:m3f:l32:a0+msc+4x4+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d160m:fba4096:tt16:mc1023
Results: 64 141 713 byte

Sound1 notes: MSC with tak=9 and raw=2/bmp=0 options! Others its defaults. (wav/mp3=1 ...)

Sound2 (*.hxb/hxc, *.LS0, *.SP0)

12 files, 192 933 113 byte
Code:
tta+lzp:3:64m:h22:d64mb+4x4 (without 2 small files, smaller than 6kB: tta+lzma:ultra:bt4:273:mc1023)
Results: 108 008 108 byte

Sound3 (*.SS0)

27 files, 250 086 228 byte
Code:
lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d128m:fba4096:tt32:mc1023
Results: 165 027 167 byte

Binaries (*.exe/dll)

62 files, 41 353 387 byte
Code:
rep+exe2+delta+lzma:ultra:mc384
Results: 10 422 472 byte

This Lossy parts:

Untouched videos size: 454 103 532 byte
Recompressed videos size: 200 621 456 byte

Code:
bpk+rep:64mb+lzp:128mb:3:h22:d256mb
Results: 143 422 866 byte

2006.894MB --> 692.649MB (34.513% ratio)
Reply With Quote
The Following User Says Thank You to kj911 For This Useful Post:
Gehrman (24-05-2022)
  #2990  
Old 24-05-2022, 13:26
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 741
Thanks: 166
Thanked 785 Times in 391 Posts
Masquerade is on a distinguished road
Dolmen
  • *.PAK
    Code:
    oo2recm+srep+lolz
  • *.MP4
    Code:
    srep
  • Everything else:
    Code:
    srep+razor

Use this oodle core.

7.3GB ---> 5.7GB [Game + 60FPS + 30FPS videos]

6.8GB ---> 5.1GB [Game + 60 FPS videos]

6.6GB ---> 5GB [Game + 30 FPS videos]
Reply With Quote
The Following 3 Users Say Thank You to Masquerade For This Useful Post:
fabrieunko (26-05-2022), Gehrman (24-05-2022), ScOOt3r (28-05-2022)
  #2991  
Old 26-05-2022, 14:58
kj911 kj911 is offline
Registered User
 
Join Date: Apr 2010
Location: world
Posts: 80
Thanks: 44
Thanked 24 Times in 16 Posts
kj911 is on a distinguished road
Reversed compression switches

Please test the sample archive, from decompression. Packed with SREP+MSC method. MSC use WAV/RAW/MP3=1 options and SREP 3.92 with -m3f:l32 switches. And TAK 2.3.1 version. Any methods, its few percentage worse ratios. (LOLZ not tested.) Decompression resources, its minimized, don't required arc/cls.ini files. Tested in use Arc.exe/ini files and any combinations its ok from WinXP machine.

1. Download the sample, and unpack to any blank dirs.
2. Run bat file and see results.
3. Move *.sha file to "Unpacked" dirs and checking use TC or any apps.

Thanks.
Attached Files
File Type: 7z test_archive.7z (15.92 MB, 0 views)
Reply With Quote
  #2992  
Old 30-05-2022, 01:27
abror's Avatar
abror abror is offline
Registered User
 
Join Date: May 2022
Location: indonesia
Posts: 24
Thanks: 13
Thanked 0 Times in 0 Posts
abror is on a distinguished road
Hai,

I'm trying to compress WWE 2K22 with Diskpan GUI by Cesar82 and it's been running for more than 5 hours. It's written in the top left corner 46:20:09

Is that normal?

Compress method : xtool:mkraken:9+srep_new:1+lolz

Attached Images
File Type: png Capture.PNG (61.8 KB, 68 views)
Reply With Quote
  #2993  
Old 30-05-2022, 02:09
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 741
Thanks: 166
Thanked 785 Times in 391 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by abror View Post
Hai,

I'm trying to compress WWE 2K22 with Diskpan GUI by Cesar82 and it's been running for more than 5 hours. It's written in the top left corner 46:20:09

Is that normal?

Compress method : xtool:mkraken:9+srep_new:1+lolz
This game is encrypted + uses Oodle Hydra compression so you will get nowhere using xtool kraken.
Reply With Quote
  #2994  
Old 30-05-2022, 04:09
abror's Avatar
abror abror is offline
Registered User
 
Join Date: May 2022
Location: indonesia
Posts: 24
Thanks: 13
Thanked 0 Times in 0 Posts
abror is on a distinguished road
Quote:
Originally Posted by Masquerade View Post
This game is encrypted + uses Oodle Hydra compression so you will get nowhere using xtool kraken.
is the method below correct?

xtool:mhydra:9+srep_new:1+lolz

in Diskpan GUI, Hydra is only in Xtool or should I replace it with oodle selkie from razor?

If something goes wrong please tell me

Or can you tell me the compression method so I can copy-paste?
Reply With Quote
  #2995  
Old 30-05-2022, 04:12
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 741
Thanks: 166
Thanked 785 Times in 391 Posts
Masquerade is on a distinguished road
The Sims 4 [Deluxe Edition] (v1.88.228.1020 + All DLCs + Soundtrack)

Code:
xzlib+srep+lolz/$mp3=mpz
50.1GB ---> 30.5GB
Reply With Quote
  #2996  
Old 30-05-2022, 04:22
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 741
Thanks: 166
Thanked 785 Times in 391 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by abror View Post
is the method below correct?
No. This game is encrypted. You cannot precompress any data without decrypting it first. Of which, is an incredibly horrid task for not much compression gain. Oodle cocecs are extremely efficient in their compression.
Quote:
Originally Posted by abror View Post
oodle selkie from razor?
Selkie and Hydra are completely different compression algos.



This graphic is slightly outdated since the Oodle family now includes LZNA and Hydra which do not appear on the above, but the image still illustrates my point.
Reply With Quote
  #2997  
Old 30-05-2022, 04:38
kj911 kj911 is offline
Registered User
 
Join Date: Apr 2010
Location: world
Posts: 80
Thanks: 44
Thanked 24 Times in 16 Posts
kj911 is on a distinguished road
Quote:
Originally Posted by 78372 View Post
GTA SanAndreas

Everything in audio\streams folder *ONLY*

Method : oggrenc+srep

Original Size = 1.09GB
Compressed size = 981MB
Its really?? Game version? v1.00 or v1.01 or v2.0?? EU or USA versions? Trying compress v1.00 files, use this srep only compression get ~2% size ratio from compression. Use last LOLZ, reduced 1.10GB to 1.07GB size. (1 125 783kB) Use oggre v0.11 only have ~12MB size reduction. Combined with LOLZ in best results: 1 117 004kB size. This audio files encypted? (Retail DVD version.) Used older OGGRE_Enc version than v0.11??

Input size: 1 187 289 114 byte (Files creation date: 2005.02.10/11.)

Any tips, idea? And best methods from SFX folder compression?

UPDATE: My "SFX" and "streams" folder CRC's hash files added.
Attached Files
File Type: zip streams_SFX_CRCs.zip (1,002 Bytes, 1 views)

Last edited by kj911; 30-05-2022 at 05:13. Reason: Hash files added
Reply With Quote
  #2998  
Old 30-05-2022, 05:53
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 230
Thanks: 80
Thanked 21 Times in 17 Posts
L33THAK0R is on a distinguished road
Quote:
Originally Posted by kj911 View Post
Its really?? Game version? v1.00 or v1.01 or v2.0?? EU or USA versions? Trying compress v1.00 files, use this srep only compression get ~2% size ratio from compression. Use last LOLZ, reduced 1.10GB to 1.07GB size. (1 125 783kB) Use oggre v0.11 only have ~12MB size reduction. Combined with LOLZ in best results: 1 117 004kB size. This audio files encypted? (Retail DVD version.) Used older OGGRE_Enc version than v0.11??

Input size: 1 187 289 114 byte (Files creation date: 2005.02.10/11.)

Any tips, idea? And best methods from SFX folder compression?

UPDATE: My "SFX" and "streams" folder CRC's hash files added.
Might just be the files you've got, when I repacked the GTA series way back when I got similar gains with oggre + srep + lolz
Reply With Quote
  #2999  
Old 30-05-2022, 06:08
kj911 kj911 is offline
Registered User
 
Join Date: Apr 2010
Location: world
Posts: 80
Thanks: 44
Thanked 24 Times in 16 Posts
kj911 is on a distinguished road
L33THAKOR: Did you get a similar result for you too? Max. ~35-42MB size reductions?
Whats differences? 78732 packed 981MB vs. my ~1.07GB (1091MB) archive.

New results with original files (not unpacked the game streams files):

srep+oogre+lolz: 1 121 406kB
oggre+srep+lolz: 1 116 863kB

The streams files unpacked via SAAT tools to *.OGG files.

Compress srep:m3f:l64 only: 1 099 616 kB (with l32: 1 095 842kB)
LZMA2/d26/lp0/pb0 --> 1 080 775kB
CAB/LZX:21 --> 1 079 857kB (better than LZMA2, LOL. Use PowerArc 7.00 CL version.)
LOLZ: 1 077 415kB

The SAAT exported OGG files reimported to original fileformats, totally lossless!! New created files (AA, ADVERTS, more..) no difference than original ones.

Testing now lolz and oggre compress its *.OGG files.

oggre:s3: 1 008 556kB (crunched again use srep:l32 --> 1 006 685kB)
oggre:s3+lolz: 1 006 630kB (yes, very minimally better than srep-ed versions.)

Note: All srep compressions, use -m3f defaults switches.

Conclusions? Make packed archive with WinXP compatible decompressors, use LOLZ only. Get better ratio and x64 systems? Use oggre+srep+lolz methods. (or and use SAAT tools from recreating original streams files, after decompression.)

Alternative ways, testing now, use OGG rehuffing, with ~2-3% or higher, taken from input/compressed size savings from *.OGG files packing without OGGRE.

Last edited by kj911; 30-05-2022 at 16:06. Reason: New results added
Reply With Quote
  #3000  
Old 30-05-2022, 12:57
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,577
Thanks: 942
Thanked 5,833 Times in 2,153 Posts
KaktoR is on a distinguished road
Sniper Elite 5

Code:
 20:57:01 - Selected ARC/DS method for Data1b-01.bin was: srep_new:1+lzma2:d96m:fb273:lc4:mc1000000
 20:57:01 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzlib+srep_new:1+lzma2:d96m:fb273:lc4:mc1000000
-------------------------------------------------------------------------------------------------------------------------------------------
 23:24:34 - Overall input size: 76.51 GB
 23:24:34 - Overall output size: 46.48 GB (Ratio 60.76%)
 23:24:34 - Overall conversion time: 02:27:26

Data1a = *.pc and *.asr files
__________________
Haters gonna hate

Last edited by KaktoR; 01-06-2022 at 07:54.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Games Are For Kids JoyBoy Chit Chat 83 16-11-2021 14:28
CorePack Compression methods ? Help ramazan19833 Conversion Tutorials 34 09-08-2018 06:51
i got the email in the mail about copying ps2 games EVOEvo PS2 Games 7 21-11-2003 07:56
Self-booting games on an older Japanese DC? Named DC Games 1 26-09-2003 17:48
Having Problems Burning Numerous *Recent* Games....Help is Appreciated Protosstic PSX Games 2 15-01-2002 21:27



All times are GMT -7. The time now is 23:00.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com