Best Compression Methods for 'Specific' Games. Q&A

[KaktoR]

Assassin's Creed Odyssey

*.webm, *.bk2 with m0
*.forge with afr:a2+srep:m3f+lzma:a1:mfbt4:d256m:fb273:mc100000 0000:lc8
rest of files with srep:m3f+lzma:a1:mfbt4:d256m:fb273:mc1000000000:lc 8

Compression time took about 7 hours.

22:52:42 - Starting Data1.bin creation
22:53:02 - Finished Data1.bin creation
22:53:03 - Starting Data2.bin.001 creation
 5:49:07 - Finished Data2.bin.001 creation
 5:49:08 - Starting Data3.bin.001 creation
 6:05:01 - Finished Data3.bin.001 creation

46.3GB => 25.5GB

[K4miKaZe]

Originally Posted by KaktoR

Assassin's Creed Odyssey

*.webm, *.bk2 with m0
*.forge with afr:a2+srep:m3f+lzma:a1:mfbt4:d256m:fb273:mc100000 0000:lc8
rest of files with srep:m3f+lzma:a1:mfbt4:d256m:fb273:mc1000000000:lc 8

Compression time took about 7 hours.

22:52:42 - Starting Data1.bin creation
22:53:02 - Finished Data1.bin creation
22:53:03 - Starting Data2.bin.001 creation
 5:49:07 - Finished Data2.bin.001 creation
 5:49:08 - Starting Data3.bin.001 creation
 6:05:01 - Finished Data3.bin.001 creation

46.3GB => 25.5GB

Hi KaktoR, im wondering what "m0" is to try it myself again with those media files. Thanks for the lzma results on this game. This game has fast compression times even on lolz. Just a fun fact: Looking at my compressed ac library, unity is the biggest game hahaha (and its the smallest of the last 4 games).

[KaktoR]

m0 is zero compression (storing).

However, you could re-encode the webm files to lower resolution or less frames or details for example.

[K4miKaZe]

Originally Posted by KaktoR

m0 is zero compression (storing).

However, you could re-encode the webm files to lower resolution or less frames or details for example.

Ahhh ok, many many thanks. Was wondering about that. I dont like lower resolution on videos, for me its better to have them on original and i think that lowering can get those 600mb to maybe 400mb, so its not worth. Was wondering if this was just the same as binkpack where you can gain some extra mb without much time consuming or losing quality.

Thanks for the reply KaktoR !!!

[oltjon]

Achtung! Cthulhu Tactics

game size 2.82 Gb
compressed game size 734 Mb

NOTHING ripped
NOTHING re-encoded
ALL languages


Srep v3.92 library By Bulat Ziganshin
Lolz v2.1.a.7 library By ProFrager


compression time 2.20 hours + -
decompression time 5 min + -

srep + lolz data1.cab

intel core i7 4 cores 2.9Mhz
6GB ram

[ZAZA4EVER]

Originally Posted by Simorq

lolz:dt0:d64m:mt4:tt1:cm0 fast / bad ratio
lolz:dtb1:d128m:mtt1:mt6:mc1023 Best / Good Ratio

Lolz Test

How unpack second method for lolz
I tested it good time and ratio but i can't unpack it by cls of lolz

[K4miKaZe]

Originally Posted by ZAZA4EVER

How unpack second method for lolz
I tested it good time and ratio but i can't unpack it by cls of lolz

Strange, it should go well, im using this same method but without the "mt6" and it installs fine with the lolz included on the "Asis Installer" by KaktoR. Also im using the lolz version on Ultraarc 2900 R5 for packing. The installer includes cls-lolz.dll,cls-lolz_x64.exe & cls-lolz_x86.exe.

You could try with the same lolz version on Asis, see if that helps. I also saw same problems on other compressors that if you have different versions on packing and unpacking it doesnt work every time. So i keep my ultraarc with same version tools as the installer/unpacker to be sure. Had this on xtool last time and solved it by using same versions.

[K4miKaZe]

Hi, this one is not on the list. I made this with two methods (with and without xtool zlib). The gain with xtool is not worth, it has not much zlib...

Tools used: Ultraarc 2900 R5, Srep v3.9.2, Lolz, Xtool 0.9 (zlib)

Computer: As always, 4 cores at 3.9GHz (up to 4.3 on boost), 8GB Ram + SSD

Ripped Files: Only languages, keeping only 1 Language (spanish in my case)

Title: Dying Light: The Following Enhanced Edition v1.16.0 (GOG with all DLCs)

Method 1:

Method:          binkpack on .bik/.bk2 files, rest of files srep+lolz
Original Size:   25.1 GB
Compressed Size: 13.2 GB
Compress Time:   6 Hours
Install Time:    12 minutes

Method 2:

Method:          binkpack on .bik/.bk2 files, rest of files xzlib+srep+lolz
Original Size:   25.1 GB
Compressed Size: 12.9 GB
Compress Time:   6 Hours 20 minutes
Install Time:    13-14 minutes

Final note: I did tried some more things but could not get this lower, using higher dictionaries like d256, d512, etc... on lolz should give you more gain but it takes double time on compression and probably you wont get more than 100-200mb (not worth to me). There are also some repeated bik files, i didnt delete them because i dont know if it works and im too busy to test them now. As always CRC checked and all is fine !!!

[JustFun]

Guys we have over 300 entries in Index thread, thank you very much to everyone involved in sharing methods, much appreciated!

[K4miKaZe]

Originally Posted by JustFun

Guys we have over 300 entries in Index thread, thank you very much to everyone involved in sharing methods, much appreciated!

Thanks to you too for keeping it updated !!!

[K4miKaZe]

I will post on the next days all Final Fantasy games with almost same method (some little changes). I have done already the biggest one (XV) but im testing it ingame because i removed duplicated videos and im not sure if its working good. So in meantime here are the FF series in order.

Tools used: Xtools 0.9, SREP 3.9.2, Lolz & Ultraarc 2900 R5
Computer: 4 Cores at 3.9GHz (up to 4.3 on boost) + 8GB Ram + SSD
Ripped Files: Only changed DirectX with the websetup installer, game is still multilanguage

Method: xZLib+srep:m3f+lolz (lolz with d128, mcc 1023)

Original Size:   644 MB
Compressed Size: 349 MB
Packing time:    10 minutes or less
Install time:    1-2 minutes

Using ztool is giving same size then xtool (tested them on both). Tomorrow i will post IV, V & VI

[K4miKaZe]

Here are some more FF Games for today, should finish with this series tomorrow or maybe 1 day more. Xzlib isnt almost required, all games have zlib but on some of them there is only a little gain. But it doesnt take much longer on compression son i leaved it this way.

Tools used: Ultraarc 2900 R5, Srep 3.9.2, Lolz, Xtool 0.9

Computer: 4 cores 3.9Ghz (4.3 boost) + 8GB Ram + SSD

Method: xZLib+Srep+Lolz

Ripped Files: Only changed dx files with webinstaller and if it was possible let only 1 language

All games are from Steam (Steam Editions) and have 1 language

Final Fantasy IV (v1.0.4):

Original Size:   792 MB
Compressed Size: 419 MB
Compress Time:   10 minutes
Install Time:    1-2 minutes

Final Fantasy IV: The After Years (v1.0):

Original Size:   974 MB
Compressed Size: 427 MB
Compress Time:   12-13 minutes
Install Time:    1-2 minutes

Final Fantasy V (v1.0):

Original Size:   1.18 GB
Compressed Size: 648 MB
Compress Time:   15 minutes
Install Time:    2-3 minutes

Final Fantasy VI (v1.0.2):

Original Size:   908 MB
Compressed Size: 535 MB
Compress Time:   12-13 minutes
Install Time:    2-3 minutes

Final Fantasy VII (v1.0.9):

Original Size:   2.27 GB
Compressed Size: 1.08 GB
Compress Time:   20 minutes
Install Time:    3-4 minutes

Final Fantasy VIII (v1.0.11):

Original Size:   3.42 GB
Compressed Size: 1.32 GB
Compress Time:   25 minutes
Install Time:    3-4 minutes

Final Fantasy IX:

Original Size:   7.17 GB
Compressed Size: 3.08 GB
Compress Time:   1 hour 10 minutes
Install Time:    7-8 minutes
Note:            On this one i have removed x86 files keeping x64

[K4miKaZe]

Here are more Final Fantasy games with same method. It tooks me a bit longer than i thought.

Tools used: Ultraarc 2900 R5, Srep 3.9.2, Lolz, Xtool 0.9

Computer: 4 cores 3.9Ghz (4.3 boost) + 8GB Ram + SSD

Method: xZLib+Srep+Lolz

Ripped Files: Nothing on X/X2 & XII, 1 language on XIII,LR,XIII-2

All games are from Steam (Steam Editions) with all DLCs

Final Fantasy X & X2 HD Remaster (2 in 1):

Original Size:   36,8 GB
Compressed Size: 23,4 GB
Compress Time:   10 hours 20 minutes
Install Time:    22 minutes
Ripped Files:    Nothing

Final Fantasy XII: The Zodiac Age:

Original Size:   29,3 GB
Compressed Size: 17,9 GB
Compress Time:   9 hours
Install Time:    18 minutes
Ripped Files:    Nothing

Final Fantasy XIII (v1.0.3):

Original Size:   57,9 GB
Compressed Size: 22,9 GB
Compress Time:   8 hours
Install Time:    12 minutes
Ripped Files:    Ripped Japanese files (english files have "us" in filenames)

Final Fantasy XIII-2 (v1.0.1):

Original Size:   27,3 GB
Compressed Size: 9.24 GB
Compress Time:   3 hours 20 minutes
Install Time:    6 minutes
Ripped Files:    Ripped Japanese files (english files have a "u" in filenames)
Note: 
Using ztool and not xtool will give you around 80mb better ratio.
KaktoR got CRC errors using xtool when he did his method but for me
there is no problem, use Xtool 0.9 as i did. CRC checked and its fine.

Lightning Returns: Final Fantasy XIII:

Original Size:   19.2 GB
Compressed Size: 7.51 GB
Compress Time:   2 hours 30 minutes
Install Time:    4-5 minutes
Ripped Files:    Ripped Japanese files (english files have a "a" in filenames)
Note: 
Using ztool and not xtool will give you around 60mb better ratio.
KaktoR got CRC errors using xtool when he did his method but for me
there is no problem, use Xtool 0.9 as i did. CRC checked and its fine.

I have done already Final Fantasy XV too with ztool, its about 46,6gb but im doing it right now again with xtool. With luck it should be posted tomorrow.

[st0rm]

Game Installed Size : 5,36 GB
Compressed Size : 3,45 GB

Nothing Ripped or Encoded.
Multi-6 languages.

Install Time : ~10 mins

Method :

binkpack for all videos
all other files used srep+lzma

[K4miKaZe]

Finally i finished with this series, here are the last 3 games. The biggest one with two methods (Ztool and Xtool). The ztool version was created 2 weeks ago but was not posted because of testing it ingame.

Tools used: Ultraarc 2900 R5, Srep 3.9.2, Binkpack, Lolz, Xtool 0.9 & Ztool

Computer: 4 cores 3.9Ghz (4.3 boost) + 8GB Ram + SSD

All games are from Steam (Steam Editions) with all DLCs

1st step before compression: I removed all duplicated videos and foreign voice files. At first, for removing the duplicated videos you can follow my easy steps:
1. Enter in /datas/movies/, once there enter the first folder, look if there is a "us" folder.
2. Select all files on the "us" folder, right click and cut the files, go one step back to the "jp" folder and paste them there (overwrite the files)
3. After overwriting the files they remain selected, so now cut them again and move them again to the "us" folder (this will delete the files without looking for names).
4. Do the same on all other movie folders. Cutting and pasting was faster for me then open up the two folders and looking for same name archieves.

2nd step before compression (Optional):
This one will give you around 600MB less in space by removing voice files
1. Go to the /Datas/sound/resources/Voice folder.
2. Remove all foreign folders (fr,de,it,etc...) and leave only us & jp folders untouched (this is for english)

Final Fantasy XV - Windows Edition (Build 1138403) "Method 1 with Ztool":

Original Size:   82,6 GB
After 1st Step:  77,2 GB
Compressed Size: 46,6 GB
Compress Time:   26-27 hours
Install Time:    1 hour 13 minutes

Notes:           Compression time is not exact, it took me 3-4 hours to start
                 the compression, so it should be around 23-24 hours

Method:          pzlib+srep+lolz on .earc files
                 binkpack on .bk2/.bik files
                 srep+lolz on rest of files

Final Fantasy XV - Windows Edition (Build 1138403) "Method 2 with Xtool":

Original Size:   82,6 GB
After 1st Step:  77,2 GB
Compressed Size: 46,5 GB
Compress Time:   22-23 hours
Install Time:    1 hour 7-8 minutes

Notes:           Compression time is not exact, it took me 3-4 hours to start
                 the compression, so it should be around 20 hours

Method:          xZLib+srep+lolz on .earc files
                 binkpack on .bk2/.bik files
                 srep+lolz on rest of files

Final Fantasy Type-0 HD (v1.5 includes August 2018 update):

Original Size:   25,1 GB
Compressed Size: 16,2 GB
Compress Time:   5-6 hours
Install Time:    15 minutes
Ripped Files:    Nothing
Method:          xZLib+srep+lolz

World of Final Fantasy:

Original Size:   11,1 GB
Compressed Size: 6,74 GB
Compress Time:   3 hours (Took me 5, same prob as XV)
Install Time:    8-10 minutes
Ripped Files:    Nothing
Method:          xZLib+srep+lolz

WARNING about World of Final Fantasy (Thanks KaktoR !!! ): Just in case you have these files:

\resource\finalizedCommon\mithril\effect\csv\mo000 _テンプレ_4足（小）_eft.csh
\resource\finalizedCommon\mithril\effect\csv\mo000 _テンプレ_4足（大）_eft.csh
\resource\finalizedCommon\mithril\effect\csv\mo000 _テンプレ_2足（大）_eft.csh

Seems that ultraarc gives an error with those files, on my version i dont have these files but if you have them just take them out of the folder before compressing. A solution if you use inno setup is to add them to the setup.exe, they are small so it shouldn´t be a problem. Just add a entry for every file in your inno script under the files section, it should look like this example:

Source: "C:\blablabla\mo000 _テンプレ_4足（小）_eft.csh"; DestDir: "{app}\resource\finalizedCommon\mithril\effect\csv\"; Flags: ignoreversion

Just edit the correct path of the source and do it for all 3 files.

With this 3 games i finished with this series. Now i will add some games this week that are not on the list like Quantum Break, Hitman, etc.... Maybe next week i will start with another serie (Resident evil is the first coming to my mind because its not complete on the index hehehe).