Best Compression Methods for 'Specific' Games. Q&A

[Wanterlude]

Originally Posted by dixen

My test with xtool v 0.77 + oodle 2.9.5

Sorry I forgot to edit that...
After Razor updated xtool (or plugin), everything works fine

[Wanterlude]

Hello everyone!
Does anyone know how to fix these errors? (Xtool&UnityPlugin latest versions)
Game: Pathfinder: Wrath of the Righteous (Build 11836620)
Dir: Bundle folder (34 gb)
xtool.exe run as administrator
Game folder not in read only

[L0v3craft]

Someone tried to precompress Baldur's Gate 3?

Sample (Textures_2.pak):

https://gofile.io/d/xXO3cs

Another sample:

https://gofile.io/d/0n69EX

[KaktoR]

I guess they using the same engine as in Divinity 2, I bet they still use lz4. Maybe try to use the lspk bms script and make a xtl plugin.

I don't looked at the files so I cannot say anything atm. I am at work lol

[L0v3craft]

Originally Posted by KaktoR

I guess they using the same engine as in Divinity 2, I bet they still use lz4. Maybe try to use the lspk bms script and make a xtl plugin.

I don't looked at the files so I cannot say anything atm. I am at work lol

I didn't try to create the database but I already tried with quickbms and that script. It can't unpack the game files.

[Nekhalo22]

How to repack game Ultimate Marvel vs. Capcom 3
What Tools ?
I want a video explanation

ultimate Marvel vs capcom 3
method used ztool zlib streams
pzlib+srep:m5f:a1+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd 1:mtt1:mt6:d100m:tt4
initial size 3.53 gb
Repack size 1.75 gb

How do I use this

[ravikant]

Originally Posted by Nekhalo22

How to repack game Ultimate Marvel vs. Capcom 3
What Tools ?
I want a video explanation

ultimate Marvel vs capcom 3
method used ztool zlib streams
pzlib+srep:m5f:a1+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd 1:mtt1:mt6:d100m:tt4
initial size 3.53 gb
Repack size 1.75 gb

How do I use this

You can use this tool to compress your files with your method

[Masquerade]

Originally Posted by Nekhalo22

How to repack game Ultimate Marvel vs. Capcom 3
What Tools ?
I want a video explanation

I already told you what tools you need to use in your other topic.

Not ztool. It's old. XTool, srep, lolz and oggre.

Nobody will make a video.

[Razor12911]

Originally Posted by L0v3craft

Someone tried to precompress Baldur's Gate 3?

Sample (Textures_2.pak):

https://gofile.io/d/xXO3cs

Another sample:

https://gofile.io/d/0n69EX

I made a quick modification to the lspk script, I'm no expert when it comes to bms scripting but eh...

Shared.pak

Compressed 1 file, 78,790,712 => 278,618,150 bytes. Ratio 353.62%
Compression time: cpu 0.05 sec/real 2.87 sec = 2%. Speed 27.47 mB/s

via bg3.xtl (generated using bms2xtl)

bms2xtl.ini

[Config]
SafeMode=1
UserInput=
Exclude=copy
lz4=lz4hc:l9

use liblz4.dll that comes with xtool attachment

Note that on multi pak files, the script will fail that's why safemode is on, for the streams in multi pak files, you have to make sure that freearc captures these files in sequence else the streams will be left behind.

I don't have this game and I can't add support for multi pak files so hope that this approach works.

[Fak Eid]

xtool:mkraken:8+srep_new+lolz

Grand Theft Auto III: The Definitive Edition - 3.17GB
Grand Theft Auto Vice City: The Definitive Edition - 6.8GB
Grand Theft Auto San Andreas: The Definitive Edition - 14.2GB

[Fak Eid]

So, I have a question here:

The problem with kraken compressor is that it takes a lot of CPU memory and takes lot of time to extract.

So, while trying to compress GTA Trilogy using kraken:8, it takes around 45 mins to install all three games on average PC. Is there anyway to speed up the extraction process by adding a pre-compressor to the algo?

[Nekhalo22]

Originally Posted by Masquerade

I already told you what tools you need to use in your other topic.

Not ztool. It's old. XTool, srep, lolz and oggre.

Nobody will make a video.

thanks bro

[Masquerade]

Originally Posted by Fak Eid

So, I have a question here:

The problem with kraken compressor is that it takes a lot of CPU memory and takes lot of time to extract.

So, while trying to compress GTA Trilogy using kraken:8, it takes around 45 mins to install all three games on average PC. Is there anyway to speed up the extraction process by adding a pre-compressor to the algo?

The Oodle family of compression algorithms are very CPU intensive. You can't speed it up.

XTool or Oodlereck, which processes the kraken streams, is the precompressor. Precompressors decompress data and compress it back during installation.

[Illume]

Originally Posted by Razor12911

for the streams in multi pak files, you have to make sure that freearc captures these files in sequence

it doesn't seems to work
FreeArc is correctly sorted files
Textures.pak
Textures_1.pak
Textures_2.pak
Textures_3.pak

solid .arc, bg3.xtl made of separated pak's
Compressed 4 files, 13,743,119,215 => 16,734,251,958 bytes. Ratio 121.76%

per file (not solid) .arc, bg3.xtl made of separated pak's
Compressed 4 files, 13,743,119,215 => 16,734,252,036 bytes. Ratio 121.76%

           Pos            Size      Compressed   Files
------------------------------------------------------
            31   4,293,937,007   7,285,063,990       1
 7,285,064,021   4,293,777,600   4,293,780,186       1
11,578,844,207   4,294,919,680   4,294,922,266       1
15,873,766,473     860,484,928     860,485,594       1

solid .arc, bg3.xtl made of joined pak's
Compressed 4 files, 13,743,119,215 => 16,734,251,958 bytes. Ratio 121.76%

per file (not solid) .arc, bg3.xtl made of joined pak's
Compressed 4 files, 13,743,119,215 => 13,743,127,639 bytes. Ratio 100.00%

so as you can see only first file (Textures.pak) is decompressed
and it's doesn't matter if you join all Textures*.pak to one file and made bg3.xtl from it

[Razor12911]

On Textures.pak, Textures_1.pak, Textures_2.pak and Textures_3.pak

XTool is created by Razor12911

Streams: 8495 / 8495
Time: 00:01:25 (CPU 00:14:32)

Size: 12.8 GB >> 20.8 GB

Done!!!

To everyone here plus repackers (I won't say, you know yourselves) who use my tools, I had to set aside time and download 120GB game just so I could tweak a 1KB script by add a few lines (only 6 lines were missing), just simple copy and paste from original script then the script will work.

XTool has so many ways of enabling anyone of any knowledge and skill level to be able to make a plugin that can work on game without requiring the author to every time provide and provide, I thought that making bms2xtl and adding generate feature would at least bridge the gap but it doesn't seem to be case, I spent time on making the documentation, explaining things, I made the source code available but then what's the point? And don't bother replying to this thread (we only post methods here), I'm just venting don't mind me.

I actually hope all games use leviathan level 9 so compressing and repacking games becomes pointless.