XTool 2020 (Plugins) - Page 6

yasitha · #76 24-01-2021, 05:05

Quote:

Originally Posted by Masquerade

yasitha
The files do not contain many streams.

yes i know.. I figured.
We don't get any good size after compressing..

Razor12911 · #77 24-01-2021, 07:57

Plugin updated

Changes

Added Unreal Engine 3 support to Unreal Engine plugin for lzna compressed games (Mortal Kombat 11)

Tests

GEARASSETS_CYR_ScriptAssets.PSF

Code:

Compressed 1 file, 47,922,080 => 145,786,020 bytes. Ratio 304.21%
Compression time: cpu 0.05 sec/real 14.56 sec = 0%. Speed 3.29 mB/s

Tested 1 file, 145,786,020 => 47,922,080 bytes. Ratio 304.21%
Testing time: cpu 0.06 sec/real 13.97 sec = 0%. Speed 3.43 mB/s

Code:

[External compressor:xtool]
header    = 0
packcmd   = xtool.exe precomp -mue3 -c32mb -t100p --dbase - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

oo2core_5_win64.dll required from game.

dixen · #78 24-01-2021, 10:31

MK 11

PORTALMODE_SCRIPTASSETS.XXX

Quote:

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 110,033,110 => 183,953,957 bytes. Ratio 167.18%
Compression time: cpu 0.11 sec/real 24.48 sec = 0%. Speed 4.50 mB/s
All OK

Quote:

Extracted 1 file, 183,953,957 => 110,033,110 bytes. Ratio 167.18%
Extraction time: cpu 0.09 sec/real 21.87 sec = 0%. Speed 5.03 mB/s
All OK

Great Work! Thanks Razor))

dixen · #79 24-01-2021, 11:53

Quote:

Originally Posted by KaktoR

I think he made a mistake somewhere.

I don't think so..

Some tests

XTool 0.3.6 with ue.dll

Quote:

Compressed 1 file, 416,062,694 => 446,732,701 bytes. Ratio 107.37%
Compression time: cpu 0.48 sec/real 6.18 sec = 8%. Speed 67.31 mB/s
All OK

ue4dt+xtool 0.3.6

Quote:

Compressed 1 file, 416,062,694 => 494,797,151 bytes. Ratio 118.92%
Compression time: cpu 0.45 sec/real 7.54 sec = 6%. Speed 55.21 mB/s
All OK

NOTE.
ue4dt.exe data release 23.11.2019
MD5 - FFCF35D32A416C0599601C44200B776C

Cesar82 · #80 26-01-2021, 14:16

Answering my own previous question, if the parameter -m2 would be passed normally using {:option} as a parameter of the XTool 2020 (ue4 plugin), which was in doubt because it had only tested with Borderlands 3 that uses -m1.
The answer is yes, it worked perfectly, look at the results.

Code:

Rune II sample Rune-WindowsServer.pak

xtool_zlib = XTool 2020 -mzlib
xtool_ue4 = XTool 2020 -mzlib+ue4

Test 01 = srep+lzma2
Compressed 1 file, 1,494,084,687 => 1,181,272,582 bytes. Ratio 79.06%
Compression time: cpu 1.80 sec/real 110.29 sec = 2%. Speed 13.55 mB/s

Test 02 = ue4dt+srep+lzma2
Compressed 1 file, 1,494,084,687 => 619,066,054 bytes. Ratio 41.43%
Compression time: cpu 1.72 sec/real 338.60 sec = 1%. Speed 4.41 mB/s

Test 03 = ue4dt+xtool_zlib+srep+lzma2
Compressed 1 file, 1,494,084,687 => 618,955,970 bytes. Ratio 41.43%
Compression time: cpu 2.06 sec/real 348.92 sec = 1%. Speed 4.28 mB/s

Test 04 = xtool_ue4(-mzlib+ue4)+srep+lzma2
DiskSpan_GUI method = xtool_ue4:m2:k0x5DD20432F2AD810071033FC3F925FFDFD647514524D0A0D222E17D76BAF57BFD+srep_new+lzma2
xtool_ue4 = Arc.ini setting
packcmd = "XTool.exe" precomp -mzlib+ue4{:option} -c32mb -t100p -d1 --dbase - - <stdin> <stdout>

Compressed 1 file, 1,494,084,687 => 545,149,382 bytes. Ratio 36.49%
Compression time: cpu 1.84 sec/real 179.33 sec = 1%. Speed 8.33 mB/s

Razor12911 · #81 27-01-2021, 23:49

Plugin updated

Changes

- updated watch dogs 2, watch dogs legion and far cry primal to support new library structure (other plugins not affected)

@Cesar82
Well I did say I did receive a sample where m2 needed to be created, there are several other variants of this unreal engine structure that xtool doesn't support so there could even be m3, m4 in future...

@dixen
sample? also send the ue4dt that gave different output.

Razor12911 · #82 31-01-2021, 03:45

Plugin updated

Changes

- Updated unreal engine plugin

Quote:

Originally Posted by dixen

That's better)

Compressed 1 file, 18,898,278 => 25,297,361 bytes. Ratio 133.86%
Compression time: cpu 0.00 sec/real 2.24 sec = 0%. Speed 8.44 mB/s
All OK

But ue4dt - Ratio 196.89%

Now

Code:

Compressed 1 file, 18,898,278 => 37,188,708 bytes. Ratio 196.78%
Compression time: cpu 0.02 sec/real 2.59 sec = 1%. Speed 7.31 mB/s

Snake288 · #83 31-01-2021, 04:05

Hello
Razor12911
XTool 2020 (Plugins) hitman_R2Plugin updated will come ?

Snake288 · #84 31-01-2021, 04:09

Hello
Razor12911
Hitman 3 (R2) and Mortal Mombat 11Unreal Engine 3 (lzna) can I get full detailed information about how the method of use should be?

Hitman 3 and Mortal Mombat 11 DiskSpan_GUI
how can you use compression for these two games

Cesar82 · #85 31-01-2021, 06:40

Comparison between the #POST test with XTool 0.34 and previous Unreal.dll (R1) vs new version XTool 0.38 and Unreal.dll (R3).
There was a big increase in Ratio but the speed dropped a lot.

Razor12911 · #86 03-02-2021, 13:07

Quote:

Originally Posted by Snake288

Hello
Razor12911
Hitman 3 (R2) and Mortal Mombat 11Unreal Engine 3 (lzna) can I get full detailed information about how the method of use should be?

Hitman 3 and Mortal Mombat 11 DiskSpan_GUI
how can you use compression for these two games

Hitman 3 needs some work, as for MK11. -mue3 is the method to use.

Razor12911 · #87 04-02-2021, 00:57

Bethesda

Supported games
The Elder Scrolls V: Skyrim (requires liblz4.dll)

Usage
Place bsa.dll near xtool.exe along with required libraries and use -mskyrim

Notes

The library is required both encoding and decoding.

Some results
Skyrim - Textures0.bsa

Code:

Compressed 1 file, 655,189,115 => 1,436,500,795 bytes. Ratio 219.25%
Compression time: cpu 0.69 sec/real 15.58 sec = 4%. Speed 42.06 mB/s

Tested 1 file, 1,436,500,795 => 655,189,115 bytes. Ratio 219.25%
Testing time: cpu 0.69 sec/real 7.27 sec = 9%. Speed 90.11 mB/s

As requested

KaktoR · #88 04-02-2021, 02:22

I uploaded the files "Skyrim - Meshes0.bsa" and "Skyrim - Meshes1.bsa".

Code:

Skyrim - Meshes0.bsa

Compressed 1 file, 1,152,069,673 => 2,097,275,557 bytes. Ratio 182.04%
Compression time: cpu 0.89 sec/real 23.95 sec = 4%. Speed 48.11 mB/s

arc.exe: wclose: invalid argument (Bad file descriptor)                     in "Skyrim - Meshes0.bsa". File is broken.

Code:

Skyrim - Meshes1.bsa (file is broken in a second test below)

Compressed 1 file, 373,427,426 => 531,939,990 bytes. Ratio 142.45%
Compression time: cpu 0.31 sec/real 4.42 sec = 7%. Speed 84.56 mB/s

Extracted 1 file, 531,939,990 => 373,427,426 bytes. Ratio 142.45%
Extraction time: cpu 0.23 sec/real 3.27 sec = 7%. Speed 114.20 mB/s

Code:

Skyrim - Textures1.bsa

Compressed 1 file, 1,509,673,333 => 1,719,892,975 bytes. Ratio 113.92%
Compression time: cpu 1.31 sec/real 7.74 sec = 17%. Speed 195.12 mB/s

Extracted 1 file, 1,719,892,975 => 1,509,673,333 bytes. Ratio 113.92%
Extraction time: cpu 1.33 sec/real 6.50 sec = 20%. Speed 232.39 mB/s

Code:

Skyrim - Textures0.bsa - Skyrim - Textures8.bsa

Compressed 9 files, 7,723,871,672 => 13,214,174,974 bytes. Ratio 171.08%
Compression time: cpu 10.33 sec/real 218.30 sec = 5%. Speed 35.38 mB/s

Extracted 9 files, 13,214,174,974 => 7,723,871,672 bytes. Ratio 171.08%
Extraction time: cpu 6.92 sec/real 201.31 sec = 3%. Speed 38.37 mB/s

---------------------------------------------------------

Same issue as Hitman 3 below

Code:

Whole Data folder (w/o sound/voice files)

Compressed 21 files, 10,231,828,591 => 13,367,393,717 bytes. Ratio 130.65%
Compression time: cpu 12.72 sec/real 277.62 sec = 5%. Speed 36.85 mB/s

WARNING: CRC failed in "Skyrim - Meshes1.bsa". File is broken.
Extracted 21 files, 13,367,393,717 => 10,231,828,591 bytes. Ratio 130.65%
Extraction time: cpu 9.47 sec/real 257.90 sec = 4%. Speed 39.67 mB/s
There were 2 warning(s)

---------------------------------------------------------

Whole Data folder (w/o sound/voice files) but with solid = 0 setting

Compressed 21 files, 10,231,828,591 => 16,825,853,659 bytes. Ratio 164.45%
Compression time: cpu 13.20 sec/real 303.24 sec = 4%. Speed 33.74 mB/s

Extracting 21 files, 10,231,828,591 bytes. Processed  13.0%WARNING: CRC failed in "Skyrim - Meshes0.bsa". File is broken
Extracted 21 files, 16,825,853,659 => 10,231,828,591 bytes. Ratio 164.45%
Extraction time: cpu 10.31 sec/real 258.47 sec = 4%. Speed 39.59 mB/s
There were 1 warning(s)

NOTE: Strangely enough that this time the file "Skyrim - Meshes1.bsa" does not give out a CRC error :confused:

---------------------------------------------------------

I even tested some mod files

Code:

RaceMenu.bsa (Link)

Compressed 1 file, 16,587,136 => 35,407,224 bytes. Ratio 213.46%
Compression time: cpu 0.02 sec/real 9.90 sec = 0%. Speed 1.67 mB/s

WARNING: CRC failed in "RaceMenu.bsa". File is broken.
Extracted 1 file, 35,407,224 => 16,587,136 bytes. Ratio 213.46%
Extraction time: cpu 0.02 sec/real 0.63 sec = 2%. Speed 26.21 mB/s
There were 1 warning(s)

Code:

icepenguinworldmapclassic - textures.bsa (Link)

Compressed 1 file, 5,980,021 => 11,931,955 bytes. Ratio 199.53%
Compression time: cpu 0.00 sec/real 0.62 sec = 0%. Speed 9.69 mB/s

Extracted 1 file, 11,931,955 => 5,980,021 bytes. Ratio 199.53%
Extraction time: cpu 0.00 sec/real 0.63 sec = 0%. Speed 9.45 mB/s

Code:

Vivid WeathersSE - Textures.bsa (Link)

Compressed 1 file, 113,654,441 => 185,505,136 bytes. Ratio 163.22%
Compression time: cpu 0.11 sec/real 2.72 sec = 4%. Speed 41.83 mB/s

WARNING: CRC failed in "Vivid WeathersSE - Textures.bsa". File is broken.
Extracted 1 file, 185,505,136 => 113,654,441 bytes. Ratio 163.22%
Extraction time: cpu 0.06 sec/real 1.65 sec = 4%. Speed 68.70 mB/s
There were 1 warning(s)

Code:

SkyUI_SE.bsa (Link)

Compressed 1 file, 1,234,711 => 1,444,829 bytes. Ratio 117.02%
Compression time: cpu 0.00 sec/real 0.62 sec = 0%. Speed 2.00 mB/s

Extracted 1 file, 1,444,829 => 1,234,711 bytes. Ratio 117.02%
Extraction time: cpu 0.00 sec/real 0.63 sec = 0%. Speed 1.95 mB/s

Code:

Unofficial Skyrim Special Edition Patch - Textures.bsa (Link)

Compressed 1 file, 73,019,853 => 171,264,577 bytes. Ratio 234.55%
Compression time: cpu 0.08 sec/real 6.24 sec = 1%. Speed 11.70 mB/s

Extracted 1 file, 171,264,577 => 73,019,853 bytes. Ratio 234.55%
Extraction time: cpu 0.05 sec/real 1.14 sec = 4%. Speed 64.05 mB/s

Razor12911 · #89 04-02-2021, 17:45

bug seems to be caused by --dbase parameter.

Skyrim - Meshes0.bsa

Code:

Compressed 1 file, 1,152,069,673 => 2,097,540,496 bytes. Ratio 182.07%
Compression time: cpu 1.31 sec/real 20.21 sec = 6%. Speed 57.02 mB/s

Tested 1 file, 2,097,540,496 => 1,152,069,673 bytes. Ratio 182.07%
Testing time: cpu 0.56 sec/real 15.51 sec = 4%. Speed 74.30 mB/s

More xtool updates...

Snake288 · #90 06-02-2021, 23:02

Hello
Razor12911
Square Enix and Crystal Dynamics
Marvel's Avengers XTool 2020 Plugins is it possible ?
a tool made for the game is available
this link https://forum.xentax.com/viewtopic.php?f=16&t=22556 deneyin

from game-related sample files
https://dosya.co/zt3ccmll4z0o/Marvel's_Avengers.7z.html

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
XTool 2020 (Main Project)	Razor12911	Conversion Tutorials	697	10-10-2024 04:30
XTool - Successor of ZTool	Razor12911	Conversion Tutorials	584	22-04-2023 18:16
[Dev]XTool	Razor12911	Conversion Tutorials	180	23-10-2020 06:26
XTool 2019 (Plugins)	Razor12911	Conversion Tutorials	50	16-05-2020 06:14

The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
Cesar82 (24-01-2021), Gehrman (28-04-2022), L0v3craft (25-05-2021)

The Following 3 Users Say Thank You to dixen For This Useful Post:
Gehrman (27-04-2021), KaktoR (24-01-2021), Razor12911 (27-01-2021)

The Following 2 Users Say Thank You to Cesar82 For This Useful Post:
ffmla (27-01-2021), Razor12911 (27-01-2021)

The Following 6 Users Say Thank You to Razor12911 For This Useful Post:
Cesar82 (28-01-2021), DiCaPrIo (28-01-2021), ffmla (28-01-2021), Grumpy (28-01-2021), Mortal Lord (28-01-2021), ZAZA4EVER (28-01-2021)

The Following 5 Users Say Thank You to Razor12911 For This Useful Post:
Cesar82 (31-01-2021), dixen (31-01-2021), ffmla (31-01-2021), Gehrman (27-04-2021), L0v3craft (31-01-2021)

The Following User Says Thank You to Cesar82 For This Useful Post:
Razor12911 (03-02-2021)

The Following 15 Users Say Thank You to Razor12911 For This Useful Post:
Abbat (08-02-2021), Cesar82 (23-05-2021), COPyCAT (11-01-2022), ffmla (04-02-2021), Gehrman (27-04-2021), KaktoR (04-02-2021), L0v3craft (04-02-2021), Masquerade (04-02-2021), Mortal Lord (06-02-2021), oltjon (12-09-2021), PsYcHo_RaGE (08-08-2021), ramydarkness (19-03-2022), RedDanzig (06-09-2023), ScOOt3r (05-02-2021), vint56 (05-02-2021)

The Following 3 Users Say Thank You to KaktoR For This Useful Post:
L0v3craft (04-02-2021), Mortal Lord (06-02-2021), Razor12911 (04-02-2021)

The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
KaktoR (04-02-2021), Mortal Lord (06-02-2021), PsYcHo_RaGE (06-02-2021)