#166
|
|||
|
|||
tested on just cause2 arc files...
default setting nothing change "ProcProfile64.exe xtool.exe precomp -mzlib -c16mb -t100p-1 %1 %1.out" system ryzen 3900x with 32gb *is there arc.ini setting ? |
The Following User Says Thank You to doofoo24 For This Useful Post: | ||
Razor12911 (18-07-2020) |
Sponsored Links |
#167
|
|||
|
|||
Rayman Orgins
bundle_pc.pak (1.9 gb) Quote:
|
The Following User Says Thank You to dixen For This Useful Post: | ||
Razor12911 (18-07-2020) |
#168
|
||||
|
||||
Code:
[External compressor:xzlib] header = 0 packcmd = xtool.exe precomp -c16mb -t100p-1 -mzlib - - <stdin> <stdout> unpackcmd = xtool.exe decode -t100p-1 - - <stdin> <stdout> |
The Following 3 Users Say Thank You to Razor12911 For This Useful Post: | ||
#169
|
|||
|
|||
tested on Dishonored2 with c16m and 512m and set -t100p-1...
work fine on ryzen 3900x and 32gb use all core and ram... 42.1gb to 57.2gb with c16mb 42.1gb to 59.8gb with c512mb *used on all game file... tested unpacking with inno i get ERROR: archive data corrupted... |
The Following User Says Thank You to doofoo24 For This Useful Post: | ||
Razor12911 (18-07-2020) |
#170
|
||||
|
||||
I must have messed up stdio mode during decoding but here is the fixed version.
Last edited by Razor12911; 18-07-2020 at 19:12. |
#171
|
|||
|
|||
now dec work super fast but i noticed it cpu usage around 50% to 70% of threads unlike compress use 90% to 100% when set to
unpackcmd = xtool.exe decode -t100p-1 - - <stdin> <stdout> disk write using ssd nvme mp510 write after burst 400 to 500 mb/s... nvme bottleneck ? need ps5 ssd to get the max |
#172
|
||||
|
||||
you noticed how much memory xtool uses when compressing compared to when decompressing? that's why. xtool uses less memory when decoding and because of this it can't use up the entire cpu because there are times in between where there is nothing to process from memory. I haven't implemented faster code but in future I will.
|
#173
|
||||
|
||||
I talked to you about preflate quite some time ago
glad to see you have made something out of it, will be returning to testing as soon as i am back home!! have produced several videos on youtube on advanced compression past weeks.
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45. |
#174
|
||||
|
||||
talking to me about it isn't the same as implementing it
@everyone here's the xtool with reflate support. I'll once again explain what's the difference. There are 3 deflate precompressors in xtool: zlib, reflate and preflate. The old xtool/ztool/pzlib all had zlib+reflate but they had so many errors so I added preflate as an alternative if you have issues when you use reflate. There are other things to this of course. I added all 3 because sometimes one has an advantage such as speed or better size output. Which is up to you to pick. reflate cannot be used at the same time as preflate or the other way round. but zlib can be used with reflate or preflate (pick one) like this -mzlib+reflate or -mzlib+preflate here are my results on games that use the "normal" deflate configuration using -mzlib: Code:
Compressed 1 file, 1,138,892,800 => 2,611,771,763 bytes. Ratio 229.33% Compression time: cpu 1.34 sec/real 55.54 sec = 2%. Speed 20.51 mB/s Code:
Compressed 1 file, 1,138,892,800 => 2,613,343,052 bytes. Ratio 229.46% Compression time: cpu 1.28 sec/real 86.86 sec = 1%. Speed 13.11 mB/s Code:
Compressed 1 file, 1,138,892,800 => 2,613,650,264 bytes. Ratio 229.49% Compression time: cpu 1.34 sec/real 90.68 sec = 1%. Speed 12.56 mB/s |
#175
|
||||
|
||||
Quote:
it would be nice if you could update the "Game File Scanner" with the new xtool. |
The Following User Says Thank You to BLACKFIRE69 For This Useful Post: | ||
Harsh ojha (23-07-2020) |
#176
|
|||
|
|||
Dishonored. Death of the outsider (yes, again)
game1.resources game1_001.resources game1_patch.resources -mpreflate Quote:
Quote:
|
The Following User Says Thank You to dixen For This Useful Post: | ||
Razor12911 (23-07-2020) |
#177
|
||||
|
||||
Quote:
try with reflate |
The Following User Says Thank You to Razor12911 For This Useful Post: | ||
shazzla (23-07-2020) |
#178
|
||||
|
||||
#179
|
|||
|
|||
-mreflate
Quote:
Quote:
Last edited by dixen; 23-07-2020 at 13:42. |
The Following User Says Thank You to dixen For This Useful Post: | ||
Razor12911 (23-07-2020) |
#180
|
||||
|
||||
DOOM 2016
snap_gameresources.resources gameresources.resources -mxtool 2019 (R3) Quote:
Decompress Quote:
Quote:
Quote:
Last edited by dixen; 23-07-2020 at 15:06. |
The Following 2 Users Say Thank You to dixen For This Useful Post: | ||
Razor12911 (23-07-2020), sanekbest1 (24-07-2020) |
Thread Tools | |
Display Modes | |
|
|