XTool 2020 (Main Project)

[Masquerade]

Originally Posted by L33THAK0R

Quick question, or I guess just asking for some clarification, in regards to "bms2xtl", can you only process a given file with your generated database, if the codec is one that xtool supports? So for example xtool wouldn't be able to process a COMTYPE if it isn't deflate, lz4(hc/x/f)... etc.? I guess what I'm asking in essence is am I correct in saying external, quickbms-native COMTYPEs aren't supported.

Use xtool.ini to add COMTYPEs that QuickBMS supports. Bear in mind that QuickBMS built in compression can vary wildly from that of what the original input file is compressed with so this is really only suitable for encryption algorithms where you're more likely to get a correct output.

Also, not every algorithm that QBMS can decompress it can also compress - such as LZ2K, of which no compression code exists publicly.

You also have totally different implementations of algos althogether such as LZSS where it's basically different every time you see it.

In short xtool.ini compression with QuickBMS is hit/miss.

[shazzla]

Hi!

How can i pass the --dedup parameter into the -m chain ?

[Masquerade]

Originally Posted by shazzla

Hi!

How can i pass the --dedup parameter into the -m chain ?

Just put --dedup into XTool packcmd in arc.ini.

[shazzla]

Currently using that method. Is it possible to pass --dedup ?!

[dixen]

Originally Posted by shazzla

Currently using that method. Is it possible to pass --dedup ?!

Just delete --dedup

[shazzla]

Delete ?!
Why ?
Not really understand....

Edit:
I mean pass --dedup parameter to chain. I dont want a new arc.ini section.

[Razor12911]

There were undocumented changes in xtool 0.6.5, --dedup can be used as -dd so you are able to pass this via freearc provided your arc.ini looks like this

[External compressor:xtool]
header    = 0
packcmd   = xtool.exe precomp { -option} -c32mb -t100p - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

then your method will be something like -mxtool:mzlib:dd

[shazzla]

Thanks ,Z !
If there are other undocumented changes ,it would be nice to publish!

[bunti_o4u]

I am trying to compress Madel of Honor Airborne with xtool but it's not inflating the input files.

Here is the sample:

https://www62.zippyshare.com/v/3b32KZZm/file.html

Result with uelr:

Compressing 2 files, 177,974,335 bytes using uelr:uv

Compressed 2 files, 177,974,335 => 181,783,854 bytes. Ratio 102.1%         
Compression time: cpu 0.13 secs, real 2.30 secs. Speed 77,496 kB/s
All OK

[External compressor:uelr]
header = 0
packcmd = uelr {option} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

Result with xtool:

Compressing 2 files, 177,974,335 bytes using XTool2K20:mue3:c128m:t75p

Compressed 2 files, 177,974,335 => 177,974,456 bytes. Ratio 100.0%         
Compression time: cpu 0.13 secs, real 3.12 secs. Speed 57,116 kB/s
All OK

[External compressor:XTool2K20]
header    = 0
packcmd   = XTool precomp {-option } - - <stdin> <stdout>

IDK what is wrong with xtool compression.

[dixen]

Originally Posted by bunti_o4u

IDK what is wrong with xtool compression.

XTool niot supported decompress ue3 lzo files

[Razor12911]

Update available

Changes

- fixed issues with exporting precompression database
- fixed issues with deduplication feature consuming a lot of system memory
- fixed oodle codec from auto enabling selkie method
- fixed reflate related checksum issues due to false positives

[dixen]

XTool 0.6.6

Test Psychonauts 2

Tested 1 file, 69,667,416,567 => 31,496,410,866 bytes. Ratio 221.19%
Testing time: cpu 11.56 sec/real 443.22 sec = 3%. Speed 71.06 mB/s
All OK

Before that, absolutely all versions issued CRC ERROR in zlib+reflate mode.
@Razor12911, thank you for fix

[Masquerade]

@Razor
Thanks for the update and your continued work

[shazzla]

@Razor12911 :

Xtool 066 bug.

xtool.exe precomp -mreflate -c32mb -t100p --verbose - - < %1 > %1.out

Streams: 11678/11678
Time: 00:00:25 (00:00:22)
Memory: 291 MB (291 MB)

arc.ini :

xtool066\xtool.exe precomp { -option} {options} -t100p - - <stdin> <stdout>

cmd :

arc a -mxtool:mreflate:c32mb p:\output.arc "p:\input.pak"
FreeArc 0.67 (March 15 2014) creating archive: p:\dd.arc
Compressed 1 file, 185,868,230 => 516,491,144 bytes. Ratio 277.88%
Compression time: cpu 0.17 sec/real 6.18 sec = 3%. Speed 30.10 mB/s
All OK

But when dedup enabled: --dedup, -dd, :dd (via arc.ini ,cmd line pararmeter ,etc. Same effect):

xtool.exe precomp -mreflate -c32mb -dd -t100p --verbose - - < %1 > %1.out

EStreamError: TBufferedStream.Seek not implemented

arc.ini :

xtool066\xtool.exe precomp { -option} {options} -dd -t100p - - <stdin> <stdout>

cmd :

$ arc a -mxtool:mreflate:c32mb p:\output.arc "p:\input.pak"
FreeArc 0.67 (March 15 2014) updating archive: p:\dd.arc
Compressing 1 file, 185,868,230 bytes. Processed 100%
ERROR: general (de)compression error in xtool:mreflate:c32mb

P/Reflate,Zlib ,it doesnt matter ,same error.

[Razor12911]

Update available

Changes

- fixed oodle scanner exceptions when incorrect library is used
- fixed issues with deduplication feature