MTX - The Universal Accelerator

[78372]

What people thinks development is? Remaking old projects with more bugs and making non sense project is not development. If you can make something new that's development, even if you remake and make something better than before that's development. Posting same thing over and over again by changing a bit of information is spamming, not development.

[Ele]

Sorry for bothering mr.BLACKFIRE, This may be a useful thread but we can't find the download section here. so please reupload it.
Thank you.

[github]

Hi,

I tried to use the settings in the snapshot, which should be using precomp048.exe

but when I test a packing, method called is

MTXprecomp048
-> calls method precomp048
-> calls precomp048.exe

however it is reporting error with precomp038.exe in the same directory.

It is MTX 5.0.0.0

[Ele]

Originally Posted by github

Hi,

I tried to use the settings in the snapshot, which should be using precomp048.exe

but when I test a packing, method called is

MTXprecomp048
-> calls method precomp048
-> calls precomp048.exe

however it is reporting error with precomp038.exe in the same directory.

It is MTX 5.0.0.0

Precomp v0.38 requires "packjpg_dll.dll" and "packjpg_dll1.dll" next to the precomp038.exe.

[github]

Thanks, that could explain part of it.
But why it would invoke precomp038.exe?
Is MTX parsing every external compressor defined in arc.ini as well as try to load them once to build some kind of lookup table into memory for later use?

[github]

; ========== for MTX testing ================

[External compressor:rz, razor, rz64]
header = 0
default = -d 128m
; packcmd = "Rz\RZ.exe" a {options} $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
; unpackcmd = "Rz\RZ.exe" e -y $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
; or

packcmd = "Rz\RZ.exe" a {options} MyOutput.out MyInput.in
unpackcmd = "Rz\RZ.exe" e -y MyOutput.out MyInput.in
datafile = MyInput.in
packedfile = MyOutput.out

[External compressor:bcm, bcm32]
header = 0
default = -9
; packcmd = "Bcm\{compressor}" {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
; unpackcmd = "Bcm\{compressor}" -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
; or

packcmd = "Bcm\{compressor}" {options} MyInput.in MyOutput.out
unpackcmd = "Bcm\{compressor}" -d MyOutput.out MyInput.in
datafile = MyInput.in
packedfile = MyOutput.out

[External compressor:lolz, lolz64]
header = 0
default = -dt -dtb1 -dtw1 -dtm1 -dto1 -dtd1 -mtt1 -mt4 -d64m -fba4096
; packcmd = Lolz\lolz_x64.exe {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
; unpackcmd = Lolz\lolz_x64_u.exe $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
; or

packcmd = Lolz\lolz_x64.exe {options} MyInput.in MyOutput.out
unpackcmd = Lolz\lolz_x64_u.exe MyOutput.out MyInput.in
datafile = MyInput.in
packedfile = MyOutput.out

[External compressor:RazorX, RazorMTX, razorx]
header = 0
default = -c:64m -t:100% --logs
packcmd = "MTX.exe" a:rz {options} - - <stdin> <stdout>
unpackcmd = "MTX.exe" x:rz -t:100p --logs - - <stdin> <stdout>

[External compressor:BcmX, BcmMTX, bcmx]
header = 0
default = -c:64m -t:100% --logs
packcmd = "MTX.exe" a:bcm {options} - - <stdin> <stdout>
unpackcmd = "MTX.exe" x:bcm -t:100p --logs - - <stdin> <stdout>

[External compressor:XLolz, LolzMTX, xlolz]
header = 0
default = -c:64m -t:100% --logs
packcmd = MTX.exe a:lolz {options} - - <stdin> <stdout>
unpackcmd = MTX.exe x:lolz -t:100p --logs - - <stdin> <stdout>

[External compressorrecomp]
header = 0
default = -cn
packcmd = "Precomp\{compressor}" {options} - - <stdin> <stdout>
unpackcmd = "Precomp\{compressor}" -r -o$$arcdatafile$$.tmp $$arcpackedfile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp
; or

;packcmd = "Precomp\{compressor}" {options} -oMyOutput.out MyInput.in
;unpackcmd = "Precomp\{compressor}" -r -oMyInput.in MyOutput.out
;datafile = MyInput.in
;packedfile = MyOutput.out

[External compressor:PrecompX, PrecompMTX, precompx]
header = 0
default = -c:64m -t:50% --logs
packcmd = MTX.exe arecomp {options} - - <stdin> <stdout>
unpackcmd = MTX.exe xrecomp -t:100p --logs - - <stdin> <stdout>

I gave the default example and some random files a go:

precomp048+srep+lolz64 works
precomp048+srep+LolzMTX ERROR: general (de)compression error in LolzMTX

precomp048+srep+rz64 works
precomp048+srep+RazorMTX ERROR: general (de)compression error in RazorMTX

precomp048+srep+bcm32 ERROR: general (de)compression error in bcm32
precomp048+srep+BcmMTX works

It is a bit strange that, if not using MTX it works, using MTX will make it not working.
If not using MTX doesn't work, using MTX will make it work?
Is it because of the input output in the settings?

Another test for
PrecompMTX+srep+ any normal or MTX final compressor

none works.

The console / log doesn't say why at all.
It seems as soon as MTX invokes precomp, it exits/crashes.
The temp folder for precomp has been created, only the 0 folder has 512KB file, all others are 0

[BLACKFIRE69]

MTX New Update v5.0.0.1

What's new: MTX v5.0.0.1

• Some improvements.
• Minor bugs fixed.
• Exception handling.
• MTX.ini is no longer supported by default.
• {compressor} keyword is no longer supported.
• A few more changes:
  1. %exePath% ==> $exePath$
  2. %basePath% ==> $basePath$

Example contains:

• Bcm
• Bsc
• Lolz
• Mcm
• Mpz
• Nanozip
• Precomp
• Razor
• Uharc
• Zcm
• Zstd

[ffmla]

^^
Thanks for the MTX update.
But in freearc alpha build struggled with Antivirus.

https://www.virustotal.com/gui/file/...5ac8/detection

If we turnoff all Ok

[Ele]

Originally Posted by ffmla

^^
Thanks for the MTX update.
But in freearc alpha build struggled with Antivirus.

https://www.virustotal.com/gui/file/...5ac8/detection

If we turnoff all Ok

Maybe because of UPX. He has compressed all exe files with UPX?

[BLACKFIRE69]

Originally Posted by ffmla

^^
Thanks for the MTX update.
But in freearc alpha build struggled with Antivirus.

https://www.virustotal.com/gui/file/...5ac8/detection

If we turnoff all Ok

it's common to see false positives due to upx. I didn't include any trojans with them.

[Masquerade]

@Blackfire69

I've hbeen having issues with both MTX.exe and RazorX trying to compress a few files, leading to an FreeArc error at 99.1% in both tools (bad file descriptor error).

I use srep before running. Will this cause issues during decompression? I've never encountered that before. I'm currently testing that myself. Arc says decompression error in razorx/mtx though, and not srep

[BLACKFIRE69]

Originally Posted by Masquerade

@Blackfire69

I've hbeen having issues with both MTX.exe and RazorX trying to compress a few files, leading to an FreeArc error at 99.1% in both tools (bad file descriptor error).

I use srep before running. Will this cause issues during decompression? I've never encountered that before. I'm currently testing that myself. Arc says decompression error in razorx/mtx though, and not srep

ok, more info please.

how many threads did you use? (for the compression and the decompression)
did you run this test on the same cpu?


in general, MTX returns errors because the number of threads doesn't match.
I mean for example, MTX can't control this situation if you use 8 threads for compression and 16 threads for decompression. this's because the number of threads for decompression should always be less than or equal to the number of threads you used in compression.

[BLACKFIRE69]

how do I fix this? (MSVCP140.dll)

solution: Install VC++ 2015-2017-2019 package (both x86 and x64)

latest Visual C++ downloads

[Masquerade]

I'd argue this is a better solution
https://github.com/abbodi1406/vcredist/releases

Anyways, I solved my issues, it appears the files being extracted were simply too small (1-2kb) and something just went wrong.

I played around a bit and managed to reach a correct extraction:

FreeArc 0.67 (March 15 2014) extracting archive: MASQUERADE-Data_01.MSQ
Extracting 41 files, 5,071,054,255 bytes. Processed   2.6%
Extracted 41 files, 1,955,615,101 => 5,071,054,255 bytes. Ratio 38.56%
Extraction time: cpu 28.59 sec/real 158.83 sec = 18%. Speed 31.93 mB/s
All OK

[BLACKFIRE69]

MTX v5.0.0.2 New Update

What's new:

1. Fixed config file parsing bug. (Thanks to @Cesar82)
 
2. Added support of MTX.ini.
    -- When you use MTX.ini next to the EXE file, 
       the settings "--basePath", "--cfgfile" and "--tmpPath" are overridden. 
       This simply means that if you use MTX.ini, you no longer need the  "--basePath",
       "--cfgfile" and "--tmpPath" setting in the commandline.
    
    -- If you use both MTX.ini and the commandline settings, the MTX will ignore
       the commandline settings ("--basePath", "--cfgfile" and "--tmpPath").
 
3. Compatible with the previous version (v5.0.0.1).

MTX.ini

[MTX64]
MainPath=".\"
Config="$basePath$\arc.ini"
TmpPath="$basePath$\temp64"

Section name
	Filename>> MTX32.exe      then [MTX32]
	Filename>> MTX64.exe      then [MTX64]
	Filename>> MTX.exe        then [MTX]
	Filename>> FileName.exe   then [FileName]

MainPath
	MainPath="$exePath$"  or
	MainPath=".\..\..\"   or
	MainPath="C:\test"

Config
	Config="$basePath$\arc.ini"  or
	Config="$exePath$\arc.ini"   or
	Config=".\..\..\arc.ini"     or
	Config="C:\test\arc.ini"

TmpPath
	TmpPath="$basePath$\temp"  or
	TmpPath="$exePath$\temp"   or
	TmpPath=".\..\..\temp"     or
	TmpPath="C:\test\temp"