3 Way Compression, Masked Compression
 

Okay, It's Been a long Time Since i made something for the forum

This Tool set features :

1) FA Next implementation to Inno
2) Eugene Shelwien's 7Zip implementation to Inno
3) Updated Arc with more tools, i removed obsolete Tools.
4) Masks Took a significant Update
5) Added Masks on FA Next and 7zip
6) I rewrote the manual to give directions and basics in depth

This Toolset isn't optimal for amount of ram :D this forum is far mature now to give you ram optimals for each spec - Trial will be your father and Error will be your mother.

7) Inno has been updated to host the new stuff
8) Added Patch_Mod support via xDelta3 and a Secondbar


FAQ:
Q: Will there be a WPI Inno ??
A: Maybe if you want it, why not.

Q: How to use this effectively?
A: Data Analysis is the key, whether you like or not !! checking what you deal with will save loads of trouble.

Q: Some Compressor failed, What do i do ??
A: I am not responsible for the compressors themselves, i didnt write their codes. Therefore i am not to be blamed for their Malfunction. I am not responsible for your Data loss. Though i will check if you send me a Pic of the problem

Q: Will you update this ?? will you Add more to it ??
A: I plan to support it a bit, and i also plan to give a huge pack of toolset, how to transcode via ffmpeg in parallel and how to manipulate xdelta to get your job done.
e.g. if you unpack a total war pack file and then pack it with 7zip tar codec you can xdelta it and get small difference like 1 or 4 KILOBYTES.

Q: Have you Kept tools from us again??
A: The only tools i have kept from this are: Razor with stdio support which Razor made for me and Reflate which me and Razor made back in 2016!
Nothing else



Update 1: Calculate MD5 a la Fitgirl
You will find the readme.txt inside that will guide you through :D

Update 2: Data Analysis Tool by Razor12911 is Added

Update 3: 7Zip Shelwien Patch 1 For Folder Management

Update 4: Masked Compression Additions, Multithreaded Precomp V 0.48, Speed Optimized by me, CLS zstd, Multithreaded Razor by CLS
Check Readme for more !!

Your updates are always a great resource, even if some methods have already been developed in your latest work.
Momentarily I abandoned the development and the study on FAN, also being a better compressor in all its points of view, due to the absence of the "-ep/1/2/3" mode for the complete control of the path. Very uncomfortable situation for exctraction of created archives of application or game. Too bad that our Bulat has not given any option, information or explanation about it, to remedy the problem.

Thanks for the update! Before packing, files are not analyzed for the most efficient compression, but are taken from the list of arc.groups?

where to get the Scanner Zee, which you mention in the manual?

I have added the data analysis tool by my dearest friend Razor12911.

Felice its all about options and handle, if you think you can handle the "new" Fa Next then go ahead, but you will say Arc is damn cool and people are used to work with it, right ???
yeah it has many additions that Fa Next lacks at the moment.

My point of view is vast more differential, if you guys don't start using the Next Gen 3 years after release, there is still not an inno that uses FA Next, then how can we motivate Bulat to update this tool ?, how can even hope to see the new srep V5 ?? how can we see FA 0.20 ??

Arc is so complete that devoures the rest of them all, But here i am 20hours++ having 10 manuals to make it as simple as it gets, people must start to go ahead.

The FAN, is my opinion, was born castrated, the concept of a new compressor had to be to get the same FA options with something more and not less. How can this be possible to develop something new in applications or in ISS, if is no the elementary basis and the most common options in FAN.
The situation is as follows, FA'Next 0.11 has stopped since 08/10/2016, there has been no more updates from Bulat, if he does not update his work, none of us here will be able to developing something new with FAN, I think the concept was clear, I think we have publicized it enough with your work and my applications, but I don't think we can go any further. Now it's up to Bulat Ziganshin.
I hope you read this post, and convince yourself in a future update for the FAN project, and for all its Fans.

I think you forgot the word 'not'

;)

thanks for pointing this out :D Last this i want is people pointing fingers to me for data loss :P hahahaha

Enjoy Grumps.


To Felice,

What i want Felice is to motivate maybe a developer who was lost somewhere.

But i will say it right here, with or without Bulat Compression will go on.

We can't stay with Arc forever, this is why i decided to also include Mr Shelwien's Stuff.

My long Plan is to basically remove Arc slowly and painfully from my toolset.
i will keep FAN since its a bit Newer.

3 Way Compression, Masked Compression

(xtool,ztool,lolz,srep)
More dead File compression ?
More powerful Method ?

Computer properties

Processor : Intel Core i9 9900K 3.6GHz 5.0GHz 16M Processor 8 Cores up to 5.0 GHz

Memory : G.SKILL TridentZ RGB Series 32GB (4x8GB) DDR4 3600MHz

SSD : Samsung 500GB 960 EVO NVMe M.2 SSD

with large capacity ssd/hdd becoming more and more affordable it's waste of cpu resource to compress games with precompresor...
i just bought 3 HDD 8TB for total 450$ :D
started to convert all of my games to srep+zstd, super fast decompression...

That's one point of view. For some people to try to push the limits of compression ratio is not a waste in any sense, is a reward of some sort.

If you specify the path to the folder with the game, the script will check the files before compression for the best result?

when using xtool writes error disk full

This tool is going to Next Gen for the best method and powerful. Which means the Arc and FA that we need to see update at newer version or else... For me to get some different something that we could use just like that.

Masked Additions v1 added Check Readme if you want more info on those :D

Enjoy!

PS. if you repack <South Park - The Fractured but Whole> then this precomp is what you look for :D

Uharc can be fit with Masked Compression... Test this.

let me give it a try then :D maybe i will add it as cls-uharc
if the results are promising

It was already that i've include that... u dont need to make cls-uharc :D

Multithread was made by me
Optimization has been moded by me
But thanks to Universal CLS Creator from Krinkels.org
:D

Universal CLS Creator is 78372 :p

Thanks... but somehow about UHARC need to a little bit optimize and need to
get the a result if the UHARC has perfect or not... Try it :D

any compressor create temp files during installation i gave up using a long time...
only <stdin> <stdout> for me like zstd/7z/4x4:lzma/srep/xtool...:)

Me too... if I can do with the method using like this
What happen it is?? :confused:
I'm using a phone now. Which means I have a job.

Will there be a WPI Inno ？ When？

WPI Inno, doesn't use isdone.dll.

isdone.dll is used for all those functions that unpack FAN and Shelwien 7zip.

in order to work i need to change many things !!

I dont think so... but if the WPI have IsDone.dll which means that u can use... Unfortunately... that old files doesnt support with Masked Compression v3. So u have gonna only use CIUv3 or ASIS Installer... I recommended.

Can anyone kindly please help me----

I have compressed a 0.98GB file down to 0.54GB ..... that's good but when I try to unpack or install it using Inno setup script... it uses just 256.57MB.... please anyone help with decompression memory increase....
I want to increase the ram usage like 1678MB during installation and anyone help me with it..

For example to get a large memory, First compress with these settings:
If decompression using more memory usage, I guess it's fine.

How to unpack with inno script?

I packed sekiro with arc\Arc a -ma9 -ds -lc4096 -ld4096 -di -i1 -ep1 -ed -r -w.\ Setup-3.xarc ^
-mpoodle+srep:m3f:a2:l256+lolzi:d128m:mt2:ldmf1:ldc 0:mc1023:mtb64:x0 "D:\Games\Sekiro Shadows Die Twice\3\*"

thanks

Hi, I'm new to compression and this was my first software that I tried...
I somehow got the inno setup working to extract files by replacing the name setup-1.arc to <myfilename> but where do I put the password to extract the files that had password while compression.
And how to extract multiple files? I mean setup-1.bin, setup-2.bin and so on!!! Do I just copy and past the same line with different name?
Thanks in advance...

How to unpack result files with inno, pls help!!

tested the Multithreaded Precomp V 0.48,
when I have setup this
The multi thread works, but it will call the cls-precomp.exe instead of cls-precomp_x64.exe

The compressing time reduced a little bit, and the result is 4% smaller?
Which doesn't seem to be right, multi thread should only reduce time not result size.
When try to unpack the result, it says
ERROR: archive structure corrupted (decompression of control block failed)Press any key to continue . . . :(

Reproduce:

You've misunderstood it. There's no Precomp with multiple threads. The Magic is in the "cls-precomp.dll" file.

CLS file for FreeArc is something like a DLL file for Windows OS. Remember that when you use a CLS file, you shouldn't declare a method similar to CLS name in the arc.ini. In your case, it shouldn't be the method name of the "precomp" in your arc.ini for both compression and decompression.

It finally says that you don't need the configuration file (arc.ini) for CLS files (Some CLS files require their own configuration file (cls-precomp.ini). ;)

Thanks for the quick response and explanation.

I read the readme.log in Masks_Additions_v1.7z and wasn't fully understand the difference that arc.exe will use cls- files without the need to declare a external compressor in arc.ini, but for FA Next, it has to be declared in fa.ini

I tried again with a clean extracting of Masked_Compression_v3.0_.7z
adding the cls- files from Masks_Additions_v1.7z to where arc.exe is.

And in the Advanced_Data_Arc.bat I changed the method to :

This compressed fine.

I copied the srep and xz methods into the arc.ini in the folder of Arc_u.

Then I tried to decompress with Advanced_Data_Unarc.bat

but it gives error of

I can see if you can show me your example. (both compression and decompression)

Ok a simplier version to reproduce the problem:

Download Masked_Compression_v3.0_.7z and extract.

Put in a random file in pack folder for testing.

Try to run Advanced_Data_Arc.bat

with default packing command of

Packing is fine.

Try to unpack.

problem 1:

Arc_u folder has cls-lolz.dll and cls-lolz_x64.exe but not in Arc folder.
Guess when unpacking cls-lolz will be called, this cause the following problem of:

cls-lolz: Can't create read mapping

while trying to unpacking.
I moved cls-lolz.dll,cls-lolz_x64.exe out temporary to solve this issue.

Problem 2:

Arc_u folder has CLS-srep.dll and cls-srep_x64.exe but not in Arc folder.
This also create problem of

CLS-srep:can't create read mapping

while trying to unpacking.
I moved CLS-srep.dll and cls-srep_x64.exe out temporary to solve this issue.

Try unpacking again,
report error of

Upon checking the

The srep64.exe in Arc and Arc_u folder is not the same.
Tried to unpacking with the srep64.exe from Arc folder, will not unpack.
Tried to packing with the srep64.exe from Arc_u folder, will not pack.

It's a dead end :(

Also

Also Arc's arc.ini has
[External compressor:lolz]
header = 0
packcmd = "lz\lolz_x64.exe" {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = "lz\lolz_x64.exe" $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

Arc_u folder's arc.ini has:

[External compressor:delta,exe,mm,rep,tor,lolz,lolzi,lolz2,l zma]
header = 0
unpackcmd = fazip -i0 decompress:{compressor}{:option} <stdin> <stdout>

But even change to the same exe for lolz will not unpack.


Changed to xz

-msrep:m3f:a8:l256+exe+xz

will not unpack.

copied srep64.exe found in 'maksed data compressor 2.5' to both the arc and arc_u folder, it will still packing fine and not unpacking?

From here
https://fileforums.com/showpost.php?...&postcount=637

srep+lolz might have problem.
But I tested srep+xz same issue.

Might be same issue here:
https://fileforums.com/showpost.php?...&postcount=582

github
This error:
Occurs when you are trying to run FreeArc decompression without administrator privileges.

Thank you.
While running with administrator privileges those two errors are gone.
With the example command line to compress and decomperss works.

The next question is , what confused me for the last time, is
if I disable cls-lolz.dll and declare the method in arc_u\arc.ini:

This is the same definition in the compressing process. But the decompress will fail with


not an SREP compressed file.


Is it requied to use the cls-lolz.dll for any lolz compressed file?


Same thing happens to srep. If I disable cls-srep.dll and declare the method in arc_u\arc.ini:

This is the same definition in the compressing process. But the decompress will fail with


ERROR: archive data corrupted (decompression fails)


Is it requied to use the cls-srep.dll for any srep processed file?

I thought cls dlls are optional to use, not mandatory? That's why last time when I moved out the cls files, it ends up with
ERROR: archive data corrupted (decompression fails)

github
The CLS dll is actually the controller part of the decompressor, with the EXE doing the work.

For lolz and srep, you must use the cls.