pZLib v3 (Final release)

[FitGirl]

Originally Posted by felice2011

Ahh ok... BF3 I had not tried it yet
MEC I'm testing with oodle with different codecs.

Oodle is meh.

[LuzhinE]

Tested on DOOM - Update 5
Ripeados all languages except Spanish, credits and folder mp and palettes

58.8 GB

Use pzlib+srep+lzma

packcmd = pZLib e -m2 -c640m -x -s -r9 -t8 - -o - <stdin> <stdout>

Final size 41 GB

Razor you said it ends in 25-27 GB

[Mini]

+1

[Simorq]

Originally Posted by LuzhinE

Tested on DOOM - Update 5
Ripeados all languages except Spanish, credits and folder mp and palettes

58.8 GB

Use pzlib+srep+lzma

packcmd = pZLib e -m2 -c640m -x -s -r9 -t8 - -o - <stdin> <stdout>

Final size 41 GB

Razor you said it ends in 25-27 GB

DOOM Update 5 Only ENG (Remove MP , SnapMap , mega.pages)
Srep+Lzma2 : 34GB
pzlib Only Work DOOM File
base\gameresources.resources
base\gameresources.patch
pZLib+Srep+Lzma2: 30 GB Unpack Crash (I think the lowlead system)

[ChronoCross]

Pzlib V3H works really good!. Very clever to include reflate libs.
pack and unpack without errors.

[Gupta]

If i recompress something without std input output, everything works awesomely, amazingly fast, delivers best ratio and most amazingly restoration always works
but whenever the std input output is used with arc, restoration never works it always gonna struck at 0.0%, i don't get a single file on which it works but without std in-out every thing works and yes crc matches always

Tested on Witcher 3, Grand theft auto 5, Skyrim Legendery edition.

[LuzhinE]

Pro Evolution Soccer 2017 with Argentina commentary

Game Size = 5.54 GB
Rpack Size = 3.55 GB

Installation time 8 minutes

pzlib+srep+lzma2

[shazzla]

Hi guys !
i hope someone can help me,because im in trouble with pzlib3 hotfix.
I cant decompress the archive using cls_pzlib.dll. It says :

ERROR: archive data corrupted (decompression fails)

The facts :
PZLib 3 hotfix
FreeArc 0.67 (December 12 2012)

@Compression :

Arc.ini :
[External compressorzlib]
packcmd = pzlib e - -o - <stdin> <stdout>
unpackcmd = pzlib d - -o - <stdin> <stdout>

Command:
d:\Trashcan\ISDone_Reflate\pack>arc.exe a -mpzlib d:\Trashcan\ISDone_Reflate\pack\1.arc d:\Trashcan\ISDone_Reflate\pack\autotest.tmd
FreeArc 0.67 (December 12 2012) updating archive: d:\Trashcan\ISDone_Reflate\pack\1.arc
Compressed 1 file, 93,613 => 446,170 bytes. Ratio 476.6%
Compression time: real 0.10 secs. Speed 955 kB/s
All OK

@Decompression:

Arc.ini:
[External compressorzlib]
unpackcmd = pzlib d - -o - <stdin> <stdout>

Arc.ini and CLS_pzlib.dll are in the decompression folder.

d:\Trashcan\ISDone_Reflate\unpack>unarc x 1.arc
FreeArc 0.67 unpacker. Extracting archive: 1.arc
Extracting Trashcan\ISDone_Reflate\pack\autotest.tmd (93613 bytes)

ERROR: archive data corrupted (decompression fails)

BUT if i remove the CLS and copy pzlib.exe and its DLL's to the decompression folder... It unpacks !

Am i miss something ?

[zouzouni]

Originally Posted by shazzla

Hi guys !
i hope someone can help me,because im in trouble with pzlib3 hotfix.
I cant decompress the archive using cls_pzlib.dll. It says :

ERROR: archive data corrupted (decompression fails)

The facts :
PZLib 3 hotfix
FreeArc 0.67 (December 12 2012)

@Compression :

Arc.ini :
[External compressorzlib]
packcmd = pzlib e - -o - <stdin> <stdout>
unpackcmd = pzlib d - -o - <stdin> <stdout>

Command:
d:\Trashcan\ISDone_Reflate\pack>arc.exe a -mpzlib d:\Trashcan\ISDone_Reflate\pack\1.arc d:\Trashcan\ISDone_Reflate\pack\autotest.tmd
FreeArc 0.67 (December 12 2012) updating archive: d:\Trashcan\ISDone_Reflate\pack\1.arc
Compressed 1 file, 93,613 => 446,170 bytes. Ratio 476.6%
Compression time: real 0.10 secs. Speed 955 kB/s
All OK

@Decompression:

Arc.ini:
[External compressorzlib]
unpackcmd = pzlib d - -o - <stdin> <stdout>

Arc.ini and CLS_pzlib.dll are in the decompression folder.

d:\Trashcan\ISDone_Reflate\unpack>unarc x 1.arc
FreeArc 0.67 unpacker. Extracting archive: 1.arc
Extracting Trashcan\ISDone_Reflate\pack\autotest.tmd (93613 bytes)

ERROR: archive data corrupted (decompression fails)

BUT if i remove the CLS and copy pzlib.exe and its DLL's to the decompression folder... It unpacks !

Am i miss something ?

This pzlib v3 (so is V2) doesn't work with cls pzlib Dll ....not meant to work with , Razor 12911 didn't program it to use cls Dll... ; )

Hey Razor , Thx again for that impressive tool , awesome work adding reflate functionnality for special zlib headers (optionnal Dll) ... wow ,very fast and great compression ratio

.... but main thing is that I can't unpack at all , always give crc checksum error at some point!

I tried on Shadow Warrior 2 bin files . Pzlib could reflate 12.9 to 22 Gb and then applying srep +lzma I could get a nice 8.4 Gb but decomp ( using ASC v0.0065 ) will always get stuck no matter how I do ... (same with pzlib v2)

I tried both V3 and hotfix, with and without optionnal files, I tried
parameters like :
-m2 -x -r9 -t4 (out of 8 threads for my xeon 3440) with optionnal Dlls
-m2 -c128m -t4
-m2 -c32m -st50
.....all giving roughly same ratio but still unpacking errors (ASC just stops decomp but no error)

Then i tried changing Input/Output settings in arc.in
from: - -0 - <stdin> <stdout>
to - $$arcdatafile$$.tmp -o $$arcpackedfile$$.tmp (PrinceGupta recommendation)
....still errors at decomp , ASC stops

Then I tried to remove files on which ASC seems to hang... it always hangs on a new file, eventhough those files could be decomp previously (before I start to remove them)

Does this has something to do with ASC ....???

Then I finally tried to change Srep settings playing between m3f/m5f and even adding -hash=md5 crc checksum.... same results, ASC stops.

I am talking about errors because I am pretty sure that if I use inno script it will send me crc checksum error ....this already happenned to me using pzlib v2 with Skyrim SE and MGSV TPP (ASC stops and Inno gives a crc error)

....and I ve just finished DarkSiders Warmastered Edition .... It wasn't decompressing either (-m2 -c400m -t4, seems to be the best setting to catch all zlibs) ....I tried Srep m5f setting and it now decompress ok with ASC ..... awesome!


BIG thk you anyway for this great christmas Gift !!! we have a new toy to play with!!

[shazzla]

I had no information about PZlib V3 was not supported. Thanks,but in this case another problem :
ISDONE :

[External compressorzlib]
header = 0
packcmd = pzlib e -v - -o - <stdin> <stdout>
unpackcmd = pzlib d - -o - <stdin> <stdout>

pzlib3hotfix.exe ,both dlls and arc.ini included...
error : unsupported compression method pzlib
unarc.dll returned an error code : -2

i dont understand.
and where can i get new information about PZlib ? Is this the only place ?

[zouzouni]

Originally Posted by shazzla

I had no information about PZlib V3 was not supported. Thanks,but in this case another problem :
ISDONE :

[External compressorzlib]
header = 0
packcmd = pzlib e -v - -o - <stdin> <stdout>
unpackcmd = pzlib d - -o - <stdin> <stdout>

pzlib3hotfix.exe ,both dlls and arc.ini included...
error : unsupported compression method pzlib
unarc.dll returned an error code : -2

i dont understand.
and where can i get new information about PZlib ? Is this the only place ?

Did you encode using pzlib v3 along with the 2 optionnal Dlls ... if so you need then in decompression folder and you need to add exctraction commands in INNO....

PZLIB+DLLS at comp and decomp ...otherwise it will give you an error!

your arc.ini is ok for decomp, don't change it ; ) ... but -v at comp is from previous pzlib version ...

you need something like that : packcmd = pZLib e -m2 -x -r9 -t4 - -o - <stdin> <stdout> to use pzlib v3 with dlls
-t4 = 4 cores
-x = ultra setting
-r9 = processing level ( from 1 to 9 ; 0 for automatic)

and for unpacking: unpackcmd = pZLib d -t8 - -o - <stdin> <stdout> (it will use up to 8 cores for decomp if available)

[shazzla]

So... then it cant be extracted by the ISArcExtract function ?

Is the -f worked ?

[zouzouni]

yes it can be extracted through ISArcExtract.... just add lines in your inno script to extract needed files before isarcextract starts!

eg: ExtractTemporaryFile('pZLib.exe');
ExtractTemporaryFile('raw2hif_dll.dll');
ExtractTemporaryFile('hif2raw_dll.dll');

-f is for fast verification of files, don't use it with -m2 option ; should only be used with -m1 option

[shazzla]

Originally Posted by zouzouni

yes it can be extracted through ISArcExtract.... just add lines in your inno script to extract needed files before isarcextract starts!

eg: ExtractTemporaryFile('pZLib.exe');
ExtractTemporaryFile('raw2hiff_dll.dll');
ExtractTemporaryFile('hif2raw_dll.dll');

Those files are included and extracted after running the "setup.exe" ! Arc.ini too -->

unsupported compression pzlib.

It cant decompress the archive :
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\c1.dat'), ExpandConstant('{app}\'), '', false, '', '', ExpandConstant('{app}'), notPCFonFLY {PCFonFLY}) then break;

WTH ?!


Edit :

if not ISExec(0, 0, 0, ExpandConstant('{tmp}\arc.exe'), ExpandConstant('x -o+ -cfg"{tmp}\arc.ini" -w"{app}" -dp"{app}" "{src}\try.arc"'), ExpandConstant('{tmp}'), '...', False) then break;

Extract successul !

But ISArcExtract would be better....

[zouzouni]

a picture to illustrate crc checksum error in inno ( ASC stops decompression but doesn't give this error)

I had to setup a test inno installer with existing script of mine for Skyrim SE....

it shows install dir for Skyrim SE but files are from Shadow Warrior 2 ...bin files as described in my previous post !

If I recompress "pc_arch_common.bin" alone it works ok at decomp but as soon as I compress several files together (big and small files mixed together with no sorting option in freearc) .... I have this CRC ERROR

I tried both inno and ASC and same results.... this bug might comes from pzlib
and was already present on V2 .... with a few games type of files! (MGSTPP, Skyrim SE and previous versions, also had this bug on DarkSiders 2 files)

I tried on xeon 3440 + 8Gb Ram, and i5 3570 + 16 Gb ram , fully stable machines ....same results