FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

ZakirAhmad 06-03-2018 11:05

Compressed AC revelations Gold Editions v1.03
 
Compressed AC Revelations Gold Edition From 6.4 Gb to 2.8 using afr+srep+lolz on .forge files and
srep + lz77 on sound files.
and
bpk + srep on bik video files.
precomp + srep + exe2 + delta + lolz on exe txt etc files.

dixen 06-03-2018 11:22

Quote:

Originally Posted by ZakirAhmad (Post 468683)
Compressed AC Revelations Gold Edition From 6.4 Gb to 2.8 using afr+srep+lolz on .forge files and
srep + lz77 on sound files.
and
bpk + srep on bik video files.
precomp + srep + exe2 + delta + lolz on exe txt etc files.

2,8 gb too
http://f5.s.qip.ru/jjb2KJDV.png

JustFun 06-03-2018 15:52

Fahrenheit: Indigo Prophecy Remastered from 9.4GB to 2GB
srep+lolz

But can be compressed even more if you use bpk on videos and other tools ;)

ZakirAhmad 08-03-2018 00:02

itried to use the exe version of bink compressor on some files from AC 3. i tried in sold mode. tje files compressed 2 times better than dll version of bink compressor. in exe version ratio was 38% and in dll version ration was 77%.but when i decompressed with exe version with the provided exe unpacker, i got crc error after the first bik file extracted. in sold mode with exe version sometimes compression too fails.

my guess is, it is bink compressor doesnt work when we put bik files in container that is why dll version of bink comlressor first compresses then puts files in arc container.

suggested changes if u think r needed.

ZakirAhmad 08-03-2018 10:11

Compressed AC 3 Complete Edition V1.06 from 15.4 gb to 5.08gb
 
compressed AC3 from 15.4gb to 5.08Gb using precomp srep lolz afr and lzma2.
bink compressor on videos.

I guess, i shkud stop posting here, because some doesnt like precomp doesnt mean we shouldn't use it.

78372 08-03-2018 10:53

AC III has no files worth with precomp. What you did is wasted your time.

I am actually surprised to see precomp, we already have pzlib to apply on zlibbed file, what's the use of precomp these days unless you need packmp3/packjpg?

ZakirAhmad 08-03-2018 18:21

r u sure.
 
Quote:

Originally Posted by 78372 (Post 468741)
AC III has no files worth with precomp. What you did is wasted your time.

I am actually surprised to see precomp, we already have pzlib to apply on zlibbed file, what's the use of precomp these days unless you need packmp3/packjpg?

I guess u havent scanned the exes etc with zlib scanner, Almost in 99% of cases they contain zlib streams whech inturn reduces their compression 5 to 10mb.

pzlib doent work on every files. for eg. the files from COD black ops, precomp works on them while pzlib not.

78372 08-03-2018 18:31

Quote:

Originally Posted by ZakirAhmad (Post 468754)
I guess u havent scanned the exes etc with zlib scanner, Almost in 99% of cases they contain zlib streams whech inturn reduces their compression 5 to 10mb.

pzlib doent work on every files. for eg. the files from COD black ops, precomp works on them while pzlib not.

Did you tried with reflate libs?

Plus monster compression isn't worth that much for me, adding some more minutes only to reduce 2-5mb

ZakirAhmad 08-03-2018 19:04

Quote:

Originally Posted by 78372 (Post 468755)
Did you tried with reflate libs?

Plus monster compression isn't worth that much for me, adding some more minutes only to reduce 2-5mb

yeah i tried with reflate libs too.

when u r targetting perfection in compression, u didnt want to leave anything behind. BTW when exe's size is >150mbs u can achieve more.

precomp doesnt add mimytes to decompress them, only 1 to 2 seconds.

78372 08-03-2018 20:12

Seems interesting, I thought reflate can precompress better than precomp. Which precomp version are you using?

ZakirAhmad 08-03-2018 20:23

Quote:

Originally Posted by 78372 (Post 468757)
Seems interesting, I thought reflate can precompress better than precomp. Which precomp version are you using?

precomp 038.
i guess any version of precomp works on them but not pzlib.
pzlib has some problems like too much ram utilization during compression and decompression. use of chunk(main problem) because u have to find the exact chuck for games. In reflate part of pzlib, u can only set level manually, u cant set memory, windowsbits, parameters, I guess which causes creation of diff file and hence makes compression worse(in some cases).
pzlib hase many good things as well like faster decompression, compression, multithreading( i have no idea why the pzlib is only a bit faster in decompression than precomp).

Vulkan 08-03-2018 23:52

Try Pzlib with these settings
pzlib e -rx -x

ZakirAhmad 09-03-2018 00:05

Quote:

Originally Posted by Vulkan (Post 468761)
Try Pzlib with these settings
pzlib e -rx -x

it is a bug with pzlib, i reported it to razor.

Vulkan 09-03-2018 00:39

What is the best lzma settings I found this
lzma:a1:mfbt4:d640m:fb273:mc1000:lc8:pb4
And I use 640m dictionary because I have 8gb of ram

ZakirAhmad 09-03-2018 01:44

Quote:

Originally Posted by doofoo24 (Post 468766)
which file has zlib ?
there forge, pck , bik.
seem to me you test it on the only pdf file Manual :confused:
i get 2.57gb on forge file with afr+srep+lolz...
i used precomp only nada :D

Normall, i distribute game in 4 archives, 1st one game data (in this case .forge ) and i used compression method afr+srep+lolz.
2nd contains sound files which (srep+lolz).
3rd contains videos (bpk+srep)
and 4th include .exes .txt pdf some images like .ico .dlls etc (for ur kind info which contains zlib streams ).

and also i compressed .forge files of ac 3 to 2.53gb

Andu21 09-03-2018 05:07

Quote:

Originally Posted by ZakirAhmad (Post 468758)
precomp 038.

Why not take advantage of latest precomp version?

KaktoR 10-03-2018 03:14

Need for Speed Payback

Data\Win32\configurations\superbundleinstallpackag e\cas_01.cas
plz4+srep+lzma => 421.236.736 Bytes
srep+lzma => 501.354.496 Bytes

Razor12911 10-03-2018 03:18

Quote:

Originally Posted by KaktoR (Post 468808)
Need for Speed Payback

Data\Win32\configurations\superbundleinstallpackag e\cas_01.cas
plz4+srep+lzma => 421.236.736 Bytes
srep+lzma => 501.354.496 Bytes

Nice :) at least ztool's other codecs apart from pzlib still work on something newer.

KaktoR 10-03-2018 07:58

Quote:

Originally Posted by Razor12911 (Post 468809)
Nice :) at least ztool's other codecs apart from pzlib still work on something newer.

Yes, but ztool is very unstable (at least lz4). It just hang now for over 3 hours on a single file.:confused:

I have just tested with standard params (no parameters were given). Will try with different parameters instead.

oltjon 10-03-2018 08:25

Quote:

Originally Posted by Razor12911 (Post 468809)
Nice :) at least ztool's other codecs apart from pzlib still work on something newer.

why not make public the latest version???:rolleyes:

oltjon 10-03-2018 13:51

any suggestions
which is the best compressor to compress file.mp4 ?!
lossles.

Razor12911 10-03-2018 15:28

1 Attachment(s)
Quote:

Originally Posted by oltjon (Post 468821)
why not make public the latest version???:rolleyes:

Attachment 21285
what latest version? I haven't been making any new programs, especially precompressors.


Quote:

Originally Posted by KaktoR (Post 468820)
Yes, but ztool is very unstable (at least lz4). It just hang now for over 3 hours on a single file.:confused:

I have just tested with standard params (no parameters were given). Will try with different parameters instead.

plz4 and these other codecs were roughly the same as pzlib v2, full of bugs. even pzlib in 0.0.19.8 is buggy, hence the 0.0.19.8 version, versions before version 1, it was an alpha release, version one was planned where everything would have been refined.

The encoder of plz4 was updated in May 2017 I think, so you can see, there was inactivity in that codec because I was so obsessed with adding a lot of other codecs, plzo, pzstd and etc.

panker1992 10-03-2018 20:26

Zee we must fix this plz4 now and forever, toooooooooooooooooooooooooo many versions :/

many devs also mod lz4 to their needs.... make it even worse

oltjon 10-03-2018 23:04

Quote:

Originally Posted by Razor12911
versions before version 1, it was an alpha release, version one was planned where everything would have been refined.

I said of version 1

Razor12911 11-03-2018 00:41

Quote:

Originally Posted by oltjon (Post 468836)
I said of version 1

version 1 only had pcrilayla and if I had it, I'd post it.
pzlib, plz4.... were being updated so there really isn't anything important in it.

Quote:

Originally Posted by panker1992 (Post 468834)
Zee we must fix this plz4 now and forever, toooooooooooooooooooooooooo many versions :/

many devs also mod lz4 to their needs.... make it even worse

I know man :)

78372 11-03-2018 01:11

GTA SanAndreas

Everything in audio\streams folder *ONLY*

Method : oggrenc+srep

Original Size = 1.09GB
Compressed size = 981MB

darkwolves 11-03-2018 03:26

Need For Speed Payback
 
(ZTOOL) plz4+srep64:m5f:a2+delta+lzma:ultra:a1:mfbt4:d158m :fb273:mc1000000000:lc8

must have fazip

compressed down to 13.8

that is not the deluxe edition... that i am repacking as we speak

ZakirAhmad 11-03-2018 03:59

Quote:

Originally Posted by darkwolves (Post 468840)
(ZTOOL) plz4+srep64:m5f:a2+delta+lzma:ultra:a1:mfbt4:d158m :fb273:mc1000000000:lc8

must have fazip

compressed down to 13.8

that is not the deluxe edition... that i am repacking as we speak

what is ur orginal game size?

darkwolves 11-03-2018 04:07

Quote:

Originally Posted by kassane (Post 464782)
What is the best method to compress Divinity Original Sin?
I have already tried to use pzlib and ztool (lz4) and did not have a satisfactory result.

that is because it is using Divinity Engine wich i personally do not know how to compress

darkwolves 11-03-2018 04:11

Quote:

Originally Posted by ZakirAhmad (Post 468843)
what is ur orginal game size?

22 gigs... as for the deluxe edition that i am working on now is 27 gigs i will post result of deluxe later

darkwolves 11-03-2018 04:31

DMC Devil May Cry Includes Vergils Downfall
 
uelr+srep64:m5f:a2+delta+lzma:a1:mfbt3:d400m:fb32: mc1000000:lc8

bpk for bik files


initial size 10.5 gb

repack size 5.78 gb

ZakirAhmad 11-03-2018 05:02

Quote:

Originally Posted by darkwolves (Post 468845)
22 gigs... as for the deluxe edition that i am working on now is 27 gigs i will post result of deluxe later

22gbs down to 13.8gb (not good compression ratio)
FGs ratio is 27 to 13gb

u can achieve better with lolz (use multithreading) with mtt0

or u can get better decompression speed with same ratio using lzma2

darkwolves 11-03-2018 05:29

Quote:

Originally Posted by ZakirAhmad (Post 468849)
22gbs down to 13.8gb (not good compression ratio)
FGs ratio is 27 to 13gb

u can achieve better with lolz (use multithreading) with mtt0

or u can get better decompression speed with same ratio using lzma2

fitgirl also uses many hidden tools not all of us know of and lolz does not work too well for me in fact those lzma settings compress higher for me than lolz does

darkwolves 11-03-2018 05:31

Quote:

Originally Posted by doofoo24 (Post 468848)
what files did you exclude when i use plz4 it just hang ?

i excluded no files

KaktoR 11-03-2018 05:31

+ lolz is slow as fu..

darkwolves 11-03-2018 05:33

Quote:

Originally Posted by KaktoR (Post 468852)
+ lolz is slow as fu..

right? i'll take a few extra gigs lol

ZakirAhmad 11-03-2018 05:35

Quote:

Originally Posted by KaktoR (Post 468852)
+ lolz is slow as fu..

Using mulithreading u can achieve better speed than lzma during compression while maintaining same compression ratio.
i am getting 250kbps speed using single thread and if i use 3 threads i am getting arounf 700kbps while getting same ratio. but know that u have to mtt0 (multi threading type zero) not mtt1.

lolz works only if u use it on precompressed files, it will not work if files r compressed, because in that case headers(bmp dxt) r corrupted by compressors like lz4 etc.
every repack of FG which r rerepackd , i compressed that around 70mb better than fg.
the only thing which currently FG has better than us is knownloadge about knowing how to unpack files if they cant be preprossed with ztool plzip or uelr.
hope this helps.

78372 11-03-2018 05:38

You can increase fba and decrease mc to get more speed at compression, it will the compression ratio, but not that much. Use more tt for better ratio and slower compression. Also check dictionary size suitable for your needs.

darkwolves 11-03-2018 05:39

Quote:

Originally Posted by ZakirAhmad (Post 468854)
Using mulithreading u can achieve better speed than lzma during compression while maintaining same compression ratio.
i am getting 250kbps speed using single thread and if i use 3 threads i am getting arounf 700kbps while getting same ratio. but know that u have to mtt0 (multi threading type zero) not mtt1.


i've used it... thing about fitgirl she knows how to decrypt files and make them re encrypt after installing... i am still trying to figure out how she did marvel vs capcom infinite... i can't even touch it and like i said i've seen little difference using lolz

darkwolves 11-03-2018 07:16

Quote:

Originally Posted by doofoo24 (Post 468860)
i mean for plz4 did you use it on all files ?

only the data folder has the frostbite 3 streams if you use it on that you should have no problems


All times are GMT -7. The time now is 09:33.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com