FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

JustFun 24-09-2017 18:46

Best Compression Methods for 'Specific' Games. Q&A
 
Hello guys, I have seen there are a lot of threads by some of you asking for best compression methods for 'specific' games.
So lets prevent spamming the forum with those threads and keep all of the questions and answers in one place, it will be easier for everyone.

So please share your best compression methods here for specific games, or if you want to know what is the best compression for a particular game please ask here.

Thank you!

An INDEX for the games discussed in this thread can be found HERE

Grumpy 24-09-2017 19:22

Keep it to 'specific' games please or posts will be removed.

.... and Thankyou JustFun ;)

lolaya 24-09-2017 19:26

Quote:

Originally Posted by Grumpy (Post 462567)
Lets keep it to 'specific' games please. What game are you wanting compression for?

.... and Thankyou JustFun ;)

FIFA17
Mad Max
Hellblade Senuas Sacrifice
Rise of the Tomb Raider
PRO EVOLUTION SOCCER 2018

JustFun 24-09-2017 20:03

Well for Mad Max, I`ve got the best results using pZlib+srep+lzma
Havent tested them yet but for Rise of the Tomb Raider and Hellblade-pZlib+srep+lzma too. Someone pls correct me if I am wrong with the better compression methods.

KaktoR 24-09-2017 23:40

Hellblade Senuas Sacrifice
pzlib+srep+lzma = 8,28GB

Update:
*.pak => pzlib:m2:st50p:t4:c32m:rx:x+srep+lzma
*.bik => bpk
*.* => srep+lzma

7.66GB


---------------------------------
Mad Max
*.arc
xtool:c32m,t4:zlib+srep+lzma = 3.87GB

*.*
srep+lzma2 = 89MB

= total of 3.96GB

KaktoR 25-09-2017 13:25

For example:
[code][External compressor:pzlib]
header = 0
packcmd = _Compressors\pZLib e {options} -c32m -t25p - -o - $$arcdatafile$$.tmp -o - <stdout>
unpackcmd = _Compressors\pZLib d {options} -t100p - -o - <stdin> <stdout>

[External compressor:srep]
header = 0
packcmd = _Compressors\srep64 {options} -m5f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = _Compressors\srep {options} -d -s - - <stdin> <stdout>[code]

Just a hint, if you select no smilies in text, under misc options, then you wont have them showing up where you don't want them, especially in posts like this one. >pakrat2k2

elit 25-09-2017 18:11

You can chain ztool for games like Ghost Recon Wildlands that use both lzo and some zlib streams, like this for example:

[External compressor:pzlib,plz4,plzo,pzstd]
header = 0
packcmd = ZTool e:{compressor}{:option} - - <stdin> <stdout>
unpackcmd = ZTool d:{compressor}{:option} - - <stdin> <stdout>

-m5 -mc-delta -mc:rep/srep64:m5f:mem2gb:s128gb:l1k -mc$default,$precomp,$obj:+plzo+pzlib
"

In the above we first pass it through lzo precompress filter and then to pzlib. Pzlib filter will also look into data that was precompressed from lzo as well as outside it. If data inside lzo's were also zlibed those will be additionally processed.
Btw for srep you absolutely have to use "s" option if you pipe its input:

[External compressor:srep64]
packcmd = srep64avx2 {options} - - <stdin> <stdout>
unpackcmd = srep64avx2 -d {options} - - <stdin> <stdout>

^then you save space and time as data are streamed directly: ztool:plzo=>ztool=>pzlib=>srep but you have to use "s" option and you have to take into account preprocessed size after ztool!

Another game where you can chain ztool is Mirror's Edge Catalyst, there you chain plz4=>pzlib.

Razor12911 25-09-2017 21:42

Quote:

Originally Posted by JustFun (Post 462569)
Well for Mad Max, I`ve got the best results using pZlib+srep+lzma
And for Fifa 17, I would say the best solution is to use ZTool(pzstd+srep+lzma)
Havent tested them yet but for Rise of the Tomb Raider and Hellblade, i`d say pZlib+srep+lzma too. Someone pls correct me if I am wrong with the better compression methods.

pzstd only works on Mass Effect Andromeda

elit 26-09-2017 03:52

Quote:

Originally Posted by lolaya (Post 462600)
I don't know why anyone don't upload file .rar with compressor files I needed .

I dont know why people who lack basic navigation skills, thinking, orientation and computer knowledge try to dwell into such difficult subjects as advanced (pre)compression. Whats next, guy trying to code its own precompressor asking how to use compiler/Windows?

KaktoR 26-09-2017 05:29

^Exactly this!

This was mentioned 1000 times before in this forum. From now on just ignore :)

EzzEldin16 26-09-2017 14:16

Made man (old game) : srep + xz - - 1.391gb --> 931mb
BeamNG Drive 0.10 : srep +xz - - 6,718gb --> 1.960gb
Prototype 1 , 2 : pzlib v3 (by razor) + srep + xz - - 8.349gb --> 6.621gb / 7.312gb --> 4.700
Devil May Cry V : srep + xz - - 11.542gb --> 8.237gb
Crysis 2 : pzlib v3 + srep + xz - - 8,168gb --> 5.725gb
Payday 2 : srep + xz - - 19.479gb --> 3.671gb
FIFA 13 : pzlib v3 + srep + xz - - 7,109gb --> 3.444gb
The Sabotuer : srep + xz - - 7.404gb --> 3.687gb
Painkiller Hell and Damnation Collecters Edition : srep + xz - - 13.175gb --> 5.531gb
Ninja Blade : pzlib v3 + srep + xz - - 4.847gb --> 2.526gb
Outlast Whistle Blower : srep + xz - - 6.422gb --> 3.442gb
Firewatch : xz - - 3,741gb --> 1,384gb
Duke Nukem Forever : srep + xz - - 7,066gb -->3.631gb
Dark : xz - - 3.194gb --> 1.859gb
Demolish and Build Company 2017 : srep + xz - - 3,334gb --> 1,953gb
Hunted one step too far : xz - - 2.709gb --> 1.209gb
Joana's Life : xz - - 5,315gb --> 2.277gb
Oxenfree : xz - - 2,282gb --> 1.193gb
Stolen : srep + xz - - 2,827gb --> 1.678gb
The Forest : srep + xz - - 1,143gb --> 669mb
Wick : xz - - 659mb --> 220mb
Universe Sandbox 2 : srep + xz - - 2,801gb --> 461mb
We Happy Few : srep + xz - - 5,161gb --> 2.638gb
Turok : srep + xz - - 16,270gb --> 8.407gb
Alpha Protocol : pzlib v3 + srep + xz - - 11,812gb --> 5.460gb

( used latest applications )

Posting more soon ...

Grumpy 26-09-2017 18:04

All Irrelevant Pestering posts have been removed, (this means most of your posts 'lolaya' have been deleted) keep it to asking about 'specific' games please.

lolaya 26-09-2017 18:09

@[email protected] thank you

please delete my all posts by lolaya and all threads started by lolaya :)

no delete this : http://fileforums.com/showpost.php?p=462568&postcount=3

lolaya 26-09-2017 18:27

I do not speak English.,
It is very difficult to understand the talk here .. I do not know how to talk to friends .. but I try to talk to everyone.

I need to use Easy Compressor .. no more. -_-

edit : I'm here since 2011 .. I do not understand anything .. but I love this place ♥: D ...

78372 26-09-2017 19:39

GTA IV: The Complete Edition

Masks:
$zlib
*.img
$bik
*bik

Method: srep+lzma/$zlib=srep+pzlib+srep+lzma/$bik=srep


Here I used srep+pzlib+srep+lzma for zlib because there are many same img files in complete edition, and using srep before pzlib significantly reduces compression time.

Game Size: 30.9GB(approx)
Final Size: 16.4GB(approx)

Chayan Manna 27-09-2017 00:17

Crysis 2 Maximum Edition:
From 9.19 GB ->> 6.27 GB
Used Method: pZLib+Srep+delta+lzma
Parameter: pzlib+srep:m3f:l256+delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8

The latest version of pZLib is used with latest reflate libs. :)

felice2011 27-09-2017 00:19

Quote:

Originally Posted by 78372 (Post 462639)
GTA IV: The Complete Edition

Masks:
$zlib
*.img
$bik
*bik

Method: srep+lzma/$zlib=srep+pzlib+srep+lzma/$bik=srep


Here I used srep+pzlib+srep+lzma for zlib because there are many same img files in complete edition, and using srep before pzlib significantly reduces compression time.

Game Size: 30.9GB(approx)
Final Size: 16.4GB(approx)

Someone who uses is recognizing the potential of masked methods.
Have you tried to use nanozip or razor compressors in the "void" mask? Or in your case "/$bik".

78372 27-09-2017 00:29

I use my own masks dude. Razor and nanozip compressors are too slow while compressing, so I do not use them. But you may get about 14.x gb or less by razor I think.

felice2011 27-09-2017 00:38

Quote:

Originally Posted by 78372 (Post 462648)
I use my own masks dude. Razor and nanozip compressors are too slow while compressing, so I do not use them. But you may get about 14.x gb or less by razor I think.

OK, But did you test the compression time on the 30 gb sample, with your method, and with the use of nz or rz?

78372 27-09-2017 00:49

No, didn't tried with them.

felice2011 27-09-2017 00:53

Quote:

Originally Posted by 78372 (Post 462650)
No, didn't tried with them.

Ok:)

elit 27-09-2017 05:24

Quote:

Originally Posted by 78372 (Post 462639)
GTA IV: The Complete Edition
Here I used srep+pzlib+srep+lzma for zlib because there are many same img files in complete edition, and using srep before pzlib significantly reduces compression time.
Final Size: 16.4GB(approx)

This is interesting, I thought "dedup" methods are for this purpose? Also, how come this does not disturb data and headers making pzlib not applicable?

78372 27-09-2017 05:33

This doesn't makes pzlib non-applicable, try yourself ;) Take two same zlibbed file with different names, use srep+pzlib, you will see.

Chayan Manna 27-09-2017 07:10

Max Payne 3 The Complete Edition:
From 32.47 GB ->> 16.4 GB

Used Method:
For zlib files: pZLib+Srep+delta+lzma
Parameter: pzlib+srep:m3f:l256+delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8
For audio files: msc(tak)+Srep+delta+lzma
Parameter: msc+srep:m3f:l256+delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8
For video files: delta+lzma
Parameter: delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8

Took a lot of time to process srep, because my RAM is 8 GB.

The latest version of pZLib is used with latest reflate libs. :)

Note: If you increase the RAM usage of LZMA the ratio will be better, but it will take more ram to compress & decompress also.... But decompression speed will increase.
For example: in this parameter "lzma:512mb:normal:bt4:27 3:mc1000:lc8" the RAM usage is 512 MB (at decompression) & it will take 5384 MB (approx) RAM to compress.

78372 27-09-2017 07:52

Just Cause 2

Game Size: 3.97GB after removing unnecessary audio files
Final Size: 1.1GB(Approx)
Method: pZlib:m2+srep:m3f+lzma:177mb:ultra:bt4:fb273:mc100 0000:lc8



@Moderators
What about creating an index for this thread at the first post?

KaktoR 27-09-2017 08:45

I don't think mods would update a third index, it'a alot of work.

Maybe someone (you?) could get ownership of first post and update it from time to time.

78372 27-09-2017 08:53

:3 Nah, I am just asking for this if possible, I seriously have no time for do so :P

Razor12911 27-09-2017 10:28

I think putting games and their methods here is a terrible idea because there are so many of them, the wise solution to this is narrowing down the field, game engines for example or picking games as a series. for example, all Assassins Creed games are lzo compressed, use the method plzo+srep+lzma for all, because listing all the AC series just makes the thread difficult to read or the index you're suggesting.
For example I already see GTAIV and Max Payne 3, next we'll probably see GTAV, what we could have said all in all is pzlib+srep+lzma for all games that use the RAGE Engine which is what they use.
https://en.wikipedia.org/wiki/Rockst...ed_Game_Engine
there is the list of games, what people could do is
put an engine with the link on a site like wikipedia that has list of games then put the method that should be used.

elit 27-09-2017 11:36

Most of major Ubisoft games: -plzo(+pzlib)+srep+lzma
Most of major past EA games: -plz4(+pzlib)+srep+lzma
Most of major recent EA games: -pzstd(+pzlib)+srep+lzma

Or I will simplify it further:
Almost-everything-out-there: -ztool(x2)+srep+lzma

Case closed :D

Chayan Manna 27-09-2017 11:49

Quote:

Originally Posted by Razor12911 (Post 462664)
I think putting games and their methods here is a terrible idea because there are so many of them, the wise solution to this is narrowing down the field, game engines for example or picking games as a series. for example, all Assassins Creed games are lzo compressed, use the method plzo+srep+lzma for all, because listing all the AC series just makes the thread difficult to read or the index you're suggesting.
For example I already see GTAIV and Max Payne 3, next we'll probably see GTAV, what we could have said all in all is pzlib+srep+lzma for all games that use the RAGE Engine which is what they use.
https://en.wikipedia.org/wiki/Rockst...ed_Game_Engine
there is the list of games, what people could do is
put an engine with the link on a site like wikipedia that has list of games then put the method that should be used.

Yeah, I agree with you, but there are some games which use same engine but same methods couldn't be applied on them.
For Example: Crysis 2 & Crysis 3 use same engine, which is Cry Engine 3 but pZLib can precompress Crysis 2 & for Crysis 3, the files are encrypted. So they must be decrypeted first before using any compression.
I know this is not a good example but it occurs sometimes. :)

felice2011 27-09-2017 12:09

The problem with this thread, is the list is messy between one page and the other, for those who are looking for a compression method on a particular game, the only solution is to create an index on the front page, with the collection of games and related methods tested by users.:rolleyes:;)

KaktoR 27-09-2017 12:21

Quote:

Originally Posted by Razor12911 (Post 462664)
for example, all Assassins Creed games are lzo compressed, use the method plzo+srep+lzma for all

Have tested a while back with AC2, ACB and ACR. Didn't work on those titles.

elit 27-09-2017 12:52

Quote:

Originally Posted by Chayan Manna (Post 462657)
Max Payne 3 The Complete Edition:
Parameter: msc+srep:m3f:l256+delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8

I see you use highest "lc" parameter for lzma. Can you tell me your general experience with it? Is it much better in general game compression usage or all usages in general? And what gain can be expected from it vs default?
Thank you

Chayan Manna 27-09-2017 12:55

Quote:

Originally Posted by KaktoR (Post 462672)
Have tested a while back with AC2, ACB and ACR. Didn't work on those titles.

Yeah, because the game engines are different.
For AC2, ACB and ACR the Engine is "Anvil" which don't use lzo.
Fro AC3, Liberation, ACBF, Rogue it's AnvilNext.
And for ACUnity, Syndicate it's AnvilNext 2.0.
AnvilNext & AnvilNext 2.0 may be precompressed with plzo, I think...

Chayan Manna 27-09-2017 13:11

Quote:

Originally Posted by elit (Post 462674)
I see you use highest "lc" parameter for lzma. Can you tell me your general experience with it? Is it much better in general game compression usage or all usages in general? And what gain can be expected from it vs default?
Thank you

There may be LZMA1 streams that have lc>3 which is default. So, better compression ratio may be gained by lc8. But using highest lc may increase the compression time a bit.
I tested it with several files & almost every time I got the best ratio with lc8.

Razor12911 27-09-2017 15:40

Quote:

Originally Posted by KaktoR (Post 462672)
Have tested a while back with AC2, ACB and ACR. Didn't work on those titles.

Either they are exceptions due to the fact that they don't use lzo or the tool does not support them. plzo is not universal.

Gupta 27-09-2017 17:51

Quote:

Originally Posted by felice2011 (Post 462671)
The problem with this thread, is the list is messy between one page and the other, for those who are looking for a compression method on a particular game, the only solution is to create an index on the front page, with the collection of games and related methods tested by users.:rolleyes:;)

think if a novice read those post, shouldn't he will be benefitted from that, will save us one or to "how they compress" it threads

ont more thing
don't use delta on game, that will increase the compression ratio
srep+lzma is always the best

Chayan Manna 27-09-2017 20:52

Quote:

Originally Posted by PrinceGupta2000 (Post 462682)
ont more thing
don't use delta on game, that will increase the compression ratio
srep+lzma is always the best

delta don't increase the ratio always, it's true that sometimes it increase the ratio, but for some files it also gives better ratio.
So, before compression one file from a branch of file type may be checked by once with delta+lzma & once with only lzma. With that one can determine, if delta is increasing or decreasing the ratio for that file type.
For me, I always check with this method & after that if delta decreases the ratio, only then I use it in compression. For those games which I've posted delta does the good job, that's why I used it on them. :)

Chayan Manna 27-09-2017 20:55

Quote:

Originally Posted by Razor12911 (Post 462679)
Either they are exceptions due to the fact that they don't use lzo or the tool does not support them. plzo is not universal.

Yeah, they don't use lzo. :)

Razor12911 27-09-2017 21:40

Quote:

Originally Posted by KaktoR (Post 462672)
Have tested a while back with AC2, ACB and ACR. Didn't work on those titles.

Quote:

Originally Posted by Chayan Manna (Post 462676)
Yeah, because the game engines are different.
For AC2, ACB and ACR the Engine is "Anvil" which don't use lzo.
Fro AC3, Liberation, ACBF, Rogue it's AnvilNext.
And for ACUnity, Syndicate it's AnvilNext 2.0.
AnvilNext & AnvilNext 2.0 may be precompressed with plzo, I think...

Quote:

Originally Posted by Chayan Manna (Post 462686)
Yeah, they don't use lzo. :)

http://wiki.tbotr.net/index.php?titl...ed:Forge_Files


All times are GMT -7. The time now is 21:11.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com