FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

78372 18-01-2018 09:31

Why not generate a cls? ;)

ZakirAhmad 18-01-2018 10:29

Generate for me please
 
Quote:

Originally Posted by 78372 (Post 466060)
Why not generate a cls? ;)

I tried but i failed to generate cls for nanozip.

is it possible to generate cls for profragers unreal engine decompressor, multithreaded one. the problem with uelr is that it is single threaded and when we recompress lzo type 9 streams with it the speed is 0.2mb/s.

78372 18-01-2018 10:34

Quote:

Originally Posted by ZakirAhmad (Post 466063)
I tried but i failed to generate cls for nanozip.

is it possible to generate cls for profragers unreal engine decompressor, multithreaded one. the problem with uelr is that it is single threaded and when we recompress lzo type 9 streams with it the speed is 0.2mb/s.

Will try to make one for UELR.

PM for nz cls

ZakirAhmad 19-01-2018 02:05

Is it always safe, if we remove unnecessary languages from game. would that game be stable?
I mean suppose i have a game say x. suppose it contains 10 audio languages. if i remove the languages which i dont understand, would it make game unstable.
how can we know in advance that removing a perticular file from game would not make it unstable?

JustFun 19-01-2018 03:12

Quote:

Originally Posted by ZakirAhmad (Post 466073)
Is it always safe, if we remove unnecessary languages from game. would that game be stable?
I mean suppose i have a game say x. suppose it contains 10 audio languages. if i remove the languages which i dont understand, would it make game unstable.
how can we know in advance that removing a perticular file from game would not make it unstable?

Game will be stable as long as you remove right files, language files are usually labeled as such, for example they have eng,fre,ita in their filename, or EN,FR,IT...

JustFun 19-01-2018 07:51

Index updated, and starting letters are separated now for easier navigation.

pakrat2k2 19-01-2018 07:53

Quote:

Originally Posted by ZakirAhmad (Post 466073)
Is it always safe, if we remove unnecessary languages from game. would that game be stable?
I mean suppose i have a game say x. suppose it contains 10 audio languages. if i remove the languages which i dont understand, would it make game unstable.
how can we know in advance that removing a perticular file from game would not make it unstable?

Game will be stable as long as you remove right files, language files are usually labeled as such, for example they have eng,fre,ita in their filename, or EN,FR,IT...
Quote:

Originally Posted by JustFun (Post 466076)
Game will be stable as long as you remove right files, language files are usually labeled as such, for example they have eng,fre,ita in their filename, or EN,FR,IT...

Dont take it for granted that it WILL work everytime, there has been a game or two that has to also have english files + whatever other language you want game in, for it to work. Always backup the files you remove & test the game to make sure it works before deleting them permantely.

JustFun 19-01-2018 07:57

Yeah like pakrat2k2 said, some games do need ENGLISH game files in order to work properly, but if you want to keep ENG only it will work 99% of the times if you delete other languages.

ZakirAhmad 19-01-2018 08:15

Thanks @Justfun an @Pakrat.
As pakrat explained, "i must put files that i want to delete in backup folder and check if game work or not". did this mean if a game doesnt support deleting of language files, it will not start when i delete the files or it will not work from some specific point (eg. say at level 3).

KaktoR 19-01-2018 08:20

Yes, or you have no speach sound ingame, or whatever.

Just try it out.

ZakirAhmad 21-01-2018 04:28

Can anyone please provide me a stable version of srep which will work with profragers
cls srep

Simorq 03-02-2018 15:56

Sniper Ghost Warrior 3 (v1.07) Repack ******
Compressed Size: 32.9 GB
Original Size: 52.4 GB
-mpzlib+srep+lolz:dtb1:d2032m

oltjon 03-02-2018 16:17

Quote:

Originally Posted by Simorq (Post 466393)
Sniper Ghost Warrior 3 (v1.07) REPACK ****
Compressed Size: 32.9 GB
Original Size: 52.4 GB
-mpzlib+srep+lolz:dtb1:d2032m


the champion is always fitgirl with 31.6:D

Simorq 03-02-2018 16:48

Quote:

Originally Posted by oltjon (Post 466394)
the champion is always fitgirl with 31.6:D

Of course, without updating 1.07:D
And use BCM for videos

ZakirAhmad 03-02-2018 20:26

the fits is only 49gb of size.
 
Quote:

Originally Posted by oltjon (Post 466394)
the champion is always fitgirl with 31.6:D

lolz performs worst than lzma if we do not first unpack or precompress already compressed game files.

oltjon 04-02-2018 01:25

Quote:

Originally Posted by Simorq (Post 466395)
Of course, without updating 1.07:D
And use BCM for videos

but 1 Gb is a lot. I do not think that bcm does all this diference

Simorq 04-02-2018 15:41

Total War ROME II - Empire Divided [***** Repack]
Compressed Size: 8.21 GB
Method:srep:m3f:l256+lollypop (Lolz):d304:al1:mc1023:lm0:rt0:dt1:mtt0:mt3:mtb64: dtb0:x1:tt8

GTA V (RPF File) [***** Repack]
Data: fg-01.bin
Compressed Size: 14.3 GB
Original Size: 50.6 GB
Method:Pz3 (ZTool)+srep:m3f:l256+lolz:d333:al1:mc1023:lm0:rt0 :dt1:mtt0:mt3:mtb64:dtb0:tt6

JustFun 04-02-2018 16:03

Quote:

Originally Posted by Simorq (Post 466412)
Total War ROME II - Empire Divided [***** Repack]
Compressed Size: 8.21 GB
Method:srep:m3f:l256+lollypop (Lolz):d304:al1:mc1023:lm0:rt0:dt1:mtt0:mt3:mtb64: dtb0:x1:tt8

GTA V (RPF File) [***** Repack]
Data: fg-01.bin
Compressed Size: 14.3 GB
Original Size: 50.6 GB
Method:Pz3 (ZTool)+srep:m3f:l256+lolly:d333:al1:mc1023:lm0:rt 0:dt1:mtt0:mt3:mtb64:dtb0:tt6

Wait mate, have you tested these or are you just sharing info on what FirGirl has used?
This topic was created mainly for people to find compression methods for tools that are already available to users here, and that are actually tested both compression and decompression without errors. A lot of people know what compression methods are used by fitgirl and other repackers, but tbh it doesnt really help to the normal users here on FF.

Simorq 04-02-2018 16:07

Quote:

Originally Posted by JustFun (Post 466413)
Wait mate, have you tested these or are you just sharing info on what FirGirl has used?
This topic was created mainly for people to find compression methods for tools that are already available to users here, and that are actually tested both compression and decompression without errors. A lot of people know what compression methods are used by fitgirl and other repackers, but tbh it doesnt really help to the normal users here on FF.

These methods are no problem And tested

Simorq 05-02-2018 06:01

Assassin’s Creed: Origins (1 Lang)
Compressed Size: 23 GB
Original Size: 55 GB
Method:afr+srep+lolz Or poodle:c512m+srep:m3f:l1024+lolz:d512

ZakirAhmad 05-02-2018 06:32

[QUOTE=Simorq;466422]Assassinís Creed: Origins (1 Lang)
Compressed Size: 23 GB
Original Size: 55 GB
Method:afr+srep+lolz Or poodle:c512m+srep:m
Have u compressed it.

drsanjula 05-02-2018 06:57

Assassins Creed Origins?

Andu21 05-02-2018 10:12

Quote:

Originally Posted by Simorq (Post 466412)
Total War ROME II - Empire Divided [****]
Compressed Size: 8.21 GB
Method:srep:m3f:l256+lollypop (Lolz):d304:al1:mc1023:lm0:rt0:dt1:mtt0:mt3:mtb64:dtb0:x1:tt8

GTA V (RPF File) [****]
Data: fg-01.bin
Compressed Size: 14.3 GB
Original Size: 50.6 GB
Method:Pz3 (ZTool)+srep:m3f:l256+lolz:d333:al1:mc1023:lm0:rt0:dt1:mtt0:mt3:mtb64:dtb0:tt6

Jesus, how can anyone achieve that kind of precision? Can't be by bruteforcing can it?

KaktoR 05-02-2018 12:26

Quote:

Originally Posted by Simorq (Post 466422)
Assassinís Creed: Origins (1 Lang)
Compressed Size: 23 GB
Original Size: 55 GB
Method:afr+srep+lolz Or poodle:c512m+srep:m3f:l1024+lolz:d512

latest afr cls has problems with 1 file unpacking. I will test another cls or without.

Razor12911 05-02-2018 12:43

Quote:

Originally Posted by Simorq (Post 466422)
Assassinís Creed: Origins (1 Lang)
Compressed Size: 23 GB
Original Size: 55 GB
Method:afr+srep+lolz Or poodle:c512m+srep:m3f:l1024+lolz:d512

pOodle works on this?

KaktoR 05-02-2018 13:00

1 Attachment(s)
Quote:

Originally Posted by Razor12911 (Post 466443)
pOodle works on this?

Yes, but not as good as afr

Edit: Well, no, poodle (ztool) has not a single effect on compression :D

ZakirAhmad 05-02-2018 20:12

@simorg. Her repack needs 105gb of available disk space; twitce the size of game. that means she is not using any cls pr stdin stdout method. that means she is using the old method of rebuilding the game.

Razor12911 05-02-2018 20:23

Quote:

Originally Posted by KaktoR (Post 466445)
Yes, but not as good as afr

Edit: Well, no, poodle (ztool) has not a single effect on compression :D

Yea, was shocked there for a bit because I remember being approached before about the game when it was released that pOodle seems to be not working at all, anyways never mind :)
I am answered.

doofoo24 06-02-2018 00:51

poodle:c512m didn't work for me ...
i used pOodle alpha 0.19...

doofoo24 06-02-2018 01:20

you can use AFR_v020a4 on forge file but one file at time then rebuild them after extract done...

ZakirAhmad 06-02-2018 03:26

Quote:

Originally Posted by doofoo24 (Post 466456)
poodle:c512m didn't work for me ...
i used pOodle alpha 0.19...

what results u got while using poodle alpha. post it here and also post a link to poodle alpha.

KaktoR 06-02-2018 04:08

Quote:

Originally Posted by ZakirAhmad (Post 466459)
what results u got while using poodle alpha. post it here and also post a link to poodle alpha.

He wrote that already.

poodle (ztool) has no effect of compression (he used the one that was leaked here, alpha 19.9).

KaktoR 11-02-2018 15:54

Sid Meiers Civilization VI
1 language

*.bk2 => bpk
*.* => srez+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd1:mt4:d64m:tt 4

4.3GB

Took around 1.5 hours for comp

KaktoR 13-02-2018 11:11

Kingdom Come: Deliverance

lolz is pretty good on this, but took some time

precompressed with pzlib+srep

I have tested just a single file yet (animations-part0.pak)

Diff was about ~300mb

KaktoR 14-02-2018 10:47

KC: D

lzma just hang at a specific point (no appcrash, just hang at 17,3% for over 5 hours now, will abort it), not sure on which file (has taken more than 5 files at once).
lzma2 works, so can't tell the diff between lzma/lzma2 fore sure.

But will not investigate that, too much time consuming.

for lolz i just used generic settings found somewhere :D
lolz:dt1:dtp1:dtm1:dtw1:dtd1:d64m:tt4: oh14:fba4096:mc1023:bc8:blr8:bm8

i am sure there are better/faster options

JustFun 15-02-2018 20:04

Can we please keep this thread about the compression methods that are tested by users(you who share them), can we please keep FitGirl and other repacking groups methods out of this, since people cant use those. THX!

Simorq 23-02-2018 16:13

Agony
Code:

Original Size: 12.6 GB
Compressed Size: 8.22 GB
Compression Time: 3 Hours (6 Cores + 16GB RAM + HDD) (DiskSpan)
Decompression Time: 5 Minutes (6 Cores + HDD)
Method: xZlib (XTool 0.6)+srep:m3f:l256+lolz:dtb1:d64:mc1023 (mt12)

Dead Rising 4
Code:

Original Size: 61.1 GB
Compressed Size: 22.8 GB
Compression Time: 6 Hours (6 Cores + 16GB RAM + HDD) (DiskSpan)
Decompression Time: 22 Minutes (6 Cores + HDD)
Method: pZLib3:m2:x+srep:m2f+4x4:b128mb:lzma:a1:mfbt4:64m:fb273:mc10000:lc8
Use pZLib 3.0.1 (-t1)

Final Fantasy XV Windows Edition
Code:

Original Size: 83.1 GB
Compressed Size: 52.5 GB
Compression Time: 12 Hours (2 Cores + 8GB RAM + HDD)
Decompression Time: 1 Hours 40 Minutes (2 Cores + HDD)
Method: pzlib:m1+srep:m3f+4x4:b100mb:lzma:a1:mfbt4:d200m:fb273:mc10000:lc8

CorePack Compressed Size: 47.9 GB
CorePack Compression Time: ?
CorePack Decompression Time: 3 Hours 40 Minutes (2 Cores + HDD)
CorePack Method: precompress(ZTool)+srep+lolz / BinkMovie: srep+lz64

Tip: Without HD Textures / Rip: JP Video

Fallout 4: Game Of The Year Edition
Code:

Original Size: 34.5 GB
Compressed Size: 23.6 GB
Compression Time: 4 Hours (2 Cores + 8GB RAM + HDD) (DiskSpan)
Decompression Time: 30 Minutes (2 Cores + HDD)
Method: pzlib:max:c32m+srep:m3f+4x4:b100mb:lzma:a1:mfbt4:d200m:fb273:mc10000:lc8

Kingdom Come Deliverance 1.43
Code:

Original Size: 32.8 GB
Compressed Size: 23.6 GB
Compression Time: 3 - 4 Hours (6 Cores + 16GB RAM + HDD) (DiskSpan)
Decompression Time: 14 Minutes (6 Cores + HDD)
Method: pzlib:max+srep:m3f:l1024+4x4:b128mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

Nioh Complete Edition
Code:

Original Size: 73.8 GB
Compressed Size: 22 GB
Compression Time: 2 - 3 Hours (2 Cores + 12GB RAM + HDD) (DiskSpan)
Decompression Time: 15 Minutes (2 Cores + HDD)
Method: srep:m3f+4x4:b100mb:lzma:a1:mfbt4:d200m:fb273:mc10000:lc8

Watch Dogs 2 Gold Edition
Code:

Original Size: 25.1 GB
Compressed Size: 20.2 GB
Compression Time: 70 Minutes (2 Cores + 12GB RAM + HDD) (DiskSpan)
Decompression Time: 8 Minutes (2 Cores + HDD)
Method: srep:m3f:l128+lzma2

Need for Speed Payback
Code:

Original Size: 27.0 GB
Compressed Size: 15.6 GB
Compression Time: 102 Minutes (2 Cores + 12GB RAM + HDD) (DiskSpan)
Decompression Time: 6 Minutes (2 Cores + HDD)
Method: srep:m3f:l128+lzma2

Gears Of War 4
Code:

Original Size: 122 GB
Compressed Size: 74.7 GB
Compression Time: 7 Hours 20 Minutes (2 Cores + 12GB RAM + HDD) (DiskSpan)
Decompression Time: 24 Minutes (2 Cores + HDD)
Method: srep:m3f+lzma2:d200m (7-Zip 18.03)

--logfile
Creating archive: GearsOfWar4.Bin.001 using srep:m3f+lzma2:d200m+diskspan:4310mb:4460mb
Memory for compression 0b, decompression 0b, cache 16mb
Compressed 245 files, 131,302,140,136 => 4,519,362,588 bytes. Ratio 3.44% 
Compression time: cpu 1439.72 sec/real 25941.72 sec = 6%. Speed 5.06 mB/s
All OK

Testing Archive: GearsOfWar4.Bin.001
Tested 245 files, 4,519,362,588 => 131,302,140,136 bytes. Ratio 3.4%     
Directory 4,048 => 11,301 bytes. Ratio 35.8%
Testing time: cpu 219.77 secs, real 1422.17 secs. Speed 92,325 kB/s


Razor12911 23-02-2018 17:37

Quote:

Originally Posted by KaktoR (Post 466604)
Civ 6 *.blp files

Original => 5.375.209.472 bytes
srep+lzma => 1.781.862.400 bytes
srep+lolz => 1.592.496.128 bytes

Hi, can you do me a favour by compressing this game but use razor.
Thanks.

KaktoR 24-02-2018 13:09

^
I can do it for *.blp files, but not for entire game (takes ages).

What switches do you recommend?

Will do it tomorrow and report back then.

doofoo24 24-02-2018 23:33

if anyone find this info useful enjoy :D
 
using srep with setting srep:m2f:l128:a1 reduce alot of memory decompression with minimum compression ratio hit as long used with lolz, the setting that i used is lolz:mc1023:fba4096:bc8:blr8:bm8:oh14:pc4:mtt1:d12 8m:mt8 (change mt depend on cpu core)...
i test mad max pzlib:max:c256m+srep:m2f:l128:a1+lolz:mc1023:fba40 96:bc8:blr8:bm8:oh14:pc4:mtt1:mt8:d128m.
i get 34,354,331,688 => 4,266,484,514 bytes. Ratio 12.42%

as in the picture lolz need 261mb per thread no need for more than 2 thread to use with pzlib becase pzlib is the bottleneck...

*srep with m3f need 21g of ram for decompression with m2f:l128:a1 it reduce to 2696mb...
the difference ratio in the end between m3f and m2f 250mb but a lot less memory usage in decompresion and much faster...
total installation time 6 min


All times are GMT -7. The time now is 05:56.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com