Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 05-06-2020, 12:03
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,636
Thanks: 2,013
Thanked 10,339 Times in 2,202 Posts
Razor12911 is on a distinguished road
Metro Exodus Precompression Tool

Another lz4 game in the bag as requested

I rushed this release, something came up and got busy. I ran one test and compared it with metro-vfx-unpacker and it seems like some streams are left behind.

test on patch_01.vfx (patch_01.vfs0, patch_01.vfs1):
using vfxrec 4.85 GB (5,215,404,338 bytes)
using metro-vfx-unpacker 5.29 GB (5,690,004,897 bytes)

That's all I can do for now

Code:
Extracted 3 files, 5,215,404,078 => 3,369,431,485 bytes. Ratio 154.79%
Extraction time: cpu 7.53 sec/real 196.03 sec = 4%. Speed 17.19 mB/s
Probably R2 will be able to detect everything.
Attached Files
File Type: 7z vfxrec_R1.7z (996.6 KB, 96 views)
File Type: 7z vfxrec_R2.7z (1.81 MB, 216 views)

Last edited by Razor12911; 08-06-2020 at 15:08.
Reply With Quote
The Following 17 Users Say Thank You to Razor12911 For This Useful Post:
ADMIRAL (06-06-2020), BLACKFIRE69 (05-06-2020), bunti_o4u (05-06-2020), Cesar82 (10-03-2022), DiCaPrIo (05-06-2020), ffmla (05-06-2020), GTX590 (07-06-2020), Harsh ojha (06-06-2020), KaktoR (05-06-2020), newfolder (03-07-2021), oltjon (06-06-2020), Pantsi (02-12-2020), rambohazard (06-06-2020), sanekbest1 (13-03-2022), shazzla (05-06-2020), vint56 (06-06-2020), ZAZA4EVER (05-06-2020)
Sponsored Links
  #2  
Old 05-06-2020, 13:52
ZAZA4EVER ZAZA4EVER is offline
Registered User
 
Join Date: Oct 2016
Location: egypt
Posts: 173
Thanks: 565
Thanked 192 Times in 69 Posts
ZAZA4EVER is on a distinguished road
content_03.vfs0

Code:
Compressed 1 file, 2,146,319,821 => 2,315,767,934 bytes. Ratio 107.89%
Compression time: cpu 5.16 sec/real 81.81 sec = 6%. Speed 26.23 mB/s
All OK
Reply With Quote
  #3  
Old 07-06-2020, 15:13
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,636
Thanks: 2,013
Thanked 10,339 Times in 2,202 Posts
Razor12911 is on a distinguished road
test on patch_01.vfx (patch_01.vfs0, patch_01.vfs1):
using R1
Code:
Extracted 3 files, 5,215,404,078 => 3,369,431,485 bytes. Ratio 154.79%
Extraction time: cpu 7.53 sec/real 196.03 sec = 4%. Speed 17.19 mB/s
using R2
Code:
Tested 3 files, 6,026,396,117 => 3,369,431,485 bytes. Ratio 178.85%
Testing time: cpu 3.19 sec/real 177.10 sec = 2%. Speed 19.03 mB/s
Quote:
Originally Posted by ZAZA4EVER View Post
content_03.vfs0

Code:
Compressed 1 file, 2,146,319,821 => 2,315,767,934 bytes. Ratio 107.89%
Compression time: cpu 5.16 sec/real 81.81 sec = 6%. Speed 26.23 mB/s
All OK
using R2

Code:
Compressed 1 file, 2,146,319,821 => 2,950,730,980 bytes. Ratio 137.48%
Compression time: cpu 2.59 sec/real 61.16 sec = 4%. Speed 35.09 mB/s
Running a few tests before update is released

Last edited by Razor12911; 07-06-2020 at 15:24.
Reply With Quote
The Following 2 Users Say Thank You to Razor12911 For This Useful Post:
ffmla (08-06-2020), oltjon (08-06-2020)
  #4  
Old 08-06-2020, 15:09
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,636
Thanks: 2,013
Thanked 10,339 Times in 2,202 Posts
Razor12911 is on a distinguished road
Update available

Changes

- Scanner updated to find all lz4 streams the game has (I think)

Notes

The files in vfx_data directory should be present ONLY during encoding and you should get this result when inflating
Code:
Compressed 70 files, 77,548,153,037 => 108,796,991,535 bytes. Ratio 140.30%
Compression time: cpu 131.33 sec/real 3361.83 sec = 4%. Speed 23.07 mB/s
all *.vfs# files except
content_platform.vfs0 {contains shaders}
content_05_sounds_us.vfs0
content_06_sounds_ru.vfs0
content_07_sounds_de.vfs0
content_08_sounds_es.vfs0
content_09_sounds_fr.vfs0
content_10_sounds_it.vfs0
patch_02_sounds_uk.vfs0


// use a different liblz4.dll to get 102GB instead of 101GB
Code:
Compressed 70 files, 77,548,153,037 => 109,700,728,480 bytes. Ratio 141.46%
Compression time: cpu 92.30 sec/real 1173.97 sec = 8%. Speed 66.06 mB/s
There are 5 streams in this game that take about 60-90 seconds each to recompress. (cpu usage will be at its minimum during this)

// I noticed a lot of ogg headers in the game files, so maybe consider oggre (maybe it will work)

After working on this for 2 days I've come to a conclusion, fuck these lz4 compressed games.

Last edited by Razor12911; 08-06-2020 at 15:11.
Reply With Quote
The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
ffmla (09-06-2020), shazzla (09-06-2020), ZAZA4EVER (09-06-2020)
  #5  
Old 11-06-2020, 00:48
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,577
Thanks: 942
Thanked 5,835 Times in 2,153 Posts
KaktoR is on a distinguished road
Does not precompress anything for me

Code:
Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%
Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile
So I assume I have to split all the files rather do the job for the whole folder. Sad
__________________
Haters gonna hate
Reply With Quote
  #6  
Old 11-06-2020, 09:42
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 527
Thanks: 113
Thanked 753 Times in 294 Posts
panker1992 is on a distinguished road
i have put alot of effort to find this game's data struc. there are alot of ogg files in it.

Basically its OGG only high quality as well.

there is 2 options, either that precompressor can opt out the data or we must zero out. for maximum compression ratio.
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
  #7  
Old 11-06-2020, 17:20
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,636
Thanks: 2,013
Thanked 10,339 Times in 2,202 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by KaktoR View Post
Does not precompress anything for me

Code:
Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%
Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile
So I assume I have to split all the files rather do the job for the whole folder. Sad
that's strange
Reply With Quote
  #8  
Old 12-06-2020, 18:59
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,636
Thanks: 2,013
Thanked 10,339 Times in 2,202 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by KaktoR View Post
Does not precompress anything for me

Code:
Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%
Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile
So I assume I have to split all the files rather do the job for the whole folder. Sad
i just reinstalled the game and ran a test with all files (no splits) and it worked.
Reply With Quote
  #9  
Old 13-06-2020, 01:09
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,577
Thanks: 942
Thanked 5,835 Times in 2,153 Posts
KaktoR is on a distinguished road
False alarm

My problem was I didn't include the vfx folder aswell. Oh boy.
__________________
Haters gonna hate
Reply With Quote
The Following 3 Users Say Thank You to KaktoR For This Useful Post:
BLACKFIRE69 (13-06-2020), jabervamp (14-11-2020), sanekbest1 (06-05-2021)
  #10  
Old 10-03-2022, 09:43
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,636
Thanks: 2,013
Thanked 10,339 Times in 2,202 Posts
Razor12911 is on a distinguished road
For Enhanced Edition of this game, you'll need to generate new vfx_data files because the vfx_data in the main post contains header information for the standard game before the ray tracing update with high resolution textures.

to do that, you'll need to use vfxgen
Code:
vfxgen GamePath LogFile
Use the newly generate files on the game files.

Notes

Use metro-vfx-tool to generate new log files if the game has been updated or if the uploaded log files seem to not work.
Attached Files
File Type: 7z vfxgen.7z (276.1 KB, 10 views)
File Type: rar logs.rar (4.16 MB, 13 views)

Last edited by Razor12911; 10-03-2022 at 09:47.
Reply With Quote
The Following User Says Thank You to Razor12911 For This Useful Post:
Gehrman (10-03-2022)
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Metro Exodus mausschieber PC Games - CD/DVD Conversions 3 30-05-2020 10:43
SRTTR Precompression Tool Razor12911 Conversion Tutorials 3 26-05-2020 05:28
Metro Exodus GTX590 PC Games - CD/DVD Conversions 7 07-05-2019 11:31
Metro Exodus Fabioddq PC Games - CD/DVD Conversions 4 09-03-2019 04:36
Metro Exodus vfx Unpacker Help masen485 Conversion Tutorials 6 28-02-2019 06:17



All times are GMT -7. The time now is 09:33.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com