Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 13-11-2024, 21:38
wareck wareck is offline
Registered User
 
Join Date: Dec 2017
Location: Mars
Posts: 48
Thanks: 11
Thanked 23 Times in 16 Posts
wareck is on a distinguished road
oggre optmization and dilemmas

I start this thread because I would like to solve a dilema about using oggre.

Actually I often use oggre_enc & oggre_dec (pre and post processing outside compression)
but I'm faced with a performance dilemma.

several small ogg files :
encode each file individually with oggre_enc
decode with oggre_dec
compare and make a diff file with hdiffz
in this case, fast installation (each file will be decoded, then patched)
but the final files are bigger
(several files, several hdiffz files, ogg_encoded files bigger)

one big file to process:
I merge all small ogg files in one archive or one chunk.
encode this big file with oggre_enc
decode with oggre_dec
compare and make a diff file with hdiffz
in this case, low speed installation (one big file to decode can take time)
but the final file is lower (one bigfile compressed, one hdiff file)

in fact after some analysis, with one big file, oggre_enc have better compression results due to ogg and frame deduplication.
With a big file we take the benefit of this step.
With several small file we gain in speed at the expense of this deduplication.

I try several things
-parallel processing (not working, because oggre do not like this)
-cut the big file in several part (working, but lost gain, more process = less deduplication)


example with numbers , game with 2.5Go of ogg files:
-single big ogg file processed with oggre => 1.65go, 7 minutes to uncompress and replace file in game
-big file cut in 4 chunk, then parallel uncompress => 1.92Go, 2 minutes to uncompress & replace files

if anyone has a better method, I'm interested.

Last edited by wareck; 13-11-2024 at 21:55.
Reply With Quote
Sponsored Links
  #2  
Old 15-11-2024, 00:15
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 1,167
Thanks: 284
Thanked 1,359 Times in 616 Posts
Masquerade is on a distinguished road
The single big file is the only way to do it in order to get the benefit of deduplication.

Also mparallel does work with oggre, this is how wemtool works.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump



All times are GMT -7. The time now is 03:34.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com