Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #3331  
Old 08-01-2023, 04:25
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 1,161
Thanks: 284
Thanked 1,354 Times in 614 Posts
Masquerade is on a distinguished road
Watch_Dogs

Full game will ALL languages and ALL DLC content.

Redists and UPlay installer ripped - they are completely unneeded if NoCD is applied.

Requires latest XTool with Watch_Dogs Database and XCompress Plugin thanks to Razor12911.

Requires QuickBMS thanks to Luigi Auriemma and Dunia Engine script.

Thanks to Nicolas Comerci for precomp stdio fork.

Do not use Oggre on the vorbis audio. Encoding is fine, but the decoder will crash.

Conversion Structure:
  • Archive 1: *.DAT (all except sound.dat, language dats and videos.dat)
  • Archive 2: All remaining files (binaries and misc documents, *.FAT except language fats)
  • Archive 3: Bink Videos listed below (pre-packed with BPK)
  • Archive 4: Videos.dat with BPK compatible videos removed
  • Archive 5: Sound.dat + English FATs/DATs
  • Remaining Language Archives: FATs/DATs for extra Non-English languages.
Compress with the following:
  • Archive 1:
    Code:
    xtool_mwatchdogs_dedup5+lolz
  • Archive 2:
    Code:
    precomps+srep+lolz
  • Archive 3:
    • Extract the videos.dat with QuickBMS. Use XTool erase command to erase the following videos from the dat:
      Code:
      0000000000000000.kb2
      0000000000000001.kb2
      0000000000000003.kb2
      0000000000000005.kb2
      0000000000000007.kb2
      000000000000000a.kb2
      000000000000000b.kb2
      000000000000000d.kb2
      000000000000000f.kb2
      0000000000000012.kb2
      0000000000000018.kb2
      000000000000001a.kb2
      000000000000001c.kb2
      000000000000001d.kb2
      000000000000001f.kb2
      0000000000000021.kb2
      0000000000000022.kb2
      0000000000000026.kb2
      0000000000000028.kb2
      0000000000000029.kb2
      000000000000002b.kb2
      000000000000002c.kb2
      000000000000002e.kb2
      0000000000000033.kb2
      0000000000000035.kb2
      0000000000000038.kb2
      000000000000003b.kb2
      000000000000003e.kb2
      000000000000003f.kb2
      0000000000000040.kb2
      0000000000000041.kb2
      0000000000000042.kb2
      0000000000000045.kb2
      0000000000000048.kb2
      0000000000000049.kb2
      000000000000004a.kb2
      000000000000004b.kb2
      000000000000004c.kb2
      000000000000004d.kb2
      000000000000004e.kb2
      0000000000000051.kb2
      0000000000000052.kb2
      0000000000000053.kb2
      0000000000000054.kb2
      0000000000000055.kb2
      0000000000000057.kb2
      000000000000005e.kb2
      000000000000005f.kb2
      0000000000000060.kb2
      0000000000000061.kb2
      000000000000006b.kb2
      000000000000006c.kb2
      0000000000000072.kb2
      0000000000000073.kb2
      0000000000000075.kb2
      0000000000000076.kb2
      0000000000000078.kb2
      000000000000007b.kb2
      000000000000007e.kb2
      0000000000000080.kb2
      0000000000000081.kb2
      0000000000000084.kb2
      0000000000000086.kb2
      0000000000000087.kb2
      0000000000000089.kb2
      000000000000008b.kb2
      000000000000008e.kb2
      0000000000000094.kb2
      0000000000000095.kb2
      0000000000000096.kb2
      000000000000009a.kb2
      000000000000009b.kb2
      00000000000000a2.kb2
      00000000000000a5.kb2
      00000000000000a8.kb2
      00000000000000aa.kb2
      00000000000000ad.kb2
      00000000000000ae.kb2
      00000000000000b0.kb2
      00000000000000b6.kb2
      00000000000000b7.kb2
      00000000000000b8.kb2
      00000000000000ba.kb2
      00000000000000bb.kb2
      00000000000000bd.kb2
      00000000000000c0.kb2
      00000000000000c2.kb2
      00000000000000c3.kb2
      00000000000000ca.kb2
      00000000000000cc.kb2
      00000000000000cf.kb2
      00000000000000d3.kb2
      00000000000000d5.kb2
      00000000000000d7.kb2
      00000000000000d8.kb2
      00000000000000da.kb2
      00000000000000db.kb2
      00000000000000dc.kb2
      00000000000000e5.kb2
      00000000000000e9.kb2
      00000000000000ea.kb2
      00000000000000eb.kb2
      00000000000000ec.kb2
      00000000000000f1.kb2
      00000000000000f2.kb2
      00000000000000f3.kb2
      00000000000000f6.kb2
      00000000000000fa.kb2
      00000000000000fd.kb2
      00000000000000fe.kb2
      0000000000000101.kb2
      0000000000000102.kb2
      0000000000000104.kb2
      000000000000010c.kb2
      000000000000010d.kb2
    • Pack those videos with BPK (use CLS if you want, I used BPK executable version since I could MT it with mparallel). Those above videos don't require patching. The other videos from the dat get motion_data warning upon packing so packing those is impossible.
    • Pack Archive 3 with srep.

  • Archive 4:
    Code:
    srep+LZMA2
  • Archive 5:
    Code:
    rz
  • Remaining Language Archives:
    Code:
    xtool_mwatchdogs+rz
    
    (don't use xtool dedup since rz has built in dedup)

Final Size

Code:
-------------------------
| Original Size: 28.9GB |
-------------------------
| Game + EN   | 12.12GB |
-------------------------
|      + DE   | +1.21GB |
|                       |
|      + ES   | +1.21GB |
|                       |
|      + FR   | +1.25GB |
|                       |
|      + IT   | +1.20GB |
|                       |
|      + JP   | +1.32GB |
|                       |
|      + PTBR | +1.20GB |
|                       |
|      + RU   | +1.21GB |
| ----------------------|
| TOTAL       | 20.72GB |
-------------------------

Last edited by Masquerade; 08-01-2023 at 04:32.
Reply With Quote
The Following 8 Users Say Thank You to Masquerade For This Useful Post:
BKR-TN (08-01-2023), fabrieunko (08-01-2023), Gehrman (08-01-2023), JustFun (12-03-2023), kj911 (08-01-2023), Razor12911 (08-01-2023), ScOOt3r (08-01-2023), ZAZA4EVER (29-01-2023)
Sponsored Links
  #3332  
Old 14-01-2023, 08:53
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 4,398
Thanks: 1,077
Thanked 7,004 Times in 2,653 Posts
KaktoR is on a distinguished road
One Piece Odyssey

Code:
 15:46:00 - Selected ARC/DS method for Data1a-01.bin was: xtool:c128mb:mue4,k0x6005F03B0D2DABCD75892C80958FFB00CBA5437AD37EB4BFCD5960FFE0C4E12D+xtool:mpreflate+xtool:db:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 16:37:14 - Overall input size: 29.31 GB
 16:37:14 - Overall output size: 24.72 GB (Ratio 84.34%)
 16:37:14 - Overall conversion time: 00:51:12
__________________
Haters gonna hate
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
JustFun (12-03-2023)
  #3333  
Old 14-01-2023, 09:50
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 1,161
Thanks: 284
Thanked 1,354 Times in 614 Posts
Masquerade is on a distinguished road
One Piece Odyssey

Used CLS-UE4D library by Shegorat, but you can also use XTool by Razor12911 (method here by KaktoR).

The file "pakchunk10-WindowsNoEditor.pak" contains only CriMovie USM files so you can just Store this file or decrypt and dedup.

Remaining files:

Code:
ue4d:key=6005F03B0D2DABCD75892C80958FFB00CBA5437AD37EB4BFCD5960FFE0C4E12D+xtool_zlib_dedup5+lolz
Start Size: 29.2GB
Final Size: 22.7GB
Reply With Quote
The Following User Says Thank You to Masquerade For This Useful Post:
JustFun (12-03-2023)
  #3334  
Old 15-01-2023, 06:08
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 4,398
Thanks: 1,077
Thanked 7,004 Times in 2,653 Posts
KaktoR is on a distinguished road
Aquatico

Code:
 13:26:49 - Selected ARC/DS method for Data1a-01.bin was: srep+lolz:d64:mtt1:mt12:mc1023
 13:26:49 - Selected ARC/DS method for Data1b-01.bin was: msc_tak+srep+4x4:lzma
 13:26:49 - Selected ARC/DS method for Data1c-01.bin was: srep+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 14:04:23 - Overall input size: 8.35 GB
 14:04:23 - Overall output size: 2.00 GB (Ratio 23.99%)
 14:04:23 - Overall conversion time: 00:37:32
-------------------------------------------------------------------------------------------------------------------------------------------
 14:07:58 - Overall decompression time: 00:03:15
 14:07:58 - All files have been successfully extracted!

Data1a = *.mdl|*.dds|*.stl
Data1b = *.bmp|*.wav|*.mp3
Data1c = rest of the files
__________________
Haters gonna hate
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
JustFun (12-03-2023)
  #3335  
Old 15-01-2023, 17:51
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 350
Thanks: 119
Thanked 58 Times in 37 Posts
L33THAK0R is on a distinguished road
Had a quick look so maybe I'm missing something obvious but are there any lossless compressors that support WaveForm "MS ADPCM" formatted audio? MSC only supports PCM formatted samples, and I got a feeling some substantial gains could be had if this format is able to be properly processed across a range of titles.
Reply With Quote
  #3336  
Old 16-01-2023, 01:48
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 1,161
Thanks: 284
Thanked 1,354 Times in 614 Posts
Masquerade is on a distinguished road
No afaik. ADPCM is a lossy format. You could try looking into this: https://monkeysaudio.com/

But it works in a similar way to Toms Lossless Audio Kompressor so then again it may do nothing.
Reply With Quote
  #3337  
Old 18-01-2023, 03:22
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 350
Thanks: 119
Thanked 58 Times in 37 Posts
L33THAK0R is on a distinguished road
A Variety of Results

All results include the installer's weight (usually between 4 - 9mb)

Avatar: The Game, James Cameron’s

3.31 GiB >>> 1.98 GiB

xtool 0.6.5 + srep + lolz

Batman: Arkham Knight

51.75 GiB >>> 26.2 GiB (Incl. Optional Videos + Lossless Videos) | 25.3 (Incl. Lossy Videos)

Note: In order to properly create lossy videos you have to extract the cue points from the appropriate USMs'. This process isn't tricky and only takes around a minute in an ideal setup however calculating the offsets and translating them into usable integers can take a hot minute. As I'm sure those who have done a similar job are aware this process can't be automated due to the lack of consistency that cue timings are stored within their appropriate headers, this was definitely more so a proof of concept considering the fact there are ~880 videos that require cue point decoding.

xtool (I forgot to document the version I used, since I did this one back in mid 2020) + uelr + srep + lolz

Far Cry 2 (Fortunes Edition)

3.27 GiB >>> 1.62 GiB

delzorec + srep + lolz

Just Cause 2

4.08 GiB >>> 1.00 GiB

Note: Final size could've been smaller (~950MiB) but I included a couple dozen QoL fixes that added a bit of weight in additional texture data.

xtool 0.3.21 + msc + srep + lolz

Mad Max

32.88 GiB >>> 3.55 GiB (Incl. Lossless Videos) | 3.50 GiB (Incl. Lossy Videos)

Note: Lossy videos were definitley just an experiement, 1080p Bink2 videos rescaled to 720p Bink1, even at 99% the target filesize look like dog-shit. Honestly just wanted to see how small I could get things. There is potential room for improvement if someone can pack the ~900 MiB of dialogue thats packed into one of the Banks, but it's encoded in a format that I can't seem to process, or even losslessly transform to and from a packable format.

xtool 0.3.21 + oggre + srep + lolz

The Surge

21.78 GiB >>> 3.86 GiB (720p Lossless Videos) | 3.72 GiB (720p Lossy Videos)

Note: 1080p + 720p videos both exist in the original game files, I just chose to present 720p for the results as its the smallest, valid, lossless size. Use a LZ4 library to recompress, I got pretty similar results accross a good dozen or so libraries, but some streams were still dropped, I'd encourage people to investigate further but I honestly spent too much time on this series for me to justify spending any more time testing is tricky.

xtool 0.3.21 + oggre + srep + lolz

-----------------------------------------------

I would post more, but these are just the most interesting results I've gotten. I've managed to beat a fair few records posted both here and by other repackers on their own websites but only by using more modern methods and by managing to process troublesome blocks of data by patching out the offending data.

Last edited by L33THAK0R; 18-01-2023 at 06:51.
Reply With Quote
The Following 4 Users Say Thank You to L33THAK0R For This Useful Post:
JustFun (12-03-2023), kj911 (18-01-2023), sanekbest1 (21-08-2023), ScOOt3r (18-01-2023)
  #3338  
Old 18-01-2023, 09:00
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 1,161
Thanks: 284
Thanked 1,354 Times in 614 Posts
Masquerade is on a distinguished road
@L33THAK0R
Would love it if you could make a post detailing more about the Cue points in the USM videos. I believe it would truly be a valuable resource.
Reply With Quote
  #3339  
Old 20-01-2023, 06:02
Carldric Clement's Avatar
Carldric Clement Carldric Clement is offline
Registered User
 
Join Date: Aug 2014
Location: Toboh, Sabah, Malaysia
Posts: 579
Thanks: 579
Thanked 632 Times in 227 Posts
Carldric Clement is on a distinguished road
Project Zomboid v41.78.12

Original Size: 6.82 GB
Compressed Size: 1.68 GB

Option:
Code:
* JPG File   = packjpg
* OGG File   = oggre:s3
* Wav File   = tta
* Rest files = xtool:zlib:reflate+srep:m3f:a2+exe2+7z:d128m:mt2
Reply With Quote
The Following User Says Thank You to Carldric Clement For This Useful Post:
JustFun (12-03-2023)
  #3340  
Old 20-01-2023, 13:11
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 4,398
Thanks: 1,077
Thanked 7,004 Times in 2,653 Posts
KaktoR is on a distinguished road
Sid Meier's Civilization VI
v1.0.12.31 (19 January 2023), all DLC, OST ripped

Code:
 19:27:51 - Selected ARC/DS method for Data1a-01.bin was: bpk
 19:27:51 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3+lolz:d32:mtt1:mt12:fba4096:mc2
 19:27:51 - Selected ARC/SPLIT method for Data1c-01.bin was: xtool:db:dd3+lolz:d32:mtt1:mt12:fba4096:mc2/$deflatepack=xtool:mpng:d1+xtool:mpreflate+xtool:db:dd3+lolz:d32:mtt1:mt12:fba4096:mc2/$oggrepack=oggre
-----------------------------------------------------------------------------------------
 21:02:04 - Overall input size: 21.36 GB
 21:02:04 - Overall output size: 8.13 GB (Ratio 38.08%)
 21:02:04 - Overall conversion time: 01:34:11

Data1a = *.bk2 (exclude "DLC\GranColombia_Maya\Platforms\Windows\Movies\GranColombia_Maya_DefeatClimate.bk2" or use bink patch method for this single file)
Data1b = *.blp
Data1c = rest of the files

PS: I used wemtool by Masquerade for the wem's
__________________
Haters gonna hate
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
JustFun (12-03-2023)
  #3341  
Old 22-01-2023, 08:23
kuyhaa's Avatar
kuyhaa kuyhaa is offline
Registered User
 
Join Date: Jun 2019
Location: metro
Posts: 54
Thanks: 88
Thanked 8 Times in 4 Posts
kuyhaa is on a distinguished road
hi

i try precomp Steel Division 2

use xtool reflate but still got CRC error when decomp

any info for solve ?

thanks
Reply With Quote
  #3342  
Old 22-01-2023, 08:33
shazzla shazzla is offline
Registered User
 
Join Date: Nov 2010
Location: Hunnia
Posts: 271
Thanks: 501
Thanked 94 Times in 71 Posts
shazzla is on a distinguished road
Exclude those files from precomp process. I did it,too.
Reply With Quote
  #3343  
Old 22-01-2023, 23:31
Gehrman's Avatar
Gehrman Gehrman is offline
Registered User
 
Join Date: Jan 2020
Location: Save Palestine
Posts: 78
Thanks: 1,267
Thanked 87 Times in 47 Posts
Gehrman is on a distinguished road
Quote:
Originally Posted by kuyhaa View Post
hi

i try precomp Steel Division 2

use xtool reflate but still got CRC error when decomp

any info for solve ?

thanks
Try with compatibility with Windows 7
Code:
ECHO OFF
Reg.exe add "HKCU\Software\Microsoft\Windows NT\CurrentVersion\AppCompatFlags\Layers" /v "%~dp0Setup.exe" /t REG_SZ /d "~ DPIUNAWARE WIN7RTM" /f
START Setup.exe
Reg Delete "HKCU\Software\Microsoft\Windows NT\CurrentVersion\AppCompatFlags\Layers" /v "%~dp0Setup.exe"  /f
Exit
Or use XTool 0.2. (It works well with ZLib's strange streams.)
Attached Files
File Type: 7z XTool_v2.7z (1.12 MB, 22 views)

Last edited by Gehrman; 23-01-2023 at 00:07.
Reply With Quote
  #3344  
Old 22-01-2023, 23:56
Gehrman's Avatar
Gehrman Gehrman is offline
Registered User
 
Join Date: Jan 2020
Location: Save Palestine
Posts: 78
Thanks: 1,267
Thanked 87 Times in 47 Posts
Gehrman is on a distinguished road
Far Cry 4 Gold Edition (1.10)

Code:
30.36 GB (EN)
Sound*
Code:
msc:raw=1+srep:m3f:l512+4x4:lzma:a1:mfbt4:32m:fb273:mc10000:lc8
*.DAT
Code:
xtool:c256mb:mfc4:dd3+lolz2:d32:dm00:fba0:gm20:mt8:mtt1:mc128
Other Files
Code:
Srep+LZMA
Code:
Final Size: 12.2 GB

Last edited by Gehrman; 23-01-2023 at 00:01.
Reply With Quote
The Following User Says Thank You to Gehrman For This Useful Post:
JustFun (12-03-2023)
  #3345  
Old 23-01-2023, 00:15
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 350
Thanks: 119
Thanked 58 Times in 37 Posts
L33THAK0R is on a distinguished road
Far Cry 4 Gold Edition (v1.10)

27.30 GiB >>> 10.9 GiB (Incl. Lossless Videos + Ripped Startup Videos, weighing in at ~40 MiB)

DELZORec + srep + lolz

Note: BPK can't be used as these are the "g" revision of the Bink2 codec. Ripped files include any included redists and non-English loc., as well as the startup video.

It's interesting to see that @Gehrman managed to get MSC working with the by just using the RAW detection, I'll give it a shot myself to see if any further gains can be had.
Reply With Quote
The Following 2 Users Say Thank You to L33THAK0R For This Useful Post:
Gehrman (23-01-2023), JustFun (12-03-2023)
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Games Are For Kids JoyBoy Chit Chat 83 16-11-2021 15:28
CorePack Compression methods ? Help ramazan19833 Conversion Tutorials 34 09-08-2018 07:51
i got the email in the mail about copying ps2 games EVOEvo PS2 Games 7 21-11-2003 08:56
Self-booting games on an older Japanese DC? Named DC Games 1 26-09-2003 18:48
Having Problems Burning Numerous *Recent* Games....Help is Appreciated Protosstic PSX Games 2 15-01-2002 22:27



All times are GMT -7. The time now is 06:05.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com