Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #136  
Old 07-06-2021, 09:53
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,630
Thanks: 2,003
Thanked 10,317 Times in 2,198 Posts
Razor12911 is on a distinguished road
as I mentioned before, if you never specify what codecs (or streams) to be used from a plugin, they are all enabled so this means all the files are required to be present but if they are missing, like missing key or dictionary then that codec will be disabled, for example only fifa games require key and if the key is nowhere to be found then the key that corresponds to a particular stream will be disabled, otherwise everything else will work as they don't require the files. As for decompression, none of these files are required to be present.
Reply With Quote
The Following User Says Thank You to Razor12911 For This Useful Post:
Cesar82 (07-06-2021)
Sponsored Links
  #137  
Old 07-06-2021, 22:49
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,630
Thanks: 2,003
Thanked 10,317 Times in 2,198 Posts
Razor12911 is on a distinguished road
Unravel 1 & 2

Instructions
Use Bms2Xtl on attached script to generate database and also make use of lz4x plugin for precompression.

Example
Code:
bms2xtl unravel.bms "D:\Games\SteamLibrary\steamapps\common\Unravel\kits\Unravel.kit" unravel.xtl

Notes

Both lz4x.exe and liblz4.dll are required for both encoding and decoding.
Attached Files
File Type: 7z unravel.7z (642 Bytes, 6 views)

Last edited by Razor12911; 23-03-2022 at 20:57.
Reply With Quote
The Following 5 Users Say Thank You to Razor12911 For This Useful Post:
:( Sad8669 (08-06-2021), dixen (08-06-2021), Gehrman (24-06-2021), L0v3craft (08-06-2021), Mortal Lord (08-06-2021)
  #138  
Old 08-06-2021, 10:03
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 730
Thanks: 160
Thanked 761 Times in 382 Posts
Masquerade is on a distinguished road
@Razor12911 How to decompress Unreal.dll method on xtool v18?
Code:
[External compressor:mele]
header     = 0
unpackcmd  = xtool decode -t100p - - <stdin> <stdout>
Code:
FreeArc 0.67 (March 15 2014) extracting archive: output.MSQ
Extracting 21 files, 7,781,670 bytes. Processed   1%
ERROR: general (de)compression error in mele
Unreal.dll is with xtool.exe...

Hopefully there is a fix without me needing to remake my archive all over again.

https://anonfiles.com/36M4c703uc/

Here is a sample archive. It's compressed with just mele method:

Code:
[External compressor: mele]
header = 0
packcmd = "xtool.exe" precomp -mue3:m2 -c256mb -t12 - - <stdin> <stdout>
Reply With Quote
  #139  
Old 08-06-2021, 10:08
:( Sad8669 :( Sad8669 is offline
Registered User
 
Join Date: Oct 2020
Location: Triangulum Galaxy, Messier 33
Posts: 189
Thanks: 81
Thanked 146 Times in 88 Posts
:( Sad8669 is on a distinguished road
Unravel???!! Damn just when i deleted the game .

Here the ones i did before i deleted them.

Unravel
Unravel 2

The XZLib and precomp_mtx were used because it was giving like 100.02% or 100.01%, doesn't make a difference but i need to make every single MB count xD.
I once saw on QuickBMS web that Unravel contains LZ4 streams.
Attached Images
File Type: png 2.PNG (1.6 KB, 199 views)
__________________
The X who used to CODE, memories are bizzare thing indeed.

Last edited by :( Sad8669; 08-06-2021 at 10:17.
Reply With Quote
  #140  
Old 08-06-2021, 10:14
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,630
Thanks: 2,003
Thanked 10,317 Times in 2,198 Posts
Razor12911 is on a distinguished road
@Masquerade

You do realize your archives are obfuscated? Can't open because of FA protect.

Code:
Compressed 1 file, 81,387,688 => 327,483,945 bytes. Ratio 402.38%
Compression time: cpu 0.08 sec/real 9.71 sec = 1%. Speed 8.38 mB/s

Tested 1 file, 327,483,945 => 81,387,688 bytes. Ratio 402.38%
Testing time: cpu 0.03 sec/real 7.93 sec = 0%. Speed 10.27 mB/s
used 0.3.18, I haven't touched oodle nor the 2nd method of ue4 for this game since 0.3.13
Attached Files
File Type: 7z test.7z (2.86 MB, 23 views)
Reply With Quote
  #141  
Old 08-06-2021, 10:26
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 730
Thanks: 160
Thanked 761 Times in 382 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
@Masquerade

You do realize your archives are obfuscated? Can't open because of FA protect
Apologies, I thought I uploaded a clean archive.

Are the --dbase and --dedup parts required? I don't have those in my packcmd and the archive will not decompress.
Reply With Quote
  #142  
Old 08-06-2021, 10:32
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,630
Thanks: 2,003
Thanked 10,317 Times in 2,198 Posts
Razor12911 is on a distinguished road
no they are not, I just put the plugin near xtool after unpacking without really checking what command lines were used and it just works, and to confirm. I removed both --dedup and --dbase and still works.

Maybe send an archive without protection and I'll check
Reply With Quote
  #143  
Old 08-06-2021, 10:34
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 730
Thanks: 160
Thanked 761 Times in 382 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
no they are not, I just put the plugin near xtool after unpacking without really checking what command lines were used and it just works, and to confirm. I removed both --dedup and --dbase and still works.

Maybe send an archive without protection and I'll check
https://anonfiles.com/Bdf1da06u5/
Reply With Quote
  #144  
Old 08-06-2021, 10:50
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,630
Thanks: 2,003
Thanked 10,317 Times in 2,198 Posts
Razor12911 is on a distinguished road
Guys guys, make sure that if there were any libraries used during compression that they are also present during decompression.

I was being specific that only database files (xtl) and configuration files (ini) are the ones that can be discarded.
Reply With Quote
The Following User Says Thank You to Razor12911 For This Useful Post:
Cesar82 (08-06-2021)
  #145  
Old 08-06-2021, 12:37
Cesar82's Avatar
Cesar82 Cesar82 is offline
Registered User
 
Join Date: May 2011
Location: Brazil
Posts: 776
Thanks: 1,289
Thanked 1,641 Times in 559 Posts
Cesar82 is on a distinguished road
I did some tests with the Unravel plugin.
These ratio results are normal (only inflate) for Unravel game?


For Unravel Two I always get the same error below 1% precompression:
I'm trying to compress the entire game folder.
PS: The files needed for precompression are together from XTool.


I tried to replicate the test with only .bat file but it didn't compress.
I attached the test using the .bat file I used.


If anyone knows what I did wrong, let me know.

Edit:
he results obtained for the final game "Unravel" were:
Code:
Method: xtool:c32mb:munravel1+srep_new+4x4:b128mb:lzma:ultra:128m:bt4:fb273:lc8:mc1000000
Input size: 3,37 GB
Output size: 2,30 GB
Conversion time: 00:09:28
Decompression time: 00:01:09

----------------------------------------------------------------------------------------------------------------------------------------
 Creating Data1a-01.bin file, Please Wait...
----------------------------------------------------------------------------------------------------------------------------------------
FreeArc 0.67 (March 15 2014) creating archive: .\Conversion_Output\Data1a-01.bin
Compressing 89 files, 3,621,043,995 bytes. Processed  10.2%
Compressing 5,245,671,359 bytes with "OTHERS\SREP\srep.exe" -m3f -a0/0 InFile OutFile
 10.2%SREP 3.93a beta (October 11, 2014): input size 5002 mb, memory used 315 mb, -m3f -l512 -c512 -a0/0 -hash=vmac -b8mb
100%: 5,245,671,359 -> 4,131,911,575: 78.77%.  Cpu 64 mb/s (77.781 sec), real 59 mb/s (85.472 sec) = 91%.  Remains 00:00
Decompression memory is 119 mb.  607,687 matches = 9,722,992 bytes = 0.24% of file
Errorlevel=0
Compressed 89 files, 3,621,043,995 => 2,474,832,435 bytes. Ratio 68.35%
Compression time: cpu 5.52 sec/real 565.58 sec = 1%. Speed 6.40 mB/s
All OK

----------------------------------------------------------------------------------------------------------------------------------------
 Extracting Data1a-01.bin file, Please Wait...
----------------------------------------------------------------------------------------------------------------------------------------
FreeArc 0.67 (March 15 2014) extracting archive: .\Conversion_Output\DVD\Data1a-01.bin
Extracting 89 files, 3,621,043,995 bytes. Processed  99.6%
Extracted 89 files, 2,474,832,435 => 3,621,043,995 bytes. Ratio 68.35%
Extraction time: cpu 212.53 sec/real 68.45 sec = 311%. Speed 52.90 mB/s
All OK
Attached Files
File Type: 7z test_uravel.7z (1.66 MB, 10 views)

Last edited by Cesar82; 08-06-2021 at 13:24.
Reply With Quote
  #146  
Old 08-06-2021, 13:57
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 408
Thanks: 138
Thanked 459 Times in 227 Posts
doofoo24 is on a distinguished road
quick test
unravel 1
3.17gb to 4.68gb using munravel1 -c64mb without --dedup
then srep+lolz from 4.68gb to 2.04gb nothing rip include trial exe
srep:m3f:d1g:a2+lolz:mt4:mtt1:d128:fba4096:mc1023: pc4:gm20:dtb1:x2

unravel 2
6.76gb to 10.1gb using munravel2 -c32mb without --dedup
then srep+lolz from 10.1gb to 3.5gb...
srep:m3f:d1g:a2+lolz:mt4:mtt1:d128:fba4096:mc1023: pc4:gm20:dtb1:x2

decompress without error...

Last edited by doofoo24; 08-06-2021 at 14:03.
Reply With Quote
  #147  
Old 08-06-2021, 15:33
Cesar82's Avatar
Cesar82 Cesar82 is offline
Registered User
 
Join Date: May 2011
Location: Brazil
Posts: 776
Thanks: 1,289
Thanked 1,641 Times in 559 Posts
Cesar82 is on a distinguished road
@Razor12911, about my previous post, I would like to inform you that the plugin is working with UnravelTwo just installed the game.
What happened was that I had the game installed on my system and with a PT-BR (tribogamer) translation applied.
The translation modifies 2 files in the D3D11kits folder (Data.kit and Data.kit.0).
I only tested including files in a "Pack" folder and there were no errors when compressing the "Data.kit" file.
Another file from the "D3D11\V" folder (0A6917B6) gives errors when compressing if I remove "Data.kit.0" from the game folder (this 0A6917B6 file has not been modified).
If I remove both files "0A6917B6" and "Data.kit.0" from the game folder no errors occur.
If you want to do some future checking in the plugin HERE is the sample of files changed by the translation and also the file "0A6917B6" (original file that had errors when it was in the folder).
PS: Unravel 1 also had the PT-BR translation applied and the plugin worked perfectly with modified files.

Code:
Unravel Two Precompression Result (Originals Files):
Method:  xtool:c32mb:munravel2
Input size: 7,05 GB
Output size: 10,41 GB (Ratio 147.66%)
Conversion time: 00:06:37
Reply With Quote
  #148  
Old 13-06-2021, 14:40
biotec2k8 biotec2k8 is offline
Registered User
 
Join Date: Jan 2021
Location: Germany
Posts: 51
Thanks: 18
Thanked 4 Times in 4 Posts
biotec2k8 is on a distinguished road
I Cannot Pack Unravell 1 with the Given BAT File...Anyone Another Bat that Goes on?

Last edited by biotec2k8; 13-06-2021 at 14:46.
Reply With Quote
  #149  
Old 14-06-2021, 00:22
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,630
Thanks: 2,003
Thanked 10,317 Times in 2,198 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by biotec2k8 View Post
I Cannot Pack Unravell 1 with the Given BAT File...Anyone Another Bat that Goes on?
Make sure you have the updated xtool along with the required libraries and the game files should be original.

Quote:
Originally Posted by dixen View Post
Razor, what about plugin for FarCry 3?)
https://fileforums.com/showpost.php?...76&postcount=6

Upload the xtl files produced.

Last edited by Razor12911; 14-06-2021 at 00:29.
Reply With Quote
  #150  
Old 14-06-2021, 03:20
dixen dixen is offline
Registered User
 
Join Date: Sep 2014
Location: Russia
Posts: 286
Thanks: 350
Thanked 327 Times in 148 Posts
dixen is on a distinguished road
Quote:
common.dat: 2634 stream(s)
ige.dat: 6952 stream(s)
patch.dat: 421 stream(s)
shadersobj.dat: 33430 stream(s)
mp_dlc1.dat: 15842 stream(s)
mp_dlc1_menus.dat: 50 stream(s)
multicommon.dat: 105147 stream(s)
But...FC3_main.fat - don't work..

Compressed 20 files, 7,065,329,260 => 9,449,481,150 bytes. Ratio 133.74%
Compression time: cpu 13.34 sec/real 824.47 sec = 2%. Speed 8.57 mB/s
All OK
Attached Files
File Type: rar fc3.rar (842.9 KB, 16 views)

Last edited by dixen; 14-06-2021 at 03:36.
Reply With Quote
The Following User Says Thank You to dixen For This Useful Post:
Razor12911 (14-06-2021)
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
XTool 2020 (Main Project) Razor12911 Conversion Tutorials 501 Yesterday 08:06
XTool - Successor of ZTool Razor12911 Conversion Tutorials 583 03-05-2022 12:11
[Dev]XTool Razor12911 Conversion Tutorials 180 23-10-2020 06:26
XTool 2019 (Plugins) Razor12911 Conversion Tutorials 50 16-05-2020 06:14



All times are GMT -7. The time now is 00:27.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com