Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #196  
Old 24-10-2020, 09:52
Sebazz Sebazz is offline
Registered User
 
Join Date: Mar 2016
Location: Terra
Posts: 58
Thanks: 21
Thanked 7 Times in 6 Posts
Sebazz is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
try the same input without using Freearc and see if the error persists and if it does, send over the sample and I'll see what is causing the problem.
The only setting that works for me. I could solve it

Code:
[External compressor:xzlib]
header = 0
packcmd = xtool precomp -mzlib -c128mb -t100p-1 $$arcdatafile$$.tmp <stdout>


This Setting dont work for me, stopped the conversion.

Code:
[External compressor:xzlib]
header = 0
packcmd = xtool precomp -mzlib -c128mb -t100p-1 - - <stdin> <stdout>


This setting works but freezes the compresion.

Code:
[External compressor:xzlib]
header = 0
packcmd = xtool precomp -mzlib -c128mb -t100p-1 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp


Mmm rare bug
Reply With Quote
The Following User Says Thank You to Sebazz For This Useful Post:
Razor12911 (24-10-2020)
Sponsored Links
  #197  
Old 24-10-2020, 09:57
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,628
Thanks: 2,002
Thanked 10,314 Times in 2,197 Posts
Razor12911 is on a distinguished road
1.3 billion streams? Alrighty then, looks like I have to start working on this bug.
Reply With Quote
The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
dixen (24-10-2020), L0v3craft (24-10-2020), Sebazz (24-10-2020)
  #198  
Old 24-10-2020, 16:27
Sebazz Sebazz is offline
Registered User
 
Join Date: Mar 2016
Location: Terra
Posts: 58
Thanks: 21
Thanked 7 Times in 6 Posts
Sebazz is on a distinguished road
Code:
[External compressor:xzstd]
header    = 0
packcmd   = xtool precomp -mzstd -t100p-1 - - <stdin> <stdout>
unpackcmd = xtool decode -t100p-1 - - <stdin> <stdout>
With this setting, the zstd compression is much slower compared with zlib .
In my tests > zstd use aprox 150 mb memory / zlib use aprox 450 mb memory
With the new libzstd, what is an optimal setting for use ?

Last edited by Sebazz; 24-10-2020 at 16:34.
Reply With Quote
  #199  
Old 24-10-2020, 18:32
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,628
Thanks: 2,002
Thanked 10,314 Times in 2,197 Posts
Razor12911 is on a distinguished road
naturally zstd compresses slower than zlib especially when xtool tries high levels. optimal use is specifying what level to use furthermore, xdelta steps in for imperfect restoration.
-mzstd:l19 as an example.
Reply With Quote
The Following User Says Thank You to Razor12911 For This Useful Post:
Sebazz (25-10-2020)
  #200  
Old 26-10-2020, 05:56
ozolt ozolt is offline
Banned
 
Join Date: Dec 2017
Location: Random
Posts: 16
Thanks: 16
Thanked 1 Time in 1 Post
ozolt is on a distinguished road
Sorry I must ask...is main project renamed to 2010 so it's now XTool 2010, or is it 2020? ...because if this is not a mistake, this version numbering is very, very wrong. I'm guessing 2010 stands for year 2020 and 10th month but OMG...
Reply With Quote
  #201  
Old 26-10-2020, 06:00
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,628
Thanks: 2,002
Thanked 10,314 Times in 2,197 Posts
Razor12911 is on a distinguished road
It's the same way Microsoft releases versions for its Windows 10. And yes, year 2020 and 10th month. 2010
Reply With Quote
  #202  
Old 27-10-2020, 05:30
Giriplayslegend899's Avatar
Giriplayslegend899 Giriplayslegend899 is offline
Registered User
 
Join Date: Oct 2020
Location: India
Posts: 17
Thanks: 8
Thanked 2 Times in 1 Post
Giriplayslegend899 is on a distinguished road
hey,razor uh i dont know coding and stuff but what does this do ? create repacks or compress game files and how can i use it?
Reply With Quote
  #203  
Old 27-10-2020, 05:33
Giriplayslegend899's Avatar
Giriplayslegend899 Giriplayslegend899 is offline
Registered User
 
Join Date: Oct 2020
Location: India
Posts: 17
Thanks: 8
Thanked 2 Times in 1 Post
Giriplayslegend899 is on a distinguished road
and also what is source code? ( sorry if asking in wrong place) when i see some projects they say an update is out and give some kind of source code. what is that?
Reply With Quote
  #204  
Old 27-10-2020, 07:26
Sebazz Sebazz is offline
Registered User
 
Join Date: Mar 2016
Location: Terra
Posts: 58
Thanks: 21
Thanked 7 Times in 6 Posts
Sebazz is on a distinguished road
Quote:
Originally Posted by Giriplayslegend899 View Post
hey,razor uh i dont know coding and stuff but what does this do ? create repacks or compress game files and how can i use it?
This tools are for compress game files, in the case of XTool has functionally of inflate compatible streams of game engine, then srep compresses it and finally lzma or lolz or lzma2 compresses it even more.

Here are best methods for compress games ... usually i use srep+lzma2 for fast compression, but in some cases i add xtool depend of game.

https://fileforums.com/showthread.php?t=101639

You can get all other tools here.

https://www.fileforums.com/showthread.php?p=478349

Last edited by Sebazz; 27-10-2020 at 07:56.
Reply With Quote
  #205  
Old 27-10-2020, 14:35
ozolt ozolt is offline
Banned
 
Join Date: Dec 2017
Location: Random
Posts: 16
Thanks: 16
Thanked 1 Time in 1 Post
ozolt is on a distinguished road
Razor12911, can you please add , (or some other sign) as alternate option to specify combining codecs? I'm actually trying to use arc.exe by specifying codecs from command line rather than modifying arc.ini, so I'm trying to use packcmd in arc.ini like this:
...
[External compressor:xtool]
header = 0
packcmd = xtool precomp -m{option} -c32mb -t100p-1 - - <stdin> <stdout>
..so I can use, for example, arc.exe a -mxtool:zlib+reflate ...
But since you choose to use + sign to combine codecs this will not work....or if somebody have another idea how to specify different codecs that requires + sign from command line and not by editing arc.ini everytime, I would much appreciate advice...

Thanks in advance,
regards
Reply With Quote
  #206  
Old 27-10-2020, 20:23
Giriplayslegend899's Avatar
Giriplayslegend899 Giriplayslegend899 is offline
Registered User
 
Join Date: Oct 2020
Location: India
Posts: 17
Thanks: 8
Thanked 2 Times in 1 Post
Giriplayslegend899 is on a distinguished road
Question A heavy Thanks But....

Quote:
Originally Posted by Sebazz View Post
This tools are for compress game files, in the case of XTool has functionally of inflate compatible streams of game engine, then srep compresses it and finally lzma or lolz or lzma2 compresses it even more.

Here are best methods for compress games ... usually i use srep+lzma2 for fast compression, but in some cases i add xtool depend of game.

https://fileforums.com/showthread.php?t=101639

You can get all other tools here.

https://www.fileforums.com/showthread.php?p=478349
A heavy Thanks But i already have razor 's quick archive packer which is okay for me but how can i use custom installer ultimate ( the second link u gave ) . what can i do with it? and also whenever razor or y_thelastknight release an update for a project how can i update it? and what is source code?

sorry if i am asking too many questions.
Reply With Quote
  #207  
Old 28-10-2020, 14:31
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 729
Thanks: 158
Thanked 760 Times in 381 Posts
Masquerade is on a distinguished road
Just another oodle test:

Sekiro v1.05 Data4.bdt:

oo2reck (oo2core_4_win64.dll):

Code:
Compressed 1 file, 541,402,628 => 1,065,375,629 bytes. Ratio 196.78%
Compression time: cpu 0.63 sec/real 52.87 sec = 1%. Speed 10.24 mB/s
All OK
Xtool Kraken (oo2core_4_win64.dll):

Code:
Compressed 1 file, 541,402,628 => 1,045,442,710 bytes. Ratio 193.10%
Compression time: cpu 0.55 sec/real 38.73 sec = 1%. Speed 13.98 mB/s
All OK
Reply With Quote
The Following User Says Thank You to Masquerade For This Useful Post:
Razor12911 (29-10-2020)
  #208  
Old 29-10-2020, 03:37
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,628
Thanks: 2,002
Thanked 10,314 Times in 2,197 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by ozolt View Post
Razor12911, can you please add , (or some other sign) as alternate option to specify combining codecs? I'm actually trying to use arc.exe by specifying codecs from command line rather than modifying arc.ini, so I'm trying to use packcmd in arc.ini like this:
...
[External compressor:xtool]
header = 0
packcmd = xtool precomp -m{option} -c32mb -t100p-1 - - <stdin> <stdout>
..so I can use, for example, arc.exe a -mxtool:zlib+reflate ...
But since you choose to use + sign to combine codecs this will not work....or if somebody have another idea how to specify different codecs that requires + sign from command line and not by editing arc.ini everytime, I would much appreciate advice...

Thanks in advance,
regards
I'll add "+" as a resource string and if you want to change it as a user, you'd have to do it yourself. in the next update, that is

Update available

Changes

- added database search
- updated zlib scanner
- fixed reflate bug
- fixed 2GB memory limit

Notes
Database search is a feature similar to configuration support, a demonstration on Far Cry 5 and Watch Dogs Legion will be posted to show how it works.

Updated zlib scanner to eliminate some pesky false positives that cause reflate bugs, verification of reflate removed and should work faster now.

2010_R2 update broke reflate, not sure if you noticed but it's now fixed.

Report made by Kaktor on some file that gave outrageous ratios.
https://fileforums.com/showpost.php?...&postcount=559
Turns out the issue was caused by this
https://community.idera.com/develope...ream-2gb-limit

So I created a custom TMemoryStream that can handle more than 2GB data in x64

Code:
Compressed 1 file, 26,336,816 => 3,013,659,460 bytes. Ratio 11442.76%
Compression time: cpu 0.19 sec/real 11.60 sec = 2%. Speed 2.27 mB/s

Tested 1 file, 3,013,659,460 => 26,336,816 bytes. Ratio 11442.76%
Testing time: cpu 0.09 sec/real 3.05 sec = 3%. Speed 8.62 mB/s

Last edited by Razor12911; 29-10-2020 at 03:43.
Reply With Quote
The Following 6 Users Say Thank You to Razor12911 For This Useful Post:
78372 (29-10-2020), dixen (29-10-2020), ffmla (29-10-2020), Gupta (29-10-2020), KaktoR (29-10-2020), shazzla (29-10-2020)
  #209  
Old 29-10-2020, 07:33
Sebazz Sebazz is offline
Registered User
 
Join Date: Mar 2016
Location: Terra
Posts: 58
Thanks: 21
Thanked 7 Times in 6 Posts
Sebazz is on a distinguished road
Talking

Quote:
Originally Posted by Masquerade View Post
Just another oodle test:

Sekiro v1.05 Data4.bdt:

oo2reck (oo2core_4_win64.dll):

Code:
Compressed 1 file, 541,402,628 => 1,065,375,629 bytes. Ratio 196.78%
Compression time: cpu 0.63 sec/real 52.87 sec = 1%. Speed 10.24 mB/s
All OK
Xtool Kraken (oo2core_4_win64.dll):

Code:
Compressed 1 file, 541,402,628 => 1,045,442,710 bytes. Ratio 193.10%
Compression time: cpu 0.55 sec/real 38.73 sec = 1%. Speed 13.98 mB/s
All OK
Whats parameters you use in your arc.ini settings ? Thanks
Reply With Quote
  #210  
Old 29-10-2020, 07:56
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 729
Thanks: 158
Thanked 760 Times in 381 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by Sebazz View Post
Whats parameters you use in your arc.ini settings ? Thanks
Code:
[External compressor: xkraken]
header = 0
packcmd = xtool precomp -mkraken -c128mb -t16 - - <stdin> <stdout>
Reply With Quote
The Following User Says Thank You to Masquerade For This Useful Post:
Sebazz (29-10-2020)
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[Dev]XTool Razor12911 Conversion Tutorials 180 23-10-2020 06:26
Project Cars Digital Edition (3xDVD5) (srep+lzma) GTX590 PC Games - CD/DVD Conversions 10 28-08-2017 08:34
Project IGI Anthology 1xCD700 CIUV2 2039 mausschieber PC Games - CD/DVD Conversions 0 24-07-2017 15:12
Space Channel 5 Part 2 Translation Project Christuserloeser DC Games 0 21-06-2004 18:16



All times are GMT -7. The time now is 09:14.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com