Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #16  
Old 14-07-2019, 03:08
shazzla shazzla is offline
Registered User
 
Join Date: Nov 2010
Location: Hunnia
Posts: 271
Thanks: 501
Thanked 94 Times in 71 Posts
shazzla is on a distinguished road
Did it five times ,as you requested.

Layers of fear 2 - pakchunk2-WindowsNoEditor.pak - OK !
Legacy of the void - data.006 - OK !
X4 Foundations - 05.dat - OK !

Interesting : in all testfiles the last two numbers were the same/file :

05.dat ends : 11372 ,11372.
data.006 : 110507,110507.
pakchunk2-WindowsNoEditor.pak : 34990,34990.
Maybe is it a bug ?!

Thanks for your work !

Last edited by shazzla; 14-07-2019 at 03:12.
Reply With Quote
The Following User Says Thank You to shazzla For This Useful Post:
Razor12911 (14-07-2019)
Sponsored Links
  #17  
Old 14-07-2019, 05:12
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 4,404
Thanks: 1,078
Thanked 7,005 Times in 2,653 Posts
KaktoR is on a distinguished road
Did it aswell with Kingdom Come Deliverance and a few pdf files.

All seems to be the way it should be!
__________________
Haters gonna hate
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
Razor12911 (14-07-2019)
  #18  
Old 14-07-2019, 16:36
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,746
Thanks: 2,141
Thanked 11,095 Times in 2,295 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by shazzla View Post
Did it five times ,as you requested.

Layers of fear 2 - pakchunk2-WindowsNoEditor.pak - OK !
Legacy of the void - data.006 - OK !
X4 Foundations - 05.dat - OK !

Interesting : in all testfiles the last two numbers were the same/file :

05.dat ends : 11372 ,11372.
data.006 : 110507,110507.
pakchunk2-WindowsNoEditor.pak : 34990,34990.
Maybe is it a bug ?!

Thanks for your work !
I actually saw those last repeating numbers, I already fixed the problem after uploading the attachment, it's not really a big deal but thanks for the test.

@everyone
there are more tests to come.
Reply With Quote
The Following 4 Users Say Thank You to Razor12911 For This Useful Post:
ffmla (17-07-2019), Harsh ojha (14-07-2019), shazzla (15-07-2019), ShivShubh (24-11-2019)
  #19  
Old 14-07-2019, 16:41
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 408
Thanks: 138
Thanked 468 Times in 227 Posts
doofoo24 is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
@everyone
there are more tests to come.
lz4,lzo,zstd...
is there any speed improvement in raw2hif_dll/hif2raw_dll, for exmaple xtool is slow on doom/cod ghost ?
Reply With Quote
The Following User Says Thank You to doofoo24 For This Useful Post:
shazzla (15-07-2019)
  #20  
Old 15-07-2019, 17:22
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,746
Thanks: 2,141
Thanked 11,095 Times in 2,295 Posts
Razor12911 is on a distinguished road
well that is the thing, I didn't make those libraries, if they are slow, they are slow nothing I can do unless if you contact the creator here:
https://encode.ru/threads/1399-refla...e-recompressor

as for doom, well I had plans for that game, there will be a plugin that will come with xtool called idtech6.dll or something similar. The plugin is specially designed to work best for games that use that engine (also dishonored 2, doto), handling zlib specifically for them unlike the universal zlib that tries all possible methods to give you the best output, the plugin will know beforehand what to do and how to handle the streams from those games and speed up the process.

xtool.exe e:precomp:t100p:idtech6 - -
is how you will use it, there are several games that if they require a special touch, they will just come separate from xtool in plugin form like dunia, unity and etc, which is why I created a separate thread here because I reckon there is going to be many.

Last edited by Razor12911; 15-07-2019 at 18:51.
Reply With Quote
The Following 9 Users Say Thank You to Razor12911 For This Useful Post:
Andu21 (16-07-2019), dixen (15-07-2019), doofoo24 (15-07-2019), ffmla (17-07-2019), Harsh ojha (15-07-2019), IgorKolesnik (16-07-2019), PsYcHo_RaGE (15-07-2019), shazzla (16-07-2019), ShivShubh (24-11-2019)
  #21  
Old 17-07-2019, 16:19
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,746
Thanks: 2,141
Thanked 11,095 Times in 2,295 Posts
Razor12911 is on a distinguished road
Here's a speed test

prepare two types of inputs, one with deflate streams and one without deflate streams, can be a video file.

drag and drop the test files onto test.bat, there will be a console output, upload those results as test report.

The test is between xtool v012 and the upcoming release.

Note: Your input shouldn't be from the game that use idTech6 engine (DOOM, Dishonored 2 and Death of the Outsider)
Attached Files
File Type: 7z xtool_1907_T2.7z (1.29 MB, 135 views)
Reply With Quote
The Following 6 Users Say Thank You to Razor12911 For This Useful Post:
Andu21 (17-07-2019), GTX590 (26-07-2019), Harsh ojha (20-07-2019), shazzla (18-07-2019), ShivShubh (24-11-2019), Simorq (17-07-2019)
  #22  
Old 17-07-2019, 17:54
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 408
Thanks: 138
Thanked 468 Times in 227 Posts
doofoo24 is on a distinguished road
test on HellbladeSenuasSacrifice (HellbladeGame-WindowsNoEditor.pak)...

Process ID : 5172
Thread ID : 3824
Process Exit Code: 0
Thread Exit Code : 0

User Time : 153.018s
Kernel Time : 28.031s
Process Time : 181.049s
Clock Time : 129.848s

Working Set : 881712 KB
Paged Pool : 109 KB
Nonpaged Pool : 18 KB
Pagefile : 1133300 KB
Page Fault Count : 541119

IO Read : 16928698 KB (in 264520 reads )
IO Write : 26142474 KB (in 3999156 writes)
IO Other : 2 KB (in 130 others)

WOW Super fast 360mb/s with half cpu usage...
Attached Images
File Type: gif 1.gif (28.8 KB, 683 views)

Last edited by doofoo24; 17-07-2019 at 18:09.
Reply With Quote
The Following User Says Thank You to doofoo24 For This Useful Post:
Razor12911 (18-07-2019)
  #23  
Old 17-07-2019, 21:34
Andu21 Andu21 is offline
Registered User
 
Join Date: Feb 2016
Location: Impossible Planet
Posts: 114
Thanks: 179
Thanked 48 Times in 38 Posts
Andu21 is on a distinguished road
Echo

CI_Sc090.mp4

Code:
xtool_new.exe:

Process ID       : 3920
Thread ID        : 2620
Process Exit Code: 0
Thread Exit Code : 0

User Time        :          20.779s
Kernel Time      :           0.265s
Process Time     :          21.044s
Clock Time       :           6.797s

Working Set      :          104788 KB
Paged Pool       :              91 KB
Nonpaged Pool    :               7 KB
Pagefile         :          163964 KB
Page Fault Count : 26277

IO Read          :          354842 KB (in            5548 reads )
IO Write         :          354826 KB (in              46 writes)
IO Other         :               5 KB (in             240 others)

xtool_old.exe:

Process ID       : 4104
Thread ID        : 4888
Process Exit Code: 0
Thread Exit Code : 0

User Time        :          40.856s
Kernel Time      :           0.187s
Process Time     :          41.043s
Clock Time       :          11.781s

Working Set      :          106836 KB
Paged Pool       :              93 KB
Nonpaged Pool    :               7 KB
Pagefile         :          164968 KB
Page Fault Count : 26918

IO Read          :          354843 KB (in            5547 reads )
IO Write         :          354826 KB (in            5545 writes)
IO Other         :               1 KB (in             220 others)
Echo-WindowsNoEditor.pak

Code:
xtool_new.exe:

Process ID       : 4832
Thread ID        : 2644
Process Exit Code: 0
Thread Exit Code : 0

User Time        :         196.046s
Kernel Time      :           3.322s
Process Time     :         199.368s
Clock Time       :         489.965s

Working Set      :          213032 KB
Paged Pool       :              91 KB
Nonpaged Pool    :               9 KB
Pagefile         :          282924 KB
Page Fault Count : 90883

IO Read          :         4233301 KB (in           66149 reads )
IO Write         :         4476621 KB (in          171112 writes)
IO Other         :               6 KB (in             240 others)

xtool_old.exe:

Process ID       : 2736
Thread ID        : 4384
Process Exit Code: 0
Thread Exit Code : 259

User Time        :         376.648s
Kernel Time      :           2.792s
Process Time     :         379.440s
Clock Time       :         464.932s

Working Set      :          214460 KB
Paged Pool       :              93 KB
Nonpaged Pool    :               9 KB
Pagefile         :          287852 KB
Page Fault Count : 100289

IO Read          :         4233303 KB (in           66148 reads )
IO Write         :         4446197 KB (in           69472 writes)
IO Other         :               1 KB (in             232 others)
Reply With Quote
The Following User Says Thank You to Andu21 For This Useful Post:
Razor12911 (18-07-2019)
  #24  
Old 17-07-2019, 22:32
dixen dixen is offline
Registered User
 
Join Date: Sep 2014
Location: Russia
Posts: 394
Thanks: 450
Thanked 433 Times in 199 Posts
dixen is on a distinguished road
bundle_pc.ipk (Rayman Origins)

Quote:
xtool_new.exe:

Process ID : 9272
Thread ID : 1356
Process Exit Code: 0
Thread Exit Code : 0

User Time : 60.453s
Kernel Time : 1.546s
Process Time : 61.999s
Clock Time : 21.767s

Working Set : 448404 KB
Paged Pool : 110 KB
Nonpaged Pool : 11 KB
Pagefile : 540260 KB
Page Fault Count : 211743

IO Read : 2046443 KB (in 31979 reads )
IO Write : 3038292 KB (in 5711 writes)
IO Other : 6 KB (in 202 others)

xtool_old.exe:


Process ID : 1220
Thread ID : 4636
Process Exit Code: 0
Thread Exit Code : 0

User Time : 130.625s
Kernel Time : 2.593s
Process Time : 133.218s
Clock Time : 44.855s

Working Set : 2084988 KB
Paged Pool : 111 KB
Nonpaged Pool : 10 KB
Pagefile : 2291268 KB
Page Fault Count : 1055801

IO Read : 2046448 KB (in 31978 reads )
IO Write : 3038286 KB (in 47474 writes)
IO Other : 3 KB (in 195 others)
Reply With Quote
The Following User Says Thank You to dixen For This Useful Post:
Razor12911 (18-07-2019)
  #25  
Old 18-07-2019, 16:10
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,746
Thanks: 2,141
Thanked 11,095 Times in 2,295 Posts
Razor12911 is on a distinguished road
Thanks for the tests, 95% complete. the new release will first ship with 1 codec (zlib) just to see if everything works as expected
Reply With Quote
The Following 10 Users Say Thank You to Razor12911 For This Useful Post:
Andu21 (19-07-2019), Cesar82 (18-07-2019), dixen (20-07-2019), Harsh ojha (20-07-2019), IgorKolesnik (19-07-2019), KaktoR (19-07-2019), shazzla (19-07-2019), ShivShubh (24-11-2019), Simorq (19-07-2019), ZAZA4EVER (19-07-2019)
  #26  
Old 19-07-2019, 07:49
IgorKolesnik IgorKolesnik is offline
Registered User
 
Join Date: Dec 2018
Location: Kiev
Posts: 31
Thanks: 27
Thanked 7 Times in 6 Posts
IgorKolesnik is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
Thanks for the tests, 95% complete. the new release will first ship with 1 codec (zlib) just to see if everything works as expected
can update game file scaner? thank
Reply With Quote
The Following User Says Thank You to IgorKolesnik For This Useful Post:
oltjon (19-07-2019)
  #27  
Old 20-07-2019, 18:37
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,746
Thanks: 2,141
Thanked 11,095 Times in 2,295 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by IgorKolesnik View Post
can update game file scaner? thank
and add what feature?

@everyone

here's a benchmark

some file from Pro Evolution Soccer

old xtool = 275MB >> 381MB took 11.63 seconds using 4 threads
new xtool = 275MB >> 381MB took 06.09 seconds using 4 threads

same memory usage and I/O

note: I only reworked the encoder to use the cpu effectively so you should expect roughly x1.25-2 more speed from old version while using same resources and this applies to all codecs reflate, oodle and etc

Last edited by Razor12911; 20-07-2019 at 18:40.
Reply With Quote
The Following 9 Users Say Thank You to Razor12911 For This Useful Post:
Andu21 (22-07-2019), dixen (21-07-2019), ffmla (17-06-2020), Harsh ojha (20-07-2019), K4miKaZe (21-07-2019), KaktoR (21-07-2019), shazzla (21-07-2019), ShivShubh (24-11-2019), Simorq (21-07-2019)
  #28  
Old 21-07-2019, 02:35
Simorq's Avatar
Simorq Simorq is offline
Registered User
 
Join Date: Mar 2014
Location: Iran
Posts: 642
Thanks: 3,602
Thanked 1,304 Times in 464 Posts
Simorq is on a distinguished road
Hi Razor12911
Code:
v: skip verification
This option works for oodle, crilayla, lzo.
Please do not delete this option in the new version.
Reply With Quote
  #29  
Old 21-07-2019, 03:10
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 4,404
Thanks: 1,078
Thanked 7,005 Times in 2,653 Posts
KaktoR is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
and add what feature?
Just fix the hang bug
Quote:
Originally Posted by Razor12911 View Post
@everyone

here's a benchmark

some file from Pro Evolution Soccer

old xtool = 275MB >> 381MB took 11.63 seconds using 4 threads
new xtool = 275MB >> 381MB took 06.09 seconds using 4 threads

same memory usage and I/O

note: I only reworked the encoder to use the cpu effectively so you should expect roughly x1.25-2 more speed from old version while using same resources and this applies to all codecs reflate, oodle and etc
This is great.
__________________
Haters gonna hate
Reply With Quote
  #30  
Old 21-07-2019, 05:43
dixen dixen is offline
Registered User
 
Join Date: Sep 2014
Location: Russia
Posts: 394
Thanks: 450
Thanked 433 Times in 199 Posts
dixen is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
and add what feature?
oodle detect, for example
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[Dev]XTool Razor12911 Conversion Tutorials 180 23-10-2020 07:26
Project Cars Digital Edition (3xDVD5) (srep+lzma) GTX590 PC Games - CD/DVD Conversions 10 28-08-2017 09:34
Project IGI Anthology 1xCD700 CIUV2 2039 mausschieber PC Games - CD/DVD Conversions 0 24-07-2017 16:12
Space Channel 5 Part 2 Translation Project Christuserloeser DC Games 0 21-06-2004 19:16



All times are GMT -7. The time now is 05:07.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com