Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #541  
Old 07-08-2022, 15:14
dixen dixen is offline
Registered User
 
Join Date: Sep 2014
Location: Russia
Posts: 341
Thanks: 397
Thanked 387 Times in 180 Posts
dixen is on a distinguished road
Quote:
Originally Posted by KaktoR View Post
Did they change compression? I'm sure in some older version of this game they used just zlib or sort of if I remember correctly.
No changes. ZLIB only in 2 *.pak files. RPACK is no compression
Reply With Quote
Sponsored Links
  #542  
Old 26-08-2022, 07:21
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 534
Thanks: 113
Thanked 757 Times in 296 Posts
panker1992 is on a distinguished road
External Codec Error

Hello, it's been ages since i had an error !!

This Came directly from Xtool documentation
Xtool version used 6.2

this is my wav.ini
[Stream1]
Name=wav
Codec=wavpack
BigEndian=0
Signature=0x46464952
Structure=Signature(4),FileSize(4),FileType(4),Str eam
StreamOffset=-12
CompressedSize=FileSize + 8
DecompressedSize=0
Condition1=FileType = 0x45564157
Condition2=FileSize >= 4096

this is my xtool.ini
[wavpack]
Encode=wavpack.exe -hh -x4 <filein>.wav <fileout>.wv
Decode=wvunpack.exe <filein>.wv <fileout>.wav

i have been unable to make this even detect the sample FLAC internal codec works and so any other
NOTE: i use this as standalone and not in FA for testing purposes
Attached Files
File Type: 7z sample.7z (19.81 MB, 10 views)
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
  #543  
Old 26-08-2022, 08:52
Edison007's Avatar
Edison007 Edison007 is offline
Registered User
 
Join Date: Mar 2014
Location: Solar System - Planet Earth
Posts: 30
Thanks: 0
Thanked 56 Times in 19 Posts
Edison007 is on a distinguished road
xtool.ini:

[wavpack]
Encode=wavpack.exe -hh -x4 <filein> <fileout>
Decode=wvunpack.exe <filein> <fileout>

or

[wavpack]
Encode=wavpack.exe -hh -x4 - - <stdin> <stdout>
Decode=wvunpack.exe - - <stdin> <stdout>
Reply With Quote
The Following 2 Users Say Thank You to Edison007 For This Useful Post:
Gehrman (23-12-2022), Guravkov2010 (26-08-2022)
  #544  
Old 26-08-2022, 09:26
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 534
Thanks: 113
Thanked 757 Times in 296 Posts
panker1992 is on a distinguished road
Quote:
Originally Posted by Edison007 View Post
xtool.ini:

[wavpack]
Encode=wavpack.exe -hh -x4 <filein> <fileout>
Decode=wvunpack.exe <filein> <fileout>

or

[wavpack]
Encode=wavpack.exe -hh -x4 - - <stdin> <stdout>
Decode=wvunpack.exe - - <stdin> <stdout>
i Spoke with Zee

it's a bug confirmed, it's been fixed already
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
  #545  
Old 05-09-2022, 03:16
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,680
Thanks: 2,088
Thanked 10,657 Times in 2,238 Posts
Razor12911 is on a distinguished road
Update available

Changes

- added universal lz4f scanner
- fixed issues with database feature
- fixed issues with executable plugin support
- updated lzo codecs
Reply With Quote
The Following 9 Users Say Thank You to Razor12911 For This Useful Post:
BKR-TN (05-09-2022), Gehrman (05-09-2022), hdneo (05-09-2022), KaktoR (05-09-2022), kuyhaa (06-09-2022), Masquerade (05-09-2022), Pantsi (05-09-2022), ScOOt3r (05-09-2022), Wanterlude (06-09-2022)
  #546  
Old 06-09-2022, 05:55
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,680
Thanks: 2,088
Thanked 10,657 Times in 2,238 Posts
Razor12911 is on a distinguished road
Update available

Changes

- fixed issues with lzo2a and lzo1c codecs
Reply With Quote
The Following 4 Users Say Thank You to Razor12911 For This Useful Post:
dixen (06-09-2022), Gehrman (06-09-2022), ScOOt3r (06-09-2022), Wanterlude (06-09-2022)
  #547  
Old 06-09-2022, 06:26
dixen dixen is offline
Registered User
 
Join Date: Sep 2014
Location: Russia
Posts: 341
Thanks: 397
Thanked 387 Times in 180 Posts
dixen is on a distinguished road
XTool v 0.6.4

Code:
[0] Processed lzo2a stream at 00000000199339FB (6669 >> 32768 >> 6669) using v999 successfully
[0] Processed lzo2a stream at 000000001993540C (6953 >> 32768 >> 6953) using v999 successfully
[0] Processed lzo2a stream at 0000000019936F39 (6965 >> 32768 >> 6965) using v999 successfully
[0] Processed lzo2a stream at 0000000019938A72 (7049 >> 32768 >> 7049) using v999 successfully
[0] Processed lzo2a stream at 000000001993A5FF (7357 >> 32768 >> 7357) using v999 successfully
[0] Processed lzo2a stream at 000000001993C2C0 (6483 >> 32768 >> 6483) using v999 successfully
[0] Processed lzo2a stream at 000000001993DC17 (6438 >> 32768 >> 6438) using v999 successfully
[0] Processed lzo2a stream at 000000001993F541 (7049 >> 32768 >> 7049) using v999 successfully
[0] Processed lzo2a stream at 00000000199410CE (10483 >> 32768 >> 10483) using v999 successfully
[0] Processed lzo2a stream at 00000000199439C5 (9063 >> 32768 >> 9063) using v999 successfully
[0] Processed lzo2a stream at 0000000019945D30 (11212 >> 32768 >> 11212) using v999 successfully
[0] Processed lzo2a stream at 0000000019948900 (13262 >> 32768 >> 13262) using v999 successfully
[0] Processed lzo2a stream at 000000001994BCD2 (19921 >> 32768 >> 19921) using v999 successfully
[0] Processed lzo2a stream at 0000000019950AA7 (14134 >> 32768 >> 14134) using v999 successfully
[0] Processed lzo2a stream at 00000000199541E1 (15579 >> 26778 >> 15579) using v999 successfully

Streams: 22550/22550
Time: 00:00:41 (00:00:38)
Memory: 264 MB (264 MB)


Errorlevel=0

Compressed 1 file, 429,260,800 => 829,963,641 bytes. Ratio 193.35%
Compression time: cpu 0.33 sec/real 42.34 sec = 1%. Speed 10.14 mB/s
All OK
Reply With Quote
The Following 5 Users Say Thank You to dixen For This Useful Post:
Gehrman (06-09-2022), L0v3craft (06-09-2022), Razor12911 (09-09-2022), ScOOt3r (06-09-2022), Wanterlude (06-09-2022)
  #548  
Old 09-09-2022, 01:19
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,680
Thanks: 2,088
Thanked 10,657 Times in 2,238 Posts
Razor12911 is on a distinguished road
Update available

Changes

- updated oodle scanner
- remove xdelta support from oodle and lzo codecs (crc mismatch often generates large diff files)

Notes

I've been getting reports of xtool taking a long time to process oodle streams (or getting stuck) so I reworked the scanner. I reverse engineered the code of oo2rec (I lost the source code) and rewrote parts of the code so xtool should produce better results while being faster.

There is a parameter rework as well, some people may know of the "n#" parameter which when set increases the chances of xtool capturing a stream. The default value now is 32, can be increased to 64, 128... Up to you, there is no limit just keep in mind that increasing this value also means longer precompression times.

Results on DOOM Eternal's "gameresources_4_1.streamdb"

oo2reck
Code:
Compressed 1 file, 1,353,405,353 => 2,584,084,262 bytes. Ratio 190.93%
Compression time: cpu 1.86 sec/real 590.20 sec = 0%. Speed 2.29 mB/s
xtool 0.4.7-0.6.4
Rumour has it that it's still processing as we speak (stuck on 5.7%)

xtool 0.6.5 (-mkraken:l6:n128)
Code:
Compressed 1 file, 1,353,405,353 => 2,589,860,614 bytes. Ratio 191.36%
Compression time: cpu 1.80 sec/real 370.32 sec = 0%. Speed 3.65 mB/s
Reply With Quote
The Following 11 Users Say Thank You to Razor12911 For This Useful Post:
BKR-TN (10-09-2022), Cesar82 (09-09-2022), elit (24-09-2022), Gehrman (09-09-2022), KaktoR (09-09-2022), L33THAK0R (09-09-2022), Lord.Freddy (09-09-2022), Masquerade (09-09-2022), ScOOt3r (09-09-2022), shazzla (10-09-2022), Wanterlude (09-09-2022)
  #549  
Old 10-09-2022, 04:29
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 534
Thanks: 113
Thanked 757 Times in 296 Posts
panker1992 is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
Update available

Changes

- updated oodle scanner
- remove xdelta support from oodle and lzo codecs (crc mismatch often generates large diff files)

Notes

I've been getting reports of xtool taking a long time to process oodle streams (or getting stuck) so I reworked the scanner. I reverse engineered the code of oo2rec (I lost the source code) and rewrote parts of the code so xtool should produce better results while being faster.

There is a parameter rework as well, some people may know of the "n#" parameter which when set increases the chances of xtool capturing a stream. The default value now is 32, can be increased to 64, 128... Up to you, there is no limit just keep in mind that increasing this value also means longer precompression times.

Results on DOOM Eternal's "gameresources_4_1.streamdb"

oo2reck
Code:
Compressed 1 file, 1,353,405,353 => 2,584,084,262 bytes. Ratio 190.93%
Compression time: cpu 1.86 sec/real 590.20 sec = 0%. Speed 2.29 mB/s
xtool 0.4.7-0.6.4
Rumour has it that it's still processing as we speak (stuck on 5.7%)

xtool 0.6.5 (-mkraken:l6:n128)
Code:
Compressed 1 file, 1,353,405,353 => 2,589,860,614 bytes. Ratio 191.36%
Compression time: cpu 1.80 sec/real 370.32 sec = 0%. Speed 3.65 mB/s

it's fixed :P , adding one big file and all libraries inside along with all versions of xtool isnt a good idea
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
  #550  
Old 15-09-2022, 09:07
kuyhaa kuyhaa is offline
Registered User
 
Join Date: Jun 2019
Location: metro
Posts: 35
Thanks: 42
Thanked 1 Time in 1 Post
kuyhaa is on a distinguished road
confiused . .

xt 065 , ( same result with other version )

Reply With Quote
  #551  
Old 28-09-2022, 11:20
shazzla shazzla is offline
Registered User
 
Join Date: Nov 2010
Location: Hunnia
Posts: 244
Thanks: 443
Thanked 90 Times in 67 Posts
shazzla is on a distinguished road
Hi guys!

I need a little help....
Something is wrong here. Tried to precomp a file with deduplication ,but XTool 0.6.5 doesnt make it. It looks like it ignores the corresponding parameter,even .bin file not created! V0.3.1 works fine!
What am i do wrong?


[External compressor:x065-dedup]
header = 0
packcmd = xtool065\xtool.exe precomp -mzlib -c32mb -t100p --dbase --dedup=chor065.bin - - <stdin> <stdout>

[External compressor:x065-nodedup]
header = 0
packcmd = xtool065\xtool.exe precomp -mzlib -c32mb -t100p - - <stdin> <stdout>

[External compressor:x031-dedup]
header = 0
packcmd = xtool031\xtool.exe precomp -mzlib -c32mb -t100p --dbase --dedup=chor031.bin - - <stdin> <stdout>

[External compressor:x031-nodedup]
header = 0
packcmd = xtool031\xtool.exe precomp -mzlib -c32mb -t100p - - <stdin> <stdout>

Results :

Xtool 0.3.1 ,deduplicated : 40.2 GB
Xtool 0.3.1 ,not deduplicated : 42.9 GB

Xtool 0.6.5 ,deduplicated : 42.9 GB
Xtool 0.6.5 ,not deduplicated : 42.9 GB

All processes finished without error. V0.6.5 is the "pure" version ,directly from Zee's ZIP-file...

Btw where to insert --verbose command?
Only one place is accepted in my experiments ,but no verbose infos are displayed...
Reply With Quote
  #552  
Old 28-09-2022, 11:30
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 927
Thanks: 241
Thanked 1,036 Times in 489 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by shazzla View Post
Btw where to insert --verbose command?
Only one place is accepted in my experiments ,but no verbose infos are displayed...
Only use --verbose for testing. It limits XTool to 1 chunk processed at once. Add it before input / output. You shouldn't combine stdin/stdout with --verbose, use $$arcdatafile$$.tmp/$$arcpackedfile$$.tmp instead.
Reply With Quote
The Following User Says Thank You to Masquerade For This Useful Post:
shazzla (28-09-2022)
  #553  
Old 28-09-2022, 11:55
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,868
Thanks: 1,009
Thanked 6,317 Times in 2,340 Posts
KaktoR is on a distinguished road
You can make a batch file near xtool.exe and drag&drop a file onto it. This way you don't use freearc for it.

Example
Code:
@echo off
cd /D "%~dp0"
xtool.exe precomp -mzlib -c16mb -t100p --verbose - - < %1 > %1.out
pause
__________________
Haters gonna hate
Reply With Quote
The Following 2 Users Say Thank You to KaktoR For This Useful Post:
shazzla (28-09-2022), Wanterlude (28-09-2022)
  #554  
Old 03-10-2022, 10:29
shazzla shazzla is offline
Registered User
 
Join Date: Nov 2010
Location: Hunnia
Posts: 244
Thanks: 443
Thanked 90 Times in 67 Posts
shazzla is on a distinguished road
Nobody ?

Found. Damn...
Parameters were changed...

Last edited by shazzla; 09-10-2022 at 12:49.
Reply With Quote
  #555  
Old 14-10-2022, 09:18
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 313
Thanks: 106
Thanked 39 Times in 31 Posts
L33THAK0R is on a distinguished road
Quick question, or I guess just asking for some clarification, in regards to "bms2xtl", can you only process a given file with your generated database, if the codec is one that xtool supports? So for example xtool wouldn't be able to process a COMTYPE if it isn't deflate, lz4(hc/x/f)... etc.? I guess what I'm asking in essence is am I correct in saying external, quickbms-native COMTYPEs aren't supported.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[Dev]XTool Razor12911 Conversion Tutorials 180 23-10-2020 07:26
Project Cars Digital Edition (3xDVD5) (srep+lzma) GTX590 PC Games - CD/DVD Conversions 10 28-08-2017 09:34
Project IGI Anthology 1xCD700 CIUV2 2039 mausschieber PC Games - CD/DVD Conversions 0 24-07-2017 16:12
Space Channel 5 Part 2 Translation Project Christuserloeser DC Games 0 21-06-2004 19:16



All times are GMT -7. The time now is 20:25.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com