Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #3151  
Old 19-09-2022, 22:24
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 310
Thanks: 106
Thanked 38 Times in 31 Posts
L33THAK0R is on a distinguished road
I'm very new to lzo1x pre-compression, could anyone explain why XTool in this example is able to detect some streams but not able to process any? I've tried levels 1 - 10 and the same amount of streams are detected but none are able to be processed

Code:
Creating Archive Please Wait...

FreeArc 0.67 (March 15 2014) updating archive: Data.arc
Compressing 1 file, 38,255,712 bytes. Processed   0%
Compressing 38,255,712 bytes with "C:\Compressor_Resources\XTool_2020\xtool_0.6.5\XTool.exe" precomp -mlzo1x:l6 -c512mb -t95p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
XTool is created by Razor12911

Streams: 0/2854
Time: 00:00:01 (00:00:03)
Memory: 128 MB (128 MB)

100%
Errorlevel=0
Compressed 1 file, 38,255,712 => 38,255,982 bytes. Ratio 100.00%
Compression time: cpu 0.05 sec/real 1.63 sec = 3%. Speed 23.44 mB/s
All OK

All done.
The algorithm used is definitely lzo1x, and creating a database with bms2xtl detects an additional ~5000 streams but alas none are detected. I've also not been able to find many other lzo libraries to test with so if its a library issue, if anyone could point me in the direction to look for others it'd be greatly appreciated.
Reply With Quote
Sponsored Links
  #3152  
Old 20-09-2022, 00:29
Lord.Freddy's Avatar
Lord.Freddy Lord.Freddy is offline
Registered User
 
Join Date: Apr 2022
Location: In Forest
Posts: 20
Thanks: 33
Thanked 13 Times in 9 Posts
Lord.Freddy is on a distinguished road
Quote:
Originally Posted by L33THAK0R View Post
I'm very new to lzo1x pre-compression, could anyone explain why XTool in this example is able to detect some streams but not able to process any? I've tried levels 1 - 10 and the same amount of streams are detected but none are able to be processed

Code:
Creating Archive Please Wait...

FreeArc 0.67 (March 15 2014) updating archive: Data.arc
Compressing 1 file, 38,255,712 bytes. Processed   0%
Compressing 38,255,712 bytes with "C:\Compressor_Resources\XTool_2020\xtool_0.6.5\XTool.exe" precomp -mlzo1x:l6 -c512mb -t95p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
XTool is created by Razor12911

Streams: 0/2854
Time: 00:00:01 (00:00:03)
Memory: 128 MB (128 MB)

100%
Errorlevel=0
Compressed 1 file, 38,255,712 => 38,255,982 bytes. Ratio 100.00%
Compression time: cpu 0.05 sec/real 1.63 sec = 3%. Speed 23.44 mB/s
All OK

All done.
The algorithm used is definitely lzo1x, and creating a database with bms2xtl detects an additional ~5000 streams but alas none are detected. I've also not been able to find many other lzo libraries to test with so if its a library issue, if anyone could point me in the direction to look for others it'd be greatly appreciated.
maybe you need to remove the level option, sometimes it works.
__________________
¤ Life good be a Dream ¤

Last edited by Lord.Freddy; 20-09-2022 at 00:36.
Reply With Quote
  #3153  
Old 20-09-2022, 01:10
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 310
Thanks: 106
Thanked 38 Times in 31 Posts
L33THAK0R is on a distinguished road
Quote:
Originally Posted by Lord.Freddy View Post
maybe you need to remove the level option, sometimes it works.
Unfortunately seems like some data actually got stripped away doing that, resulted in a 99.51% ratio
Reply With Quote
  #3154  
Old 20-09-2022, 09:01
Edison007's Avatar
Edison007 Edison007 is offline
Registered User
 
Join Date: Mar 2014
Location: Solar System - Planet Earth
Posts: 30
Thanks: 0
Thanked 56 Times in 19 Posts
Edison007 is on a distinguished road
Quote:
Originally Posted by L33THAK0R View Post
I'm very new to lzo1x pre-compression, could anyone explain why XTool in this example is able to detect some streams but not able to process any? I've tried levels 1 - 10 and the same amount of streams are detected but none are able to be processed

Code:
Creating Archive Please Wait...

FreeArc 0.67 (March 15 2014) updating archive: Data.arc
Compressing 1 file, 38,255,712 bytes. Processed   0%
Compressing 38,255,712 bytes with "C:\Compressor_Resources\XTool_2020\xtool_0.6.5\XTool.exe" precomp -mlzo1x:l6 -c512mb -t95p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
XTool is created by Razor12911

Streams: 0/2854
Time: 00:00:01 (00:00:03)
Memory: 128 MB (128 MB)

100%
Errorlevel=0
Compressed 1 file, 38,255,712 => 38,255,982 bytes. Ratio 100.00%
Compression time: cpu 0.05 sec/real 1.63 sec = 3%. Speed 23.44 mB/s
All OK

All done.
The algorithm used is definitely lzo1x, and creating a database with bms2xtl detects an additional ~5000 streams but alas none are detected. I've also not been able to find many other lzo libraries to test with so if its a library issue, if anyone could point me in the direction to look for others it'd be greatly appreciated.
Maybe used pro-functions. Upload example file for testing
Reply With Quote
The Following User Says Thank You to Edison007 For This Useful Post:
L33THAK0R (21-09-2022)
  #3155  
Old 21-09-2022, 04:35
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 310
Thanks: 106
Thanked 38 Times in 31 Posts
L33THAK0R is on a distinguished road
Quote:
Originally Posted by Edison007 View Post
Maybe used pro-functions. Upload example file for testing
Thanks for offering to have a looksie, really appreciate any insight you can offer, also in case its of any interest I've also got an LZ4 sample I've been having similar issues with, tried about a dozen libraries but no dice so far, xtool (0.6.5) is also detecting streams but unable to pick any up unfortunately.
Attached Files
File Type: rar lz4_sample.rar (21.94 MB, 18 views)
File Type: rar lzo_sample.rar (28.93 MB, 13 views)

Last edited by L33THAK0R; 21-09-2022 at 04:48.
Reply With Quote
  #3156  
Old 21-09-2022, 05:09
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,867
Thanks: 1,009
Thanked 6,317 Times in 2,340 Posts
KaktoR is on a distinguished road
For your lz4 sample you have to use lz4f with level 2 and pick the right lz4 library

Code:
Compressed 1 file, 32,882,867 => 158,560,939 bytes. Ratio 482.20%
Compression time: cpu 0.08 sec/real 1.18 sec = 7%. Speed 27.85 mB/s
All OK
You have to look which level produces the closest recompressed size to the original size



However in a quick test there are still some streams left behind.
__________________
Haters gonna hate

Last edited by KaktoR; 21-09-2022 at 05:12.
Reply With Quote
  #3157  
Old 21-09-2022, 08:38
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 310
Thanks: 106
Thanked 38 Times in 31 Posts
L33THAK0R is on a distinguished road
Quote:
Originally Posted by KaktoR View Post
For your lz4 sample you have to use lz4f with level 2 and pick the right lz4 library

Code:
Compressed 1 file, 32,882,867 => 158,560,939 bytes. Ratio 482.20%
Compression time: cpu 0.08 sec/real 1.18 sec = 7%. Speed 27.85 mB/s
All OK
You have to look which level produces the closest recompressed size to the original size



However in a quick test there are still some streams left behind.
Ah didnt realise I had to specify lz4f, many thanks, also what tool are you using to get that console output if you dont mind me asking?
Reply With Quote
  #3158  
Old 21-09-2022, 09:04
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,867
Thanks: 1,009
Thanked 6,317 Times in 2,340 Posts
KaktoR is on a distinguished road
--verbose mode from xtool
__________________
Haters gonna hate
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
L33THAK0R (21-09-2022)
  #3159  
Old 21-09-2022, 09:38
Edison007's Avatar
Edison007 Edison007 is offline
Registered User
 
Join Date: Mar 2014
Location: Solar System - Planet Earth
Posts: 30
Thanks: 0
Thanked 56 Times in 19 Posts
Edison007 is on a distinguished road
Quote:
lzo_sample.rar
The old function LZO1X-1 was used. You can use these libraries. But not all streams are successfully recompressed, because lzo-detect in xtool is't ideal.
Attached Files
File Type: 7z lzo_libs_for_xtool.7z (20.7 KB, 17 views)
Reply With Quote
The Following 4 Users Say Thank You to Edison007 For This Useful Post:
Gehrman (21-09-2022), L33THAK0R (21-09-2022), Masquerade (21-09-2022), ScOOt3r (21-09-2022)
  #3160  
Old 21-09-2022, 11:48
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 310
Thanks: 106
Thanked 38 Times in 31 Posts
L33THAK0R is on a distinguished road
Thumbs up

Quote:
Originally Posted by Edison007 View Post
The old function LZO1X-1 was used. You can use these libraries. But not all streams are successfully recompressed, because lzo-detect in xtool is't ideal.
Just ran a quick test, this works wonderfully, thanks so much! I've had this sitting on the back-burner for months, it's very satisfying to have it finally sorted!
Reply With Quote
  #3161  
Old 23-09-2022, 02:34
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 310
Thanks: 106
Thanked 38 Times in 31 Posts
L33THAK0R is on a distinguished road
Does anyone know if theres a way to bulk apply/insert a hexadecimal pattern into a given chunk of data if given a start and end offset? I've got some projects I'm working on that require a few hundred blanking/0-filling operations and its awfully slow to do so with HxD's GUI. I've gone through the SFK documentation a half dozen times and alas to no avail. My current solution is just to have a massive blank file and drawn on the given offsets from it but this is obviously not very practical and is a pain having to increase its size should I be attempting to patch out a chunk from a larger archive in the future.
Reply With Quote
  #3162  
Old 23-09-2022, 02:43
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,867
Thanks: 1,009
Thanked 6,317 Times in 2,340 Posts
KaktoR is on a distinguished road
Try with xtool's erase/replace command
__________________
Haters gonna hate
Reply With Quote
  #3163  
Old 23-09-2022, 05:34
dixen dixen is offline
Registered User
 
Join Date: Sep 2014
Location: Russia
Posts: 341
Thanks: 397
Thanked 387 Times in 180 Posts
dixen is on a distinguished road
Pathfinder: Kingmaker (GOG Version) [New repack]

Bundle Folder (excluded manifest files)
XTool v0.65 (unity+lz4 plugin v1.75)+srep+lolz
21 gb > 50 gb > 25 gb > 7.2 gb

Sound files (*.wem & *.bnk)
srep+lzma2
3.2 gb > 2.6 gb

*.assets *.resS & extensionless files
srep+lolz
13.4 gb > 2.8 gb

Rest files
400 mb > 65 mb

Repack's size - 12.7 gb
Install time - 29 min. (R5 3600)
Reply With Quote
The Following User Says Thank You to dixen For This Useful Post:
JustFun (06-10-2022)
  #3164  
Old 24-09-2022, 10:44
shazzla shazzla is offline
Registered User
 
Join Date: Nov 2010
Location: Hunnia
Posts: 242
Thanks: 443
Thanked 90 Times in 67 Posts
shazzla is on a distinguished road
Quote:
Originally Posted by L33THAK0R View Post
Ah didnt realise I had to specify lz4f, many thanks, also what tool are you using to get that console output if you dont mind me asking?
Hi Kaktor and everybody !

What is this tool in the screenshot ? And what parameter was used?
Im out nearly 2 years from repacking!
Btw anyone can share me an lz4 library collection for xtool?
Many thanks!
Reply With Quote
  #3165  
Old 24-09-2022, 10:51
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,867
Thanks: 1,009
Thanked 6,317 Times in 2,340 Posts
KaktoR is on a distinguished road
Quote:
Originally Posted by shazzla View Post
Hi Kaktor and everybody !

What is this tool in the screenshot ? And what parameter was used?
Im out nearly 2 years from repacking!
Btw anyone can share me an lz4 library collection for xtool?
Many thanks!
xtool --verbose mode

Attached file contains some lz4 libraries
Attached Files
File Type: 7z LZ4_Libs.7z (904.9 KB, 5 views)
__________________
Haters gonna hate
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
shazzla (25-09-2022)
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Games Are For Kids JoyBoy Chit Chat 83 16-11-2021 15:28
CorePack Compression methods ? Help ramazan19833 Conversion Tutorials 34 09-08-2018 07:51
i got the email in the mail about copying ps2 games EVOEvo PS2 Games 7 21-11-2003 08:56
Self-booting games on an older Japanese DC? Named DC Games 1 26-09-2003 18:48
Having Problems Burning Numerous *Recent* Games....Help is Appreciated Protosstic PSX Games 2 15-01-2002 22:27



All times are GMT -7. The time now is 13:28.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com