Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #16  
Old 29-05-2020, 11:36
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 527
Thanks: 113
Thanked 752 Times in 294 Posts
panker1992 is on a distinguished road
Sorry to revive this graved topic from the afterlife.

I have briefly some questions as i am trying to get into lz4 for the " i dont know i lost count " time.

you give some tools above a story and an explanation.

1) how to use the script to Import the files back in?? the files are decompressed and they will give error.
Q)Where does it say how to import them and with what parameters ?

2) How do you zero out the entire space of the files you are willing to remove? for example sound.
Q)Castlevania is mixed with sounds and they are wav/ogg files and they take up alot of space? i only want to zero out those and then reimport them but your script gives error.
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
Sponsored Links
  #17  
Old 05-07-2020, 13:46
elit elit is offline
Registered User
 
Join Date: Jun 2017
Location: sun
Posts: 224
Thanks: 163
Thanked 287 Times in 99 Posts
elit is on a distinguished road
Panker, I simply wrote bat script:
recode_RotBP.zip


As for null, either with quickbms -Z or rawinjector I made. You have to figure things the rest for yourself, it was a long time.
Reply With Quote
  #18  
Old 08-07-2020, 12:54
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 527
Thanks: 113
Thanked 752 Times in 294 Posts
panker1992 is on a distinguished road
Thanks for giving guidance !

I have posted several youtube videos on very advanced compressing and analyzing data

sorry to bother this old grave of a post, let it rest in peace
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
  #19  
Old 03-08-2021, 20:34
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 229
Thanks: 79
Thanked 20 Times in 16 Posts
L33THAK0R is on a distinguished road
Ah fuck I didn't realise LZ4 was such a bitch, also on what Razor said about Z/XTool LZ4 support not being designed to be universal that explains a lot of my troubles with the codec. I've been trying to pack "Demon's Souls" (contains LZ4 streams) and was wondering why Z/XTool wouldn't work with it, I guess this is the reason why.
Reply With Quote
  #20  
Old 04-08-2021, 11:20
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 527
Thanks: 113
Thanked 752 Times in 294 Posts
panker1992 is on a distinguished road
Last time i checked demon souls isnt out for pc yet !!!

are you telling me you have a secre that it may come out ?
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
  #21  
Old 04-08-2021, 11:53
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,557
Thanks: 935
Thanked 5,802 Times in 2,143 Posts
KaktoR is on a distinguished road
@panker
https://fileforums.com/showpost.php?...&postcount=396
__________________
Haters gonna hate
Reply With Quote
  #22  
Old 04-08-2021, 13:46
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 527
Thanks: 113
Thanked 752 Times in 294 Posts
panker1992 is on a distinguished road
if it's possible i want sample data of lz4 streams

i think it's possible
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
  #23  
Old 04-08-2021, 17:37
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 229
Thanks: 79
Thanked 20 Times in 16 Posts
L33THAK0R is on a distinguished road
Quote:
Originally Posted by panker1992 View Post
Last time i checked demon souls isnt out for pc yet !!!

are you telling me you have a secre that it may come out ?
@panker1992, sorry I should have clarified. I'm currently repacking console exclusives, as I've figured out how to pack some trickier microsoft/sony container-types, and have been getting good ratios. Although Xenia (Xbox 360 emulator) progress is slow, RPCS3 (PS3 emulator) development has had a decent uptick in progress. "Demon's Souls" for the PS3 (not PS5) contains LZ4 streams, however this is based entirely off of investigating the methods used in 2 repacks of the title (A Darack team-member, & Gnarly), the former of which is currently offline due to personal issues, and the latter being unable to recall their methodology. I currently can't say which files (of which there are ~6000) contain the LZ4 streams, as the GFS tool is unable to detect any.

I'm also not sure how to identify if LZ4 compression was used, like how the Authors other project ZSTD can be, by examining the first 4 bytes in a hex editor.
Reply With Quote
  #24  
Old 05-08-2021, 08:30
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 731
Thanks: 160
Thanked 764 Times in 382 Posts
Masquerade is on a distinguished road
LZ4 can be used without header info. This also confused me at first. I'm out of country currently, but I definitely intend to do some more research when I get back.

Btw you could encounter problems analysing the data since desktop PCs are little endian whereas the PS3 had a CPU made by PowerPC which is big endian iirc.
Reply With Quote
  #25  
Old 05-08-2021, 10:35
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 229
Thanks: 79
Thanked 20 Times in 16 Posts
L33THAK0R is on a distinguished road
Quote:
Originally Posted by Masquerade View Post
LZ4 can be used without header info.
This is both fascinating and slightly depressing, just when I think I'm starting to understand the basics of these algorithms, I realise I'm yet to even scratch the surface.

Quote:
Originally Posted by Masquerade View Post
Btw you could encounter problems analysing the data since desktop PCs are little endian whereas the PS3 had a CPU made by PowerPC which is big endian iirc.
Damn I hadn't considered the architecture differences. I suppose though it shouldn't be too hard to determine if a mainstream compression algorithim is being used, through trial and error, should a universal methodology for LZ4 pre-compression be developed (which from the sounds of things would be no easy feat).

Last edited by L33THAK0R; 05-08-2021 at 10:38. Reason: brain went full munted murphy mode
Reply With Quote
  #26  
Old 05-08-2021, 12:49
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 731
Thanks: 160
Thanked 764 Times in 382 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by L33THAK0R View Post
I realise I'm yet to even scratch the surface.
Welcome to the party.
Reply With Quote
  #27  
Old 06-08-2021, 17:35
FitGirl FitGirl is offline
Registered User
 
Join Date: Dec 2014
Location: Riga
Posts: 189
Thanks: 16
Thanked 227 Times in 122 Posts
FitGirl is on a distinguished road
LZ4 has been released only in 2011, it could not exist in Demon's Souls. If any LZ algo is used in there - it's something custom, like LZSS, Japanese devs love it.
Reply With Quote
  #28  
Old 06-08-2021, 19:18
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 229
Thanks: 79
Thanked 20 Times in 16 Posts
L33THAK0R is on a distinguished road
Quote:
Originally Posted by FitGirl View Post
LZ4 has been released only in 2011, it could not exist in Demon's Souls. If any LZ algo is used in there - it's something custom, like LZSS, Japanese devs love it.
Rats! I hadn't considered that, that begs the question how ztool was used in the repacks I mentioned to be able to pack these streams. It'll definitely be interesting to see if anyones able to figure this one out, but given how niche this hobby is, and more niche still with console game-data compression, I think this might just remain a mystery for a while longer!
Reply With Quote
  #29  
Old 07-08-2021, 00:01
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 731
Thanks: 160
Thanked 764 Times in 382 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by L33THAK0R View Post
Rats! I hadn't considered that, that begs the question how ztool was used in the repacks I mentioned to be able to pack these streams. It'll definitely be interesting to see if anyones able to figure this one out, but given how niche this hobby is, and more niche still with console game-data compression, I think this might just remain a mystery for a while longer!
Well if you can see what plugin was used for ZTool, that might help you.
Reply With Quote
  #30  
Old 07-08-2021, 01:50
L33THAK0R's Avatar
L33THAK0R L33THAK0R is offline
Registered User
 
Join Date: Feb 2021
Location: Saudi Arabia
Posts: 229
Thanks: 79
Thanked 20 Times in 16 Posts
L33THAK0R is on a distinguished road
Quote:
Originally Posted by Masquerade View Post
Well if you can see what plugin was used for ZTool, that might help you.
All I was able to gather from the installer and testing the archives was that, at least for Gnarys repack of the title, "plz4" was used. I haven't been able to look at the Darack teams repack of it as no mirrors of it exist currently, but I theorise a similar method was used.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Ultimate Conversion Compressor (UCC) vollachr Conversion Tutorials 55 26-04-2021 09:27
PSX Modchip FAQ Ne0 PSX Games 1 07-08-2009 08:18
QUERY: editing CloneCD images & best for game data & music CDs andwan0 CD/DVD Software & Utilities 2 18-05-2009 18:13
CD/DVD Data Recovery 123walter CD/DVD Software & Utilities 1 05-08-2005 21:53
99min CD-R's, my great experience w/Audio & Data abbadon CD/DVD Recordable Media 10 15-05-2002 23:16



All times are GMT -7. The time now is 07:51.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com