LZO precompressor (Side project)

[Razor12911]

Hi again guys, here's another procompressor for another algorithm.

Things you should know:
* This thing does not detect every single stream in the game, like specific precompressors like DELZORec when dealing with game titles like Far Cry 3 and 4.
* It's slow af from my opinion but it's first release, probably a few releases down the line, it can be made faster.
* It can be buggy, had problems setting it up, it wasn't like oodle and zstd, for now. I have no idea what causes certain bugs because firstly, I lack samples which produce bugs, I may need help in this department when you come across bugs, do report with helpful information
* For now, I have added support for lzo1x_999 (1-9)
* Max decompressed stream size should be no more than 4MB for it to be detected.

Ran a test on a portion of lzo streams I bundled together and these were results:

Compressed 1 file, 33,987,678 => 62,617,798 bytes. Ratio 184.24%
Compression time: cpu 0.06 sec/real 19.78 sec = 0%. Speed 1.72 mB/s

Extracted 1 file, 62,617,798 => 33,987,678 bytes. Ratio 184.24%
Extraction time: cpu 0.13 sec/real 3.46 sec = 4%. Speed 9.82 mB/s

Before I forget, I wonder who this guy is
Capture80.PNG

[JustFun]

Originally Posted by Razor12911

Before I forget, I wonder who this guy is
Attachment 24115

Laughed soo much when I saw it, he even thanked you in this thread

[darkwolves]

Originally Posted by JustFun

Laughed soo much when I saw it, he even thanked you in this thread

imposter lol

[KaktoR]

Originally Posted by Razor12911

Before I forget, I wonder who this guy is
Attachment 24115

Maybe it's you from an other dimension?

[oltjon]

I wanted to compress far cry 3

[ZAZA4EVER]

Far Cry New Dawn - patch_english.dat

D:\ZAZA\Repacks\Far Cry New Dawn\LZO Test>arc.exe a -ep1 -r -ed -s; -w.\temp -ml
zorec data.arc "pack\*"
FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 122,241 => 122,253 bytes. Ratio 100.01%
Compression time: cpu 0.00 sec/real 0.31 sec = 0%. Speed 0.39 mB/s
All OK

[Razor12911]

Originally Posted by oltjon

I wanted to compress far cry 3

could you find out what file pops up that error?

Originally Posted by ZAZA4EVER

Far Cry New Dawn - patch_english.dat

D:\ZAZA\Repacks\Far Cry New Dawn\LZO Test>arc.exe a -ep1 -r -ed -s; -w.\temp -ml
zorec data.arc "pack\*"
FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 122,241 => 122,253 bytes. Ratio 100.01%
Compression time: cpu 0.00 sec/real 0.31 sec = 0%. Speed 0.39 mB/s
All OK

is the game lzo compressed?

[ZAZA4EVER]

Originally Posted by Razor12911

could you find out what file pops up that error?



is the game lzo compressed?

yep

[FitGirl]

Originally Posted by ZAZA4EVER

yep

Nope

[elit]

I was thinking about modifying QuickBMS to make it universal "precomp". It already support -O option which mean you can inflate almost any data into a single file, just like precomp or your tools do. Of course you need bms script and skill but it would remain universal forever.

Its main problem currently seem to be that it doesn't "reimport" from that single file back, it is still looking for the whole extracted directory. And of course, QuickBMS do not try to maintain 1:1 CRC so that would have to be dealt with as well. But facilities are already there. I dont know when/if I can ever get time for that but... damn. Such potential.

[ZAZA4EVER]

Originally Posted by FitGirl

Nope

game Use lz4 stream ... there is differance betwwen lzo & lz4?
sorry for my mistake

[KaktoR]

^This scanner is crap, even razor say this. Use GFS instead.

[Razor12911]

Originally Posted by ZAZA4EVER

there is differance betwwen lzo & lz4?

I'm sorry but I can't help it

[FitGirl]

Originally Posted by ZAZA4EVER

game Use lz4 stream ... there is differance betwwen lzo & lz4?
sorry for my mistake

lzo, lzma, lzham, lolz, lzma2, lz4, lz5, rar, zip are all the same. Devs are simply having fun renaming them here and there.

[ZAZA4EVER]

Originally Posted by FitGirl

lzo, lzma, lzham, lolz, lzma2, lz4, lz5, rar, zip are all the same. Devs are simply having fun renaming them here and there.

Thanks Fitgirl for your replay and respect