FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Cls bcm & zlib (https://fileforums.com/showthread.php?t=102794)

78372 26-05-2019 07:02

Cls bcm & zlib
 
3 Attachment(s)
1. BCM

BCM STDIO Patch updated for bcm140_win64. Supports stdio in both compression and decompression now and can be multithreaded with PMT. CLS is not required anymore.
PMT Example Settings:
Code:

[bcm]
Encode = bcm -1 stdin stdout <stdin> <stdout>
Decode = bcm -d stdin stdout <stdin> <stdout>

2. ZLIB
Uses default compression level. Doesn't need external executables.

Kitsune1982 27-05-2019 21:30

re: cls-bcm and zlib
 
does the cls-zlib support UA/diskspan if i extract it to my compressors folder in the tools bundle package kaktor uploaded in his post on the CIUv3 thread? im new so im not sure how to use this new zlib cls with UltraArc/diskspan.

please post back and tell me if it is compatible and if so, what i need to do to make diskspan/ua use it. im not that good with freearc so im not sure how to go about adding it to freearc. thanks for any advice.

-Kitsune

*note* also, can this be used as with xtool.exe or is it only usable with freearc standalone .exe?

78372 28-05-2019 01:57

^^

You can use it with DiskSpan and FreeArc. These two things are compresssors, I.E alternative of lzma/lolz. It has nothing to do with xtool.

Kitsune1982 28-05-2019 04:31

re: cls-bcm and zlib
 
thanks for answering my post. my next question is, i unpacked both the cls-bcm and cls-zlib archives and put cls-zlib in the cls-bcm folder. once thats done, i put cls-zlib and bcm together in the same folder with the bcm .exe and related files. also, what file types exactly does bcm compress? i've heard of ecm which was used mostly for compressing ps1 isos but i've never heard of bcm. does it have something to do with compressing .bin files?

^^

update: nevermind, i see how it works. i copied the extracted files from cls-bcm and cls-zlib to my freearc/bin folder and now it works. all i do is put the files i want to compress in the pack folder and run the compress.bat batch script to compress them and put the bin file i want to unpack in 'unpacked' folder.

shazzla 28-05-2019 08:44

Is any way to make BCM multithreaded ?

78372 28-05-2019 08:47

Quote:

Originally Posted by shazzla (Post 481148)
Is any way to make BCM multithreaded ?

Try using 4x4.
Like 4x4:chunksize:tthread:bcm
Ex: srep:m3f+4x4:b64m:t4:bcm

Simorq 28-05-2019 13:25

The "CLS.BCM.dll" file is missing!?

78372 28-05-2019 19:04

Quote:

Originally Posted by Simorq (Post 481150)
The "CLS.BCM.dll" file is missing!?

And nobody noticed that yet.
File uploaded, check it now.

Simorq 29-05-2019 08:14

Thanks 78372

Code:

Compressed 1,899 files, 213,268,328 => 187,379,131 bytes. Ratio 87.86%   
Compression time: cpu 0.61 sec/real 39.55 sec = 2%. Speed 5.39 mB/s
All OK

Tested 1,899 files, 187,379,131 => 213,268,328 bytes. Ratio 87.86%       
Directory 20,955 => 53,115 bytes. Ratio 39.45%
Testing time: cpu 0.91 sec/real 49.25 sec = 2%. Speed 4.33 mB/s
All OK


shazzla 19-09-2019 02:29

Quote:

Originally Posted by 78372 (Post 481149)
Try using 4x4.
Like 4x4:chunksize:tthread:bcm
Ex: srep:m3f+4x4:b64m:t4:bcm

Thank you very much !
Compression works well with 4x4,but decompression... No...
Single threaded BCM is fine ,but 4x4'd ,NO !
bcm130_win64.zip was used for compression.

Can you help me how to decompress 4x4:chunksize:tthread:bcm ?

The error :

arc t e:\xxx.arc

FreeArc 0.67 (March 15 2014) testing archive: e:\xxx.arc
Testing 75 files, 3,305,111,978 bytes. Processed 0.0%Decompressing stdin:
Decompressing stdin:
Decompressing stdin:
Decompressing stdin:
Not in BCM format!
0.0%


Files from cls_bcm.7z are near arc.exe in separate unpack folder :
bcm.exe
bcmpatch.dll
cls-bcm.dll

arc.ini in unpack folder doesnt contain BCM section.

78372 19-09-2019 03:45

Expected behavior. Stdio support in bcm is not so stable and compression doesn't support stdio. 4x4 messes up with streams in this type of case.

shazzla 19-09-2019 03:48

Ok,thanks.
but if i make an archive with -mbcm ,how can i decompress it multithreaded wihtout tmp file ?

78372 26-09-2019 00:14

Umm, not possible atm I think

78372 19-01-2020 04:46

BCM STDIO Patch updated for bcm140_win64. Supports stdio in both compression and decompression now and can be multithreaded with PMT. CLS is not required anymore.
PMT Example Settings:
Code:

[bcm]
Encode = bcm -1 stdin stdout <stdin> <stdout>
Decode = bcm -d stdin stdout <stdin> <stdout>

See first post for downloading bcmpatch

Gehrman 26-02-2020 02:41

High performance data compression library
 
1 Attachment(s)
Hi 78372
bsc is better than bcm, please add support stdio if possible.

shazzla 02-07-2020 23:09

Yeah,its better. But eats insane amount of RAM at comp/decomp. :-/

Gehrman 21-07-2022 04:16

1 Attachment(s)
Updated BCM

Gehrman 07-03-2023 00:09

BCM v2.03
 
Note: BCM works excellent for compressing the SFD and USM video format.

Source
Code:

BCM - A BWT-based file compressor, v2.03
Copyright (C) 2008-2023 Ilya Muravyov

Usage: bcm [options] input [output]

Options:
  -b#[k,m] Block size in KB or MB (default: 32m)
  -l#      Minimum match length for LZP (default: 128)
  -t#      Number of worker threads (default: auto)
  -c      Write to standard output
  -d      Decompress
  -f      Force overwrite of output file
  -x-      Disable X86 preprocessor

Download

FreeArc
Code:

[External compressor:bcm]
header    = 0
default    =-b64m -x-
packcmd  = bcm.exe -c {options} $$arcdatafile$$.tmp <stdout>
unpackcmd = bcm.exe -d -c <stdin> <stdout>



All times are GMT -7. The time now is 06:00.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com