FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   WavPack Algorithm Support Freearc (https://fileforums.com/showthread.php?t=98133)

Carldric Clement 22-08-2016 18:44

WavPack Algorithm Support Freearc
 
2 Attachment(s)
In this post... i'll show about wavpack lossless sound about what happen in this post... the photos will be show...

If you guys need to response, let me hear your comment about what it take so long... :D

This file was found on krinkels.org. & thanks to him for good support for freearc. :D

FitGirl 23-08-2016 15:20

The point? TAK in MSC has better compression and is lightning fast.

Carldric Clement 23-08-2016 19:32

Nice.. but you need to test WavPack
 
Quote:

Originally Posted by FitGirl (Post 450978)
The point? TAK in MSC has better compression and is lightning fast.

Your point is MSC to get faster compression. But my point is to get a slow to a huge compression like WavPack... :D:D

ramazan19833 23-08-2016 20:20

New Mini Compressor WavPack Algorithm Support Freearc update

FitGirl 24-08-2016 06:54

Quote:

Originally Posted by Carldric Clement (Post 450981)
Your point is MSC to get faster compression. But my point is to get a slow to a huge compression like WavPack... :D:D

Can you provide a link to wav(s), on which WavPack beats TAK in terms of compression. Lossless, I mean.

Gupta 24-08-2016 07:25

Quote:

Originally Posted by FitGirl (Post 450995)
Can you provide a link to wav(s), on which WavPack beats TAK in terms of compression. Lossless, I mean.

msc_frog will even achive better then msc_tak itself... bt may take little bit more time
bt if u consider more on compression then i don't think increase in time can give you the pain in ur a**

Carldric Clement 24-08-2016 08:49

Quote:

Originally Posted by PrinceGupta2000 (Post 450996)
msc_frog will even achive better then msc_tak itself... bt may take little bit more time
bt if u consider more on compression then i don't think increase in time can give you the pain in ur a**

hmm... :confused:
I've never used that before but it's good to use it msc_frog... :cool:
but Wavpack was really perfect lossless about it. :D

Gupta 24-08-2016 09:34

Quote:

Originally Posted by Carldric Clement (Post 450997)
hmm... :confused: Wavpack was really perfect lossless about it. :D

As the Msc... it is totally lossless

one drawback of ur method i can see is that it works for masks only, meaning any wavs that is embedded in an archive, it will not gonna work. similarly game developers and our gaming rigs are now wealthy enough to use files with more complexity for example mp3 and handle them perfectly, i saw tons of mp3s embedded in game archives nowadays.So i see more scope of discussion over mp3 compression rather then on wav.

bt the case of MSC is different means it doesn't go for masks bt for the headers, it scans whole things first meaning the data u asked arc to compress, make a log of what it found and then extract things one by one and process it with "special" compressors, put it back in another archive.

about the msc_frog and msc_tak, actually MSC provide choice between two compressors for compression of wav files i.e Frog and Tak, frog provides somewhat better compression then tak on the cost of speed, I divided MSC on these basis in MSC_frog and MSC_TAk in Masked Compression v2.5.1 for the sake of decompression as they requires different versions of cls for decompression.

Conclusion : i think masks compression doesn't a go for compression lovers, doing things manually will yields u much better results. means scanning each file manually with dragon unpacker or something like that, extracting file, processing things with "special" compressors or simply u can use MSC, it has also a compressor for mp3 and for wav as well. Even the MSC itself has the feature of extracting things that can be processed with "special" compressors, but the injection feature didn't work for me.

Pls correct me if u thing i got wrong somewhere or my whole thinking is creepy s***.

Best regards,
Prince Gupta

Carldric Clement 24-08-2016 19:24

Quote:

Originally Posted by PrinceGupta2000 (Post 451002)
As the Msc... it is totally lossless

one drawback of ur method i can see is that it works for masks only, meaning any wavs that is embedded in an archive, it will not gonna work. similarly game developers and our gaming rigs are now wealthy enough to use files with more complexity for example mp3 and handle them perfectly, i saw tons of mp3s embedded in game archives nowadays.So i see more scope of discussion over mp3 compression rather then on wav.

bt the case of MSC is different means it doesn't go for masks bt for the headers, it scans whole things first meaning the data u asked arc to compress, make a log of what it found and then extract things one by one and process it with "special" compressors, put it back in another archive.

about the msc_frog and msc_tak, actually MSC provide choice between two compressors for compression of wav files i.e Frog and Tak, frog provides somewhat better compression then tak on the cost of speed, I divided MSC on these basis in MSC_frog and MSC_TAk in Masked Compression v2.5.1 for the sake of decompression as they requires different versions of cls for decompression.

Conclusion : i think masks compression doesn't a go for compression lovers, doing things manually will yields u much better results. means scanning each file manually with dragon unpacker or something like that, extracting file, processing things with "special" compressors or simply u can use MSC, it has also a compressor for mp3 and for wav as well. Even the MSC itself has the feature of extracting things that can be processed with "special" compressors, but the injection feature didn't work for me.

Pls correct me if u thing i got wrong somewhere or my whole thinking is creepy s***.

Best regards,
Prince Gupta

More result...
I think you should go a rest time to get more information about it.
But it's good to me your information was perfect. Unfortunately msc_tak was failed about decompression like this:
Code:

[External compressor:msc]
;Alt: -f = Forced on bigger data //-frog=9 use this instead of -tak=9 = yields error on decomp.
header = 0
packcmd = MSC c -v -wav=1 -raw=1 -bmp=1 -ddsraw=1 -ddsdxt=1 -mp3=1 -bmf=9s -tak=9 -dxt=1 -lzma=hc4,lc8,lp2,pb2,fb273,mc1000 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

think about it. :rolleyes:

1234567890123 25-08-2016 09:53

frog gives better ratio than tak. but sometimes using -f giving error in both of them. not always but you must test archive with decompres it.actually it gives more error with reflate and a bit precomp

Gupta 25-08-2016 10:05

Quote:

Originally Posted by 1234567890123 (Post 451046)
frog gives better ratio than tak. but sometimes using -f giving error in both of them. not always but you must test archive with decompres it.actually it gives more error with reflate and a bit precomp

not for me, i hardly got any error from Msc side unless you consider the Bmf part

Simorq 19-04-2017 12:40

[External compressor:WavPack] Not Work
Please Help

felice2011 19-04-2017 13:39

Quote:

Originally Posted by Simorq (Post 458226)
[External compressor:WavPack] Not Work
Please Help

Oh yep it works, add the mask as in the example, add and set the external compressor in the arc.ini file, and you'll see it works, better than "msc" (now no longer updated from years).
Use these settings, "-hh -x5" for wav files.;)

Bulat 20-04-2017 03:54

isn't built-in TTA algo compress better than wavpack?

JRD! 20-04-2017 05:16

TTA is much faster than wavpack for the same result:

----------------------------- START 14:06:32 -----------------------------
[2017/04/20:14:06:32] Creating archive: Data-01.bin (1/1)
[2017/04/20:14:06:32] IntputPath: C:\Users\JRD\Downloads\0905.wav
[2017/04/20:14:06:32] InputSize: 65,93 MB
[2017/04/20:14:06:32] FilesCount: 1
----------------------------- METHOD -----------------------------
[2017/04/20:14:06:32] Step Method Count: 1
[2017/04/20:14:06:32] MaskedMethod: -mfreearc_tta
[2017/04/20:14:06:32] FullMethod: -mtta
----------------------------- COMPRESSORS -----------------------------
[2017/04/20:14:06:32] Compressors count: 1
[2017/04/20:14:06:32] Compressor: tta
----------------------------- RESULT -----------------------------
[2017/04/20:14:06:36] OutputSize: 29,56 MB
[2017/04/20:14:06:36] Ratio: 44,84 %
[2017/04/20:14:06:36] Status: Operation success
[2017/04/20:14:06:36] Compression time: 00:00:03
----------------------------- FINISH 14:06:36 -----------------------------

----------------------------- START 14:06:54 -----------------------------
[2017/04/20:14:06:54] Creating archive: Data-01~1.bin (1/1)
[2017/04/20:14:06:54] IntputPath: C:\Users\JRD\Downloads\0905.wav
[2017/04/20:14:06:54] InputSize: 65,93 MB
[2017/04/20:14:06:54] FilesCount: 1
----------------------------- METHOD -----------------------------
[2017/04/20:14:06:54] Step Method Count: 1
[2017/04/20:14:06:54] MaskedMethod: -mwavpack_x64
[2017/04/20:14:06:54] FullMethod: -mwavpack_x64
----------------------------- COMPRESSORS -----------------------------
[2017/04/20:14:06:54] Compressors count: 1
[2017/04/20:14:06:54] Compressor: wavpack_x64 -hh -x5 - -
----------------------------- RESULT -----------------------------
[2017/04/20:14:07:51] OutputSize: 29,56 MB
[2017/04/20:14:07:51] Ratio: 44,83 %
[2017/04/20:14:07:51] Status: Operation success
[2017/04/20:14:07:51] Compression time: 00:00:57
----------------------------- FINISH 14:07:51 -----------------------------

----------------------------- START 14:11:58 -----------------------------
[2017/04/20:14:11:58] Creating archive: Data-01~2.bin (1/1)
[2017/04/20:14:11:58] IntputPath: C:\Users\JRD\Downloads\0905.wav
[2017/04/20:14:11:58] InputSize: 65,93 MB
[2017/04/20:14:11:58] FilesCount: 1
----------------------------- METHOD -----------------------------
[2017/04/20:14:11:58] Step Method Count: 1
[2017/04/20:14:11:58] MaskedMethod: -mwavpack_x64
[2017/04/20:14:11:58] FullMethod: -mwavpack_x64
----------------------------- COMPRESSORS -----------------------------
[2017/04/20:14:11:58] Compressors count: 1
[2017/04/20:14:11:58] Compressor: wavpack_x64 -h -x5 - -
----------------------------- RESULT -----------------------------
[2017/04/20:14:12:40] OutputSize: 29,56 MB
[2017/04/20:14:12:40] Ratio: 44,84 %
[2017/04/20:14:12:40] Status: Operation success
[2017/04/20:14:12:40] Compression time: 00:00:41
----------------------------- FINISH 14:12:40 -----------------------------

felice2011 20-04-2017 06:52

if we compare with the same level of compression I can not see the difference in speed.

tta r3.4

Code:

-↓- [ CMD Bench.Test.Info v0.6.9c Viper Edition ] -↓- Compressed Archive Completed At -↓- 20/04/2017 15:25:11
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

          TTAenc          41,8°MB          26,4°MB        63,16%              1°File    00:00:01:95                              -e -o
=============================================================================================================================================

wavpack 5.1.0

Code:

-↓- [ CMD Bench.Test.Info v0.6.9c Viper Edition ] -↓- Compressed Archive Completed At -↓- 20/04/2017 15:24:36
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

        wavpack          41,8°MB          26,4°MB        63,16%              1°File    00:00:01:959                                -h 
=============================================================================================================================================

But calculations do not come back, increasing the compression level, time increases, but the ratio varies little or nothing.:mad:

ChronoCross 20-04-2017 09:25

1 Attachment(s)
i was build this prepack for wav and raw(image).
is in c lang. but i cant fix to unpack. if anyone can help.
check the attach.

Bulat 20-04-2017 09:29

freearc contains tta 3.2 which afaik compress better but slower than 3.4

so it's better to run freearc/fazip itself rather than use tta executables

and compression time probably isn't important for repacks, only dec. speed and ratio matters. check all 3 levels - from tta:m1 to tta:m3

Carldric Clement 25-04-2017 10:25

OK Guys... if you want to know about TTA and wavpack are same but was almost different.

TTA is smooth compression and lightning style. but the level was not to fit loss to combine before and after.

wavpack is slow compression and support algorithm with a huge calculate. but the level was good to fit. almost not fit or whatever combine before and after.

see?? it just same.

rayated 26-05-2017 22:16

Can anyone give me wavpack 5.1's pack and unpackcmd?

JRD! 27-05-2017 10:04

2 Attachment(s)
You can replace {compressor} with the name of the executable

"-h -x5 -q" are additional parameters...

rayated 27-05-2017 19:32

Quote:

Originally Posted by JRD! (Post 459209)
You can replace {compressor} with the name of the executable

"-h -x5 -q" are additional parameters...

btw whats the unpackcmd?
What if I use hybrid? :(

Carldric Clement 23-06-2019 17:48

Quote:

Originally Posted by rayated (Post 459217)
btw whats the unpackcmd?
What if I use hybrid? :(

You can use with hybrid. Anyway try it.

kj911 27-09-2021 09:35

Quote:

Originally Posted by felice2011 (Post 458228)
Use these settings, "-hh -x5" for wav files.;)

Try its use "-hh -x6" (not "-h -x5"!) its probably best compression ratio. WavPack v4.80.0 its minimally faster and better comp. rate compare to v5.3.0 release. (The finish build support from WinXP! 5.4.0 its dropped support.)

Testing my day in few hours, these big 2 hours lenght vhs-audio tracks compression.

Code:

Source: ESB.wav (orig file: MP2/224kbps/48kHz, old 2h length vhs audio transcoded to 16bit WAV file.)

Size: 1 380 802 638 byte

Comp. sizes with WavPack 5.3.0 x86:

compare: FLAC, (use LibFLAC 1.3.1) with -5 comp. switch: 369 547 248 byte)

-h: 365 706 748 byte (114.72s)
-h -x1: 362 673 094 byte (161.70s)

-hh -x1: 360 268 386 byte (217.08s)
-hh -x2: 359 867 010 byte (356.16s)
-hh -x3: 359 888 742 byte (716.14s)
-hh -x4: 356 520 814 byte (2838.94s)
-hh -x5: wait results.
-hh -x6: wait...

Carldric/ChronoCross posted packages testing in next times via two games: MSTS with pure WAV's and probably compress SCPT game *.LS0 files only.

Quote:

Originally Posted by rayated (Post 459217)
btw whats the unpackcmd?
What if I use hybrid? :(

Tested the Hybrid mode with the huge file. Its *.wv compressed file only smaller than lossless copy. Use ("-bn -c" switches) and added *.vvc restoration file its *.wv files during compression. This *.wv+vvc packages biggest than losslessly compressed *.wv fille only!

kj911 16-10-2021 14:38

1 Attachment(s)
Quote:

Originally Posted by JRD! (Post 459209)
You can replace {compressor} with the name of the executable

"-h -x5 -q" are additional parameters...

Works from ONE WAV-file compression. Multiple WAV compression not handle properly via switches and Arc.exe its crashed. Manually updating arc file use one WAV file its added again and again its very impossible.

More methods, use separated WAV->WV compression and put all *.WV file to one archive its works! See te attached packages. Required properly encoded WAV source files from during compression. The "MISSING FILES" directory contain three uncompressible, damaged WAV's not compressing the MSTS game files sets. (4998 file its work via 5001 files set. CRCs it OK!)

Mini compare (from my big test):

WAVPACK 4.80.0 x86 with "-hh -x6" + FreeArc 0.67 with "-mx" switches:
Results: 674 635kB (FreeArc temporary file: 673 358kB)**
with -mrep:512m switches: 673 414kB
Comp. time: ~155+20min; Decomp. time: ~10min

WAVPACK 4.80.0 x86 with "-f" + FreeArc 0.67 with "-mx" switches:
Results: 674 635kB (FreeArc temporary file: 709 262kB)**
with -mrep:512m switches: 711 083kB**
Comp. time: ~10+20min; Decomp. time: ~10min!

**Missing 3 files!!! Yes, don't use LZMA compression!

MSC+SREP: 634861kB (In last time.)

UPDATE: New results are posted it --> https://fileforums.com/showpost.php?...postcount=2597

Carldric Clement 24-10-2021 08:26

2 Attachment(s)
Quote:

Originally Posted by kj911 (Post 494488)
Works from ONE WAV-file compression. Multiple WAV compression not handle properly via switches and Arc.exe its crashed. Manually updating arc file use one WAV file its added again and again its very impossible.

More methods, use separated WAV->WV compression and put all *.WV file to one archive its works! See te attached packages. Required properly encoded WAV source files from during compression. The "MISSING FILES" directory contain three uncompressible, damaged WAV's not compressing the MSTS game files sets. (4998 file its work via 5001 files set. CRCs it OK!)

Mini compare (from my big test):

WAVPACK 4.80.0 x86 with "-hh -x6" + FreeArc 0.67 with "-mx" switches:
Results: 674 635kB (FreeArc temporary file: 673 358kB)**
with -mrep:512m switches: 673 414kB
Comp. time: ~155+20min; Decomp. time: ~10min

WAVPACK 4.80.0 x86 with "-f" + FreeArc 0.67 with "-mx" switches:
Results: 674 635kB (FreeArc temporary file: 709 262kB)**
with -mrep:512m switches: 711 083kB**
Comp. time: ~10+20min; Decomp. time: ~10min!

**Missing 3 files!!! Yes, don't use LZMA compression!

MSC+SREP: 634861kB (In last time.)

UPDATE: New results are posted it --> https://fileforums.com/showpost.php?...postcount=2597

Here's the arc setting useful.
Code:

[External compressor:wavpack]
header = 0
packcmd  = wavpack.exe -hh - $$arcpackedfile$$.tmp <stdin>
unpackcmd = wvunpack.exe - - <stdin> <stdout>
solid = 0

The only works by using one method. No need to add srep or lzma.
Code:

Compressed 5 files, 5,459,330 => 947,119 bytes. Ratio 17.35%                                                           
Compression time: cpu 0.02 sec/real 1.28 sec = 1%. Speed 4.25 mB/s                                                     
All OK

:)

kj911 25-10-2021 12:11

Carldric! Use very higher files sets from compression! Works?? (Testing now in few hours.)

Found the BUG! See the pictures. YES! That was the problem. WvUnpack.exe glitch! 50-50 percentage its really to extract properly! Internally ARC file test its OK!

https://i.kek.sh/QxRGNgmjd45.png
https://i.kek.sh/AOGsQ63uXnk.png

Tested from my 5001 WAV files sets. Don't work. The WAVPACK compressor no tolerance its incompressible, not standard and/or damaged WAV files. Found first error and compression progress exiting now with Errorlevel=1 message. This MSC and FreeArc with TTA-method tolerance any errors and will compress properly!

Compression error: https://i.kek.sh/723SkDDMPn5.png

Its probably fully proper switches from decompression:
Code:

unpackcmd = wvunpack.exe -z $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
See picture: https://i.kek.sh/1OGVCcvdYsl.png

The "-z" switch its cosmetic usage from CMD Window title.

Carldric Clement 28-10-2021 01:24

Quote:

Originally Posted by kj911 (Post 494607)
Carldric! Use very higher files sets from compression! Works?? (Testing now in few hours.)

Found the BUG! See the pictures. YES! That was the problem. WvUnpack.exe glitch! 50-50 percentage its really to extract properly! Internally ARC file test its OK!

https://i.kek.sh/QxRGNgmjd45.png
https://i.kek.sh/AOGsQ63uXnk.png

Tested from my 5001 WAV files sets. Don't work. The WAVPACK compressor no tolerance its incompressible, not standard and/or damaged WAV files. Found first error and compression progress exiting now with Errorlevel=1 message. This MSC and FreeArc with TTA-method tolerance any errors and will compress properly!

Compression error: https://i.kek.sh/723SkDDMPn5.png

Its probably fully proper switches from decompression:
Code:

unpackcmd = wvunpack.exe -z $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
See picture: https://i.kek.sh/1OGVCcvdYsl.png

The "-z" switch its cosmetic usage from CMD Window title.

The third pic that I saw was like "Too many channels" right now. Maybe it was because the WAV encode was an unknown issue. I've tried to figure some other params without using "-hh" to make it work. :)

EDIT: Use "tta" method on FreeARC to compress a WAV files if it works.

kj911 28-10-2021 12:23

Carldric: It looks like we're pretty much done with this WavPack compression, with all its limitations.

Yes, TTA or MSC/TAK method its best and favorized methods usage in future time. Compression ratio and any results barely better then WavPack versions. Good luck.


All times are GMT -7. The time now is 04:46.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com