Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #31  
Old 04-12-2015, 08:59
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 450
Thanks: 110
Thanked 611 Times in 256 Posts
panker1992 is on a distinguished road
Quote:
Originally Posted by RamiroCruzo View Post
Amigos if you wanna so fast compression method, why don't you take a look at LZ4 which goes beyond 1GB/s without I/O overwrapping & multithreading.....

I have tested lz4 and lz5 long time ago, zstd is a step ahead of lz4 lz5 and zhuff at the moment its steady and it has a lot of support the one i posted is v3.6 and the one i am testing now is 4.2 and it has 2.2 gigs/sec around
( 593mb/sec/thread = 2.2 gigs/sec )
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following 3 Users Say Thank You to panker1992 For This Useful Post:
felice2011 (04-12-2015), RamiroCruzo (04-12-2015), romulus_ut3 (04-12-2015)
Sponsored Links
  #32  
Old 04-12-2015, 09:35
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
 
Join Date: Feb 2011
Location: italy
Posts: 809
Thanks: 337
Thanked 1,069 Times in 368 Posts
felice2011 is on a distinguished road
Quote:
Originally Posted by RamiroCruzo View Post
Amigos if you wanna so fast compression method, why don't you take a look at LZ4 which goes beyond 1GB/s without I/O overwrapping & multithreading.....
Quote:
Originally Posted by panker1992 View Post
I have tested lz4 and lz5 long time ago, zstd is a step ahead of lz4 lz5 and zhuff at the moment its steady and it has a lot of support the one i posted is v3.6 and the one i am testing now is 4.2 and it has 2.2 gigs/sec around
( 593mb/sec/thread = 2.2 gigs/sec )
Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.
Reply With Quote
The Following 2 Users Say Thank You to felice2011 For This Useful Post:
panker1992 (04-12-2015), RamiroCruzo (04-12-2015)
  #33  
Old 04-12-2015, 10:39
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 450
Thanks: 110
Thanked 611 Times in 256 Posts
panker1992 is on a distinguished road
Quote:
Originally Posted by felice2011 View Post
Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.
This is why i chose zstd ...because it features advanced API that can compress decent.

To be more specific zstd has at least 30% ~ 35% better compression ratio
tho everyone i see use my original -8 switch ....it can easily go as high as -20 but its ratio doesnt compare to lzma at all :P

All in all zstd gives 30% ~ 35% better compression AND it decompressed as fast as lz4

HINT : zstd and all tools i use have porpose nothing i choose is coincidence this all is part of my upcoming big project call "Masked Compression"

soon !!!
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following User Says Thank You to panker1992 For This Useful Post:
RamiroCruzo (04-12-2015)
  #34  
Old 04-12-2015, 11:10
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
 
Join Date: Feb 2011
Location: italy
Posts: 809
Thanks: 337
Thanked 1,069 Times in 368 Posts
felice2011 is on a distinguished road
Great Bro ... at least we know that LZ4 and LZ5 is now out
Reply With Quote
  #35  
Old 04-12-2015, 13:22
Razor12911's Avatar
Razor12911 Razor12911 is offline
Coder
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,296
Thanks: 1,787
Thanked 8,337 Times in 1,841 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by ShadowEagle View Post
Ok, i do understand. You created a tool, posted it and don`t help to get it work. I see no tutorial. I`ll give 1 star for bad support, most bad support i`ve ever seen.
took me 4 minutes to figure out how this program works, from my perspective, this program is easier than ultra arc and it is reliable.
__________________
Please ask questions on the forum, I'm getting too many private messages and I hardly go online to check.
Cheers!!!
Reply With Quote
The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
felice2011 (04-12-2015), RamiroCruzo (04-12-2015), ShadowEagle (04-12-2015)
  #36  
Old 04-12-2015, 15:32
ShadowEagle's Avatar
ShadowEagle ShadowEagle is offline
Registered User
 
Join Date: Dec 2014
Location: Wonderland
Posts: 138
Thanks: 18
Thanked 21 Times in 18 Posts
ShadowEagle is on a distinguished road
Yes i`m stupid and bad guy
Reply With Quote
  #37  
Old 04-12-2015, 17:58
Razor12911's Avatar
Razor12911 Razor12911 is offline
Coder
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,296
Thanks: 1,787
Thanked 8,337 Times in 1,841 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by ShadowEagle View Post
Yes i`m stupid and bad guy
not really, you just have to engage with the program even further and use logic, so far so good, you are showing interests with this program only thing left is to make attempts to make the program work using logic then you'll get there.
__________________
Please ask questions on the forum, I'm getting too many private messages and I hardly go online to check.
Cheers!!!
Reply With Quote
  #38  
Old 04-12-2015, 19:58
gozarck's Avatar
gozarck gozarck is offline
Registered User
 
Join Date: Nov 2013
Location: Argentina
Posts: 162
Thanks: 253
Thanked 459 Times in 111 Posts
gozarck is on a distinguished road
Yes felice your tool is very powerfull and easy to use.you need to make the UI more atractive for newbies. Do you was tried to integrate metroframework.dll (metroUI) in yours projects?.
__________________
-the science of the useless-
Reply With Quote
The Following 2 Users Say Thank You to gozarck For This Useful Post:
felice2011 (05-12-2015), RamiroCruzo (04-12-2015)
  #39  
Old 04-12-2015, 23:14
RamiroCruzo's Avatar
RamiroCruzo RamiroCruzo is offline
Registered User
 
Join Date: Jul 2015
Location: India
Posts: 184
Thanks: 386
Thanked 165 Times in 75 Posts
RamiroCruzo is on a distinguished road
Quote:
Originally Posted by felice2011 View Post
Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.
Lets compare ourselves which is better for our needs....

Source:Encode.ru

| Compressor name | Compression| Decompress.| Compr. size | Ratio |
| --------------- | -----------| -----------| ----------- | ----- |
| memcpy | 8533 MB/s | 8533 MB/s | 104857600 |100.00 |
| lz4 r131 | 480 MB/s | 2275 MB/s | 64872315 | 61.87 |
| lz4hc r131 -1 | 82 MB/s | 1896 MB/s | 59448496 | 56.69 |
| lz4hc r131 -3 | 54 MB/s | 1932 MB/s | 56343753 | 53.73 |
| lz4hc r131 -5 | 41 MB/s | 1969 MB/s | 55271312 | 52.71 |
| lz4hc r131 -7 | 31 MB/s | 1969 MB/s | 54889301 | 52.35 |
| lz4hc r131 -9 | 24 MB/s | 1969 MB/s | 54773517 | 52.24 |
| lz4hc r131 -11 | 20 MB/s | 1969 MB/s | 54751363 | 52.21 |
| lz4hc r131 -13 | 17 MB/s | 1969 MB/s | 54744790 | 52.21 |
| lz4hc r131 -15 | 14 MB/s | 2007 MB/s | 54741827 | 52.21 |
| lz5 r131 | 195 MB/s | 939 MB/s | 55884927 | 53.30 |
| lz5hc r131 -1 | 32 MB/s | 742 MB/s | 52927122 | 50.48 |
| lz5hc r131 -3 | 20 MB/s | 716 MB/s | 50970192 | 48.61 |
| lz5hc r131 -5 | 10 MB/s | 701 MB/s | 49970285 | 47.66 |
| lz5hc r131 -7 | 5.54 MB/s | 682 MB/s | 49541511 | 47.25 |
| lz5hc r131 -9 | 2.69 MB/s | 673 MB/s | 49346894 | 47.06 |
| lz5hc r131 -11 | 1.36 MB/s | 664 MB/s | 49266526 | 46.98 |
| zstd v0.3 | 257 MB/s | 547 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -1 | 257 MB/s | 553 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -3 | 76 MB/s | 417 MB/s | 46774383 | 44.61 |
| zstd_HC v0.3 -5 | 40 MB/s | 476 MB/s | 45628362 | 43.51 |
| zstd_HC v0.3 -9 | 14 MB/s | 485 MB/s | 44840562 | 42.76 |
| zstd_HC v0.3 -13 | 9.34 MB/s | 469 MB/s | 43114895 | 41.12 |
| zstd_HC v0.3 -17 | 6.02 MB/s | 463 MB/s | 42989971 | 41.00 |
| zstd_HC v0.3 -21 | 3.35 MB/s | 461 MB/s | 42956964 | 40.97 |
| zstd_HC v0.3 -23 | 2.33 MB/s | 463 MB/s | 42934217 | 40.95 |
__________________
We are such stuff as dreams are made on, and our little life is rounded with a sleep.

Last edited by RamiroCruzo; 04-12-2015 at 23:18. Reason: Better looks
Reply With Quote
  #40  
Old 05-12-2015, 03:07
ShadowEagle's Avatar
ShadowEagle ShadowEagle is offline
Registered User
 
Join Date: Dec 2014
Location: Wonderland
Posts: 138
Thanks: 18
Thanked 21 Times in 18 Posts
ShadowEagle is on a distinguished road
Used this method:



I tried to extract with inno setup. I copied all files from "Resources" folder into includes folder in inno setup script and added the reflate files into the script:

Code:
Source: Include\reflate.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\rawrest.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\rawdet.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\raw2hif.exe; DestDir: {tmp}; Flags: dontcopy
But i get this error:



Pls help. What i`m doing wrong?
Reply With Quote
  #41  
Old 05-12-2015, 05:21
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 450
Thanks: 110
Thanked 611 Times in 256 Posts
panker1992 is on a distinguished road
Quote:
Originally Posted by RamiroCruzo View Post
Lets compare ourselves which is better for our needs....

Source:Encode.ru

| Compressor name | Compression| Decompress.| Compr. size | Ratio |
| --------------- | -----------| -----------| ----------- | ----- |
| memcpy | 8533 MB/s | 8533 MB/s | 104857600 |100.00 |
| lz4 r131 | 480 MB/s | 2275 MB/s | 64872315 | 61.87 |
| lz4hc r131 -1 | 82 MB/s | 1896 MB/s | 59448496 | 56.69 |
| lz4hc r131 -3 | 54 MB/s | 1932 MB/s | 56343753 | 53.73 |
| lz4hc r131 -5 | 41 MB/s | 1969 MB/s | 55271312 | 52.71 |
| lz4hc r131 -7 | 31 MB/s | 1969 MB/s | 54889301 | 52.35 |
| lz4hc r131 -9 | 24 MB/s | 1969 MB/s | 54773517 | 52.24 |
| lz4hc r131 -11 | 20 MB/s | 1969 MB/s | 54751363 | 52.21 |
| lz4hc r131 -13 | 17 MB/s | 1969 MB/s | 54744790 | 52.21 |
| lz4hc r131 -15 | 14 MB/s | 2007 MB/s | 54741827 | 52.21 |
| lz5 r131 | 195 MB/s | 939 MB/s | 55884927 | 53.30 |
| lz5hc r131 -1 | 32 MB/s | 742 MB/s | 52927122 | 50.48 |
| lz5hc r131 -3 | 20 MB/s | 716 MB/s | 50970192 | 48.61 |
| lz5hc r131 -5 | 10 MB/s | 701 MB/s | 49970285 | 47.66 |
| lz5hc r131 -7 | 5.54 MB/s | 682 MB/s | 49541511 | 47.25 |
| lz5hc r131 -9 | 2.69 MB/s | 673 MB/s | 49346894 | 47.06 |
| lz5hc r131 -11 | 1.36 MB/s | 664 MB/s | 49266526 | 46.98 |
| zstd v0.3 | 257 MB/s | 547 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -1 | 257 MB/s | 553 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -3 | 76 MB/s | 417 MB/s | 46774383 | 44.61 |
| zstd_HC v0.3 -5 | 40 MB/s | 476 MB/s | 45628362 | 43.51 |
| zstd_HC v0.3 -9 | 14 MB/s | 485 MB/s | 44840562 | 42.76 |
| zstd_HC v0.3 -13 | 9.34 MB/s | 469 MB/s | 43114895 | 41.12 |
| zstd_HC v0.3 -17 | 6.02 MB/s | 463 MB/s | 42989971 | 41.00 |
| zstd_HC v0.3 -21 | 3.35 MB/s | 461 MB/s | 42956964 | 40.97 |
| zstd_HC v0.3 -23 | 2.33 MB/s | 463 MB/s | 42934217 | 40.95 |
Impressive but this test utilize the HC format of the zstd program
currently i test zstd v4.2

i have eaten all my day to test, test and test this :P

download the lz4 installer for windows and rename zstd ~~> lz4.exe and
replace in programs/lz4 folder

use this and you will see that decomp speed is all but fake i/o cant handle
2.2 gigs/sec because of limitation unless you have some x6 SSD array :P
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.

Last edited by panker1992; 05-01-2016 at 20:06.
Reply With Quote
The Following User Says Thank You to panker1992 For This Useful Post:
romulus_ut3 (05-12-2015)
  #42  
Old 05-12-2015, 06:49
sayang123 sayang123 is offline
Registered User
 
Join Date: Jul 2015
Location: Indonesia
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
sayang123 is on a distinguished road
Is there any installer script which support the unpack command from this app?

sorry for my bad english
Reply With Quote
  #43  
Old 05-12-2015, 09:23
rinaldo's Avatar
rinaldo rinaldo is offline
Registered User
 
Join Date: Sep 2015
Location: Rome
Posts: 430
Thanks: 101
Thanked 632 Times in 186 Posts
rinaldo is on a distinguished road
also applies in the ComboBox style. the success is in knowing how to match colors
(Too bright and too colorful are crap)
lit are used to such mail alert .. design still do not like you know.

Last edited by Joe Forster/STA; 13-02-2016 at 06:45.
Reply With Quote
  #44  
Old 05-12-2015, 10:48
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
 
Join Date: Feb 2011
Location: italy
Posts: 809
Thanks: 337
Thanked 1,069 Times in 368 Posts
felice2011 is on a distinguished road
also applies in the ComboBox style. the success is in knowing how to match colors
(Too bright and too colorful are crap)
lit are used to such mail alert .. design still do not like you know.[/QUOTE]

Depending on your point of view there are those who see the world in color and some in black and white... I see the world in color, anyway I see what you need.

Last edited by Joe Forster/STA; 13-02-2016 at 06:46.
Reply With Quote
The Following User Says Thank You to felice2011 For This Useful Post:
Simorq (06-12-2015)
  #45  
Old 05-12-2015, 13:17
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
 
Join Date: Feb 2011
Location: italy
Posts: 809
Thanks: 337
Thanked 1,069 Times in 368 Posts
felice2011 is on a distinguished road
Quote:
Originally Posted by sayang123 View Post
is there any installer script which support the unpack command from this app?

Sorry for my bad english
In attachment it is an example of installing proprietary 'not InnoSetup' with a data file compressed using the reflate method 'reflate+srep+delta+lzma:a1:mfbt4:d158m:fb273:mc10 00000000:lc8'
For what concerns me and for my use decompression or installation or setup of a compressed data folder, with the excellent method reflate, works beautifully.

coming soon, new universal extractor in new thread

Last edited by felice2011; 12-12-2015 at 01:00. Reason: new universal extractor
Reply With Quote
The Following User Says Thank You to felice2011 For This Useful Post:
Simorq (06-12-2015)
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Full Method, Splitting, Finalizing, Compressing felice2011 Conversion Tutorials 54 23-11-2015 05:16



All times are GMT -7. The time now is 18:01.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.
Copyright 2000-2018, FileForums @ https://fileforums.com