                                The Art
                              of Lossless
                           Data Compression
                                vol. 22g

Here are the results of tests performed in May 2001 to compare
lossless compression of True Color (24-bit) images by all known programs
developed for such purpose, including BMF, JPEG-LS and PNG software,
7-Zip, Pkzip, and archivers with special algorithms for 24-bit images.

See Archive Comparison Test by Jeff Gilchrist for more info: http://act.by.net

If anybody wants to start or continue such tests,
or can suggest some other sets of images, or other compression programs,
 (not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
 (some new fantastic technology, an algorithm or even a program capable
 of lossless compression of up to 1000:1 and lossy compression of
 up to 10000:1, we hear about it from time to time since PC-XTs)
please let us know immediately: artest@inbox.ru   Thank you!


[[1]] COMPRESSION QUALITY
=========================
             (see also
             [[2]] Speed
             [[3]] Details
             [[4]] Comments)

The last 13th line shows results for the sum of all 12 sets (538 images, 1.6Gb)

original  BMF    RKIM    UHIC  ArHanGel   NK    ERI32   UHARC   ACE32    LSP
301.07% 109.41  111.17  110.00  120.89  119.97   100%   118.85  124.75  126.33
289.11%  100%   124.50  104.88  114.61  132.43  118.56  112.29  121.22  136.11
245.22%  100%   101.38  107.93  112.92  109.62  122.72  118.96  114.33  111.39
238.64%  100%   112.66  104.20  110.53  118.18  117.03  116.73  114.13  122.73
472.81% 102.88   100%   112.24  113.06  117.29  134.61  125.91  120.73  235.68
238.40%  100%   102.20  105.10  109.91  107.08  113.77  117.53  112.83  112.67
284.74%  100%   103.04  104.35  110.93  107.79  109.96  113.96  115.95  124.18
337.03%  100%   102.94  105.64  111.14  110.31  116.06  119.99  119.41  116.77
227.58%  100%   104.53  104.00  108.91  109.02  112.80  114.60  111.00  110.35
547.50%  100%   104.25  104.84  107.76  122.73  120.59  127.76  156.04  132.31
379.87%  100%   130.51  104.36  113.80  145.03  124.75  133.06  138.21  158.03
330.79% 109.30  108.57  110.41  118.26  118.75   100%   110.54  126.75  127.79
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
295.73%  100%   104.34  104.48  110.44  111.41  111.81  116.46  118.03  120.41

  DC     SBC      RK     LOCO    ZZip  PngCrush   RAR  Display   7Zip    PkZIP
131.22  132.19  132.25  163.81  143.51  163.00  146.10  168.36  174.15  183.23
127.16  128.32  127.76  156.41  132.25  151.37  140.60  164.86  205.21  208.56
123.53  124.68  125.13  119.20  130.83  129.36  124.25  139.53  193.86  195.64
124.69  125.42  124.76  127.45  130.68  133.56  132.94  144.00  182.24  184.71
137.84  132.69  134.12  176.37  139.34  144.49  144.52  157.12  186.38  187.70
119.39  121.69  120.96  116.52  127.01  120.21  126.14  129.91  173.17  175.08
122.14  121.71  121.60  120.84  126.77  128.63  136.31  136.56  166.25  168.95
125.68  126.36  126.23  125.50  131.75  132.36  138.56  142.03  191.87  195.38
120.30  120.58  120.62  118.45  126.10  122.06  123.23  133.10  179.79  181.12
131.15  131.16  132.38  151.17  137.53  141.64  170.38  148.74  186.28  193.32
145.19  146.36  145.35  195.34  152.55  174.54  174.25  191.18  217.05  224.13
127.68  124.43  127.46  143.37  129.13  141.13  140.38  151.05  181.11  187.88
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
123.21  123.74  123.76  128.33  129.08  130.75  135.54  140.42  179.00  182.50


[[2]] Speed
===========
A set of 23 images totalling 27,133,146 bytes
from ftp://www.cipr.rpi.edu/pub/image/still/KodakImages/color/
was used for this test and a 400 MHz PC with 192 Mb RAM and Windows98.

 Programs,options        Overall      Average      Compress Extract  Compressed
                          score,       Users'        time,   time,     size,
                                       score,       seconds seconds    bytes
                      seconds  %    seconds  %
no compression         7537   276%   7537   288%        0       0     27133146
pngcrush -q            4822   177%   4175   159%      719       -     14772830
pngcrush -q -loco      4140   152%   3516   134%      693       -     12409745
eri     a -3e03        2722   100%   2617   100%      116     112      8980915
eri     a -3e03 -h95   2738   100%   2617   100%      135     116      8954210
sbc c -m1 -b59         3770   138%   3659   139%      123      64     12900341
sbc c -m2 -b59         3525   129%   3376   129%      166      76     11821344
sbc c -m3 -b59         3563   130%   3395   129%      187      89     11838517
sbc c -m3 -b59 -a      3590   131%   3420   130%      189      88     11926526
sbc c -m3 -b59 -oa     3563   130%   3395   129%      187      89     11838517
sbc c -m3 -b59 -on     3565   130%   3402   130%      181      90     11860841
sbc c -m3 -b59 -os     3511   128%   3279   125%      258     128     11250407
sbc c -m3      -os     3566   130%   3378   129%      209      95     11745177
7z    a     -tzip      4443   163%   4369   166%       83       9     15666242
7z    a -mx -tzip      4487   164%   4370   166%      131       9     15649266
7z    a     -tufa1     4059   149%   3892   148%      186      19     13872996
7z    a -mx -tufa1     4058   149%   3891   148%      185      19     13872996
ace   a -d4096         3234   118%   3144   120%       99      26     11189907
ace32 a                3233   118%   3144   120%       99      26     11191619
ace32 a -d4096         3235   118%   3145   120%      100      26     11190095
ace32 a -d4096 -m1     3235   118%   3146   120%       98      26     11196635
ace32 a -d4096 -m5     3257   119%   3152   120%      117      26     11210655
ace32 a -d4096     -s- 3273   120%   3149   120%      138      26     11191243
ace32 a -d4096 -m1 -s- 3274   120%   3151   120%      137      26     11198127
ace32 a -d4096 -m5 -s- 3302   121%   3157   120%      162      26     11210935
rar   a                4588   168%   4466   170%      136       9     15996627
rar   a  -mm           3703   136%   3663   139%       45      20     13095126
rar   a  -mm -m1       3703   136%   3663   139%       44      20     13098345
rar   a  -mm -m5       3704   136%   3662   139%       47      20     13092151
rar   a  -mm     -mde  3703   136%   3662   139%       45      20     13095126
rar   a  -mm -m1 -mde  3703   136%   3663   139%       44      20     13098345
rar   a  -mm -m5 -mde  3704   136%   3662   139%       47      20     13092151
rar   a  -mm -s  -mde  3700   135%   3657   139%       47      20     13077240
rar32 a  -mm -s  -mde  3713   136%   3664   140%       54      26     13077240
UHarc a -m1            3621   133%   3336   127%      317      71     11641810
UHarc a -m2            3664   134%   3335   127%      366      70     11620323
UHarc a -m3            4024   147%   3346   127%      752      68     11531306
UHarc a -mx            4408   161%   3707   141%      778     652     10719512
UHarc a -mx -md8192    4412   162%   3711   141%      779     655     10719503
7zip  a                4440   163%   4369   166%       79      10     15666242
7zip  a -mx            4490   164%   4369   166%      134      10     15649266
alch  ---n             4709   172%   4419   168%      323      56     15594096
alch  ---n 0           4980   182%   4889   186%      100      47     17399494
alch  ---n 1           4534   166%   4365   166%      188      48     15475837
alch  ---n 2           4637   170%   4470   170%      185      48     15857298
alch  ---n 3           4662   171%   4459   170%      224      67     15736143
alch  ---n 4           4708   172%   4418   168%      322      55     15594095
arhangel a             5672   208%   4994   190%      753     737     15057230
arhangel a -mm -1      3430   126%   3200   122%      255     157     10867001
arhangel a -mm -2      3430   126%   3200   122%      255     157     10867001
arhangel a -mm -1 -2   3429   125%   3200   122%      254     157     10867001
bmf     -f             3026   111%   2953   112%       80      23     10522960
bmf     -f    -q9      3374   123%   2980   113%      437      22     10494756
bmf     -f -s          3349   123%   3047   116%      335     283      9832328
bmf     -f -s -q9      3871   142%   3100   118%      856     284      9832328
locoe  -c1             4145   152%   4121   157%       26      28     14730521
locoe  -c2             4163   152%   4135   158%       31      30     14770163
cbtpc                  4555   167%   4517   172%       42      25     16160698
lsp                    3243   119%   3199   122%       48      41     11357044
lsp    -f              3318   121%   3280   125%       42      36     11667530
lsp    -g              4244   155%   4207   160%       40      34     15011506
lsp    -fg             4294   157%   4262   162%       35      28     15232420
dc  e                  3519   129%   3338   127%      200      49     11772337
dc  e -b16300          3520   129%   3339   127%      201      49     11772337
dc  e -b16300 -mb5     3518   129%   3338   127%      199      49     11772337
display -bpng --same   4482   164%   4245   162%      263      16     15131718
imp     a -2  -s4      3806   139%   3740   142%       73      21     13365646
imp98   a              4586   168%   4528   173%       64       6     16261267
imp98   a     -m3      4591   168%   4504   172%       96       7     16156757
imp98   a -mm          4327   158%   4241   162%       95       7     15212564
imp98   a -mm -m3      4357   160%   4222   161%      150       8     15118784
imp98   a -mm -2       3797   139%   3733   142%       72      19     13345236
imp98   a -mm -s4      4314   158%   4225   161%       97       7     15154706
imp98   a -2  -s4      3804   139%   3739   142%       72      20     13365818
pkzip  -es             5528   203%   5511   210%       18       7     19812852
pkzip  -a              4658   171%   4629   176%       32       7     16630959
pkzip  -exx            4674   171%   4630   176%       48       7     16630245
pkzipc -add            4683   172%   4646   177%       40       9     16682715
pkzipc -add -max       4685   172%   4639   177%       50       9     16652375
pkzipc -add      -defl 4652   170%   4604   175%       53       9     16524036
pkzipc -add -max -defl 4667   171%   4594   175%       81       9     16481369
rk   -mf1              3894   143%   3785   144%      121      85     13278736
rk   -mf2              4213   154%   3939   150%      304     244     13196628
rk   -mf3              4457   163%   3946   150%      566     233     13166528
rk   -mx1              5681   208%   4722   180%     1065    1300     11938300
rk   -mx2              6218   228%   5015   191%     1336    1613     11770288
rk   -mx3              6679   245%   5233   199%     1606    1842     11629912
rkim     c             3276   120%   3118   119%      175     211     10405925
rkim     cx            3516   129%   3067   117%      499     243      9989608
uhic   e               3264   119%   3047   116%      240     243     10013246
uhic   m               3609   132%   3229   123%      422     441      9887092
zzip a                 3736   137%   3646   139%      100      57     12889383
zzip a -mm             3770   138%   3662   139%      119      59     12933183
zzip a -mm -mx         3770   138%   3662   139%      119      59     12932662

Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600 , because 28800 bits_per_second is 3600 bytes_per_second

Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.

Losslessly compressed with ERI32 to 8,748,580 bytes, this set can be found
at http://artest.virtualave.net/kodak/ and http://artest1.tripod.com/kodak/


[[3]] Details
=============
are no longer put to this main text
(872 lines reporting 17754 results on 538 files in 12 sets),
but can be found in FULL version with GRAPHICS.DAT and all *.BAT
at http://geocities.com/SiliconValley/Bay/1995/artest22.zip
or http://artest1.tripod.com/artest22.zip

1,2,3,4,9 image sets were taken from ftp://www.cipr.rpi.edu/pub/image/ and
/image2/ , converted from Sun Raster format to Windows Bitmap,
(this conversion changes image headers only, 32 bytes
are replaced by 54 bytes, but image data is not modified)

This site www.cipr.rpi.edu is described in comp.compression FAQ,
in 29 lines of "Subject: [55] Where can I find Lenna and other images?"

Eight images in the 5th set are from the famous Waterloo Color Set,
( losslessly compressed to 2,850,878 bytes,
it can be found at http://geocities.com/eri32 )

6,7,8th image sets are from ftp://download.intel.com/pressroom/images/
They were converted from TIFF format to Windows Bitmap.

10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/

Some images were slightly renamed. See GRAPHICS.DAT inside artest22.zip
for more details. Some new images (from download.intel.com) were not added yet.


[[4]] Comments
==============
Links to download programs:
~~~~~~~~~~~~~~~~~~~~~~~~~~~
7-Zip 2.24    :W http://www.7-zip.com/dl/7zip224.exe                              463K
ACE32 2.02    :W ftp://ftp.forlangs.net/pub/windows/winace/ace202.exe             587K
ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip            50K
BMF    1.1    :e ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/bmf_1_10.zip   132K
DC 0.98b      :W ftp://ftp.cdrom.com/.2/sac/pack/dc124.zip                         55K
ERI32 4.16fre :e http://geocities.com/eri32/eri416fr.zip                           94K
Imp     1.1   :e http://www.winimp.com/imp110d.zip                                266K
Imp-win 1.12  :W http://www.winimp.com/imp112.exe                                 122K
Pkzip   2.50  :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe     202K
PkzipC  4.00  :W ftp://ftp.pkware.com/pkzc400s.exe                               3470K
RK     1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe              380K
RKim   1.06   :W http://rksoft.virtualave.net/downloads/rkim106.zip                57K
RAR32  2.80   :e ftp://ftp.netlab.sk/public/rarsoft/rar/rarx280.exe               269K
WinRAR 2.80   :W ftp://ftp.netlab.sk/public/rarsoft/rar/wrar280.exe               621K
UHIC   1.0    :e ftp://ftp.elf.stuba.sk/pub/pc/pack/uhic10.zip                     52K
SBC 0.860b    :e http://geocities.com/sbcarchiver/sbc0860b.zip                    208K
ZZip 0.36c    :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip            35K

NK  1.0       :W ftp://tu.tusur.ru/pub/ImageTools/NK1.ZIP                          87K
JPEG-LS 1.00  :W http://www.hpl.hp.com/loco/jlsrefV100.zip                        325K
SPIHT  Nov'96 :W http://www.cipr.rpi.edu/research/SPIHT/EW_Code/lsp.exe            72K
BTPC   4.1    :W http://www.engr.mun.ca/~john/btpc4.1.zip                         715K
PngCrush 1.5.4:e http://download.sourceforge.net/pmt/pngcrush-1.5.4-DOS.zip       145K
Display 1.90b5:e http://www.freenet.edmonton.ab.ca/~crnelson/disp.exe             811K
SEA 1.3       :e ftp://ftp.elf.stuba.sk/pub/pc/graph/sea13.zip                    705K
Alchemy 1.10  :a ftp://ftp.elf.stuba.sk/pub/pc/graph/alch110.zip                 1462K

:a - any DOS  - DOS programs, will run under pure DOS or in a DOS box
:e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI
:W - windows  - Windows95/98/NT/etc programs

If direct link doesn't work-most probably newer version of the program appeared
at the same site: visit web page, or read the whole directory from ftp server
(i.e. try the same URL, but without filename).


Homepages:
~~~~~~~~~~
Arhangel     : http://geocities.com/SiliconValley/Lab/6606
Eri32        : http://geocities.com/eri32
      mirror : http://artest1.tripod.com
RK, RKim     : http://rksoft.virtualave.net
Imp,WinImp   : http://www.technelysium.com.au
      mirror : http://www.winimp.com
ACE,WinACE   : http://www.winace.com
Ufa,777,7-Zip: http://www.7-zip.com
PkZip        : http://www.pkware.com
RAR,WinRAR   : http://www.rarsoft.com
JPEG-LS      : http://www.hpl.hp.com/loco
PngCrush     : http://pmt.sourceforge.net/pngcrush
SPIHT        : http://www.ipl.rpi.edu/research/SPIHT
BTPC         : http://www.engr.mun.ca/~john/btpc.html
Display      : http://fn2.freenet.edmonton.ab.ca/~crnelson/display.html
Alchemy      : http://www.handmadesw.com/Products/Image_Alchemy.htm
SEA          : http://www.photodex.com/products/dos
SBC          : http://geocities.com/sbcarchiver
ZZip         : http://www.zzip.f2s.com


What's new:
~~~~~~~~~~~
3 new programs tested: ERI32 4.15fre, SBC 0.850b, PNGCrush 1.5.4.
Newer versions of SBC, ZZip and ERI32 are ready, they will be tested next time.

Results of BTPC, IMP and Ufa1 are in the full version only, see GRAPHICS.DAT.

Latest beta versions of DC, UFA, UHARC are available from authors by e-mail:
DC: EdgarBinder@t-online.de
UFA: support@7-zip.com
UHARC: Uwe.Herklotz@gmx.de


WARNINGS:
~~~~~~~~~
ZZip 0.36b can't losslessly decompress some images: kodak01 ... kodak17.bmp,
footbal* and susie* from 2nd set, moore2.bmp from 6th.

 ESP, Rkive and some other programs are not tested any more,
 their results and links can be found in previous versions:
 ESP   - artest3...artest12
 Rkive - 3...12
 UFA   - 3...12
 777   - 13...14
 BOA   - 7...14
 UHARC - 5...10
 SEA   - 12...19
 CompuShow 2000! - 3...11

The LATEST RELEASE, and all previous versions of these tests can be found
at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/

Send your suggestions, comments to artest@inbox.ru
With best kind regards,
A.Ratushnyak,
RAO Inc.
