RISC OS Benchmarks

Benchmarks showing Titanium, 5432EVM, IGEPv5, ARMX6, Pandaboard ES, Beagleboard XM, Raspberry Pi models A+, B+, 2 B and 3 B, Iyonix and Virtual Risc PC are shown in the table below. Although the benchmarks are expressed in percentages (where 100%=SA202 RiscPC running RISC OS 4.02), actual performance figures for a Risc PC are also shown to allow more direct comparision. Note also that the 'disc' speeds (quoted in Mbyte/s for HD read/write [based on loading/saving an 8Mbyte file as many times as can be done in one second] and quoted in kbyte/s for FS read/write [based on BPut/BGet operations for one second]) are compared to 100% on Risc PC when the Risc PC is accessing its hard disc. To allow comparison with Risc PC when using the same medium, speeds for Risc PC are also quoted. The ROMark programme used to generate the benchmarks is available here.

These benchmarks have been updated and some 'real-world' tasks included to give an indication of overall performance. A 'mixed memory and processor' test has been added - this uses the application !CountDn to calculate the 24 million possible arrangements of the 2, 3, 5, 7, 50 and 75 tiles using all possible combinations of arithmetic operator - for those that like exact figures, it is 24,694,290 [= 2C6 × 6 × (1 + 2C5 × 6 × (1 + 2C4 × 6 × (1 + 2C3 × 6 × (1 + 2C2 × 6)))) ] - the time taken is given in centi-seconds and allows a comparison characterising computational tasks that make few disc accesses.

An 'overall performance' test has been added (this unpacks the ROM source and compiles it, based on the BCM2835 rom image of 22-Jul-2014) - the time taken is given for each. This allows more disc-intensive computational tasks to be compared. The fastest time so far is on the Pandaboard using a 500Mbyte RAMFS drive: unpacking takes 41s and compiling takes 4min54sec. Comparison with ARMX6 is not currently possible: the maximum RAMFS size is determined at ROM compile time as it is hard-coded and the ARMx6 RAMFS size limit is currently 128Mbytes.

The disc speed tests now also now include a test of RAMFS speed and use an 8Mbyte file for load and save (HD read and HD write) to make sure it is larger than the cache. Disc speed in 'real-world' applications is correlated much more strongly with FS read/write (BPUT & BGET) than with HD read/write (LOAD & SAVE).

Most of the benchmarks quoted are for the latest (2015/16) hardware and software. The ARMini/Beagleboard XM (2013), Iyonix (2010) and Risc PC (1999) are exceptions as although these are recent tests, they use hardware/software from the date stated. For Virtual Risc PC the machine is an Intel i5-3470 processor running at 3.2GHz fitted with a fast Samsung 500GB SSD running Windows 7 Home Premium SP1 4GB using Virtual Risc PC Adjust version 1.6 - i.e. 2015 hardware and software so that the year quoted (2004) is a little misleading in this case!

Benchmarks which test a single machine parameter such as 'processor' can be misleading. For example on VRPC that would just test the efficiency of the JIT compiler for the particular machine code instructions concerned whereas on native hardware it reflects the processor speed directly. I have therefore added another 'real world' performance indicator which is the rendering of the ArtWorks Apple, which the Risc PC can do 9.06 times a second at 32k colours(a little faster at 256 colours). This is 100% in the 'draw render' test added below. On real world tests, therefore, native ARM hardware is now definitely faster than emulated hardware such as VRPC.

Machine/Test Titanium
250/1500 MHz
5432EVM
500/1500 MHz
IGEPv5
500/1500 MHz
ARMX6
324/1008 MHz
Pandabd ES
350/1200 MHz
Virtual Risc PC
3192MHz
ARMini
BBXM
1000MHz
Raspberry Pi 600/1200MHz
Model 3 B RC14+
Raspberry Pi 700/1000MHz
Zero RC14+
Raspberry Pi 600/1000MHz
Model B2 RC14+
Raspberry Pi 850MHz
Model B1+ RC14+
Iyonix
600 MHz
Risc PC Notes
RAM (max speed MB/s) 2GB 533MHz DDR3 (8528) 2GB 4GB 1066MHz DDR3 (8500) 2GB 528MHz DDR3 (8400) 1GB 400MHz DDR2 (6400) 4GB / 139MB 512MB 166MHz DDR (1333) 1 GB 512 MB 1GB 512 MB 512MB 200MHz DDR (3200) 98MB 16MHz (64)
Processor
(equiv. RPC)
2117%
(4289MHz)
2140%
(4335MHz)
2090%
(4234MHz)
1064%
(2155MHz)
1050%
(2127MHz)
344%
(696MHz)
578%
(1171MHz)
1371%
(2775MHz)
(673% = slow)
392%
(794MHz)
(267% = slow)
683%
(1380MHz)
(401% = slow)
332%
(672MHz)
260%
(526MHz)
115%
(233MHz)
Memory
(equiv. RPC)
20870%
(3180MHz)
18571%
(2830MHz)
20688%
(3152MHz)
4722%
(720MHz)
5612%
(855MHz)
3804%
(580MHz)
1692%
(258MHz)
20117%
(3065MHz)
946%
(145MHz)
8850%
(1350MHz)
1391%
(212MHz)
161%
(24MHz)
105%
(16MHz)
Varies with
Rect Copy 1259% 1150% 1130% 158% 878% 925% 194% 603%607% 602% 638% 1178% 52% resolution
Icon Plotting 1984% 2051% 2286% 1006% 642% 662% 403% 1191%817% 1127% 702% 185% 90% 1920x1080C16M
Draw Path 739% 755% 759% 359% 425% 258% 243% 364%619% 473% 537% 94% 99% shown here
Draw Fill 1163% 1162% 1157% 415% 308% 356% 195% 105%107% 77% 92% 56% 54%
HD Read MB/s 165.4 (5547%) 186 (6255%) 162 (5439%) 165 (5547%) 265 (8887%) 1135 (38079%) 36.2 (1215%) 66.4 (2227%)118.1 (3962%) 126.0 (4226%) 109.2 (3662%) 14.8 (494%) 20.5 (686%)  
HD Wr MB/s 462.3 (15202%) 1038 (34139%) 522 (17166%) 159 (5230%) 345 (11356%) 1127 (37073%) 146 (4800%) 220.5 (7252%)110.2 (3626%) 364.9 (12002%) 102.4 (3367%) 39.8 (1307%) 20.5 (673%)  
FS Read kB/s 3555 (1717%) 3520 (1700%) 3143 (1518%) 7038 (3400%) 8317 (4017%) 5103 (2465%) 3879 (1873%) 5727 (2766%)4412 (2131%) 5165 (2495%) 3746 (1809%) 2970 (1434%) 1756 (848%) RAMFS
FS Write kB/s 3762 (1959%) 3623 (1886%) 3324 (1731%) 7198 (3748%) 8467 (4409%) 3102 (1615%) 4276 (2227%) 6172 (3214%)4608 (2400%) 5526 (2878%) 3866 (2013%) 3354 (1746%) 1722 (896%) 128Mb
HD Read MB/s 2.1 (71%) 3.4 (114%) 12.3 (413%) 1.8 (63%) 5.2 (174%) 6.8 (228%) 2.3 (78%) 10.5 (352%)8.1 (271%) 10.1 (341%) 9.5 (319%) 8.5 (286%) 0.8 (26%)
HD Wr MB/s 18.4 (607%) 3.8 (127%) 8.3 (274%) 14.6 (481%) 7.0 (230%) 9.6 (317%) 2.9 (96%) 8.1 (268%)5.4 (179%) 7.5 (247%) 5.9 (195%) 5.5 (180%) 0.7 (22%) Network
FS Read kB/s 1705 (823%) 660 (318%) 998 (482%) 1347 (650%) 994 (480%) 3455 (1669%) 50 (24%) 1325 (640%)842 (406%) 1094 (528%) 744 (359%) 657 (317%) 101 (48%) LanMan98
FS Write kB/s 1559 (811%) 403 (209%) 486 (253%) 551 (286%) 493 (256%) 245 (127%) 50 (26%) 577 (300%)693 (360%) 492 (256%) 327 (170%) 303 (157%) 87 (45%) & NAS
HD Read MB/s 6.2 (208%) 5.1 (173%) 5.0 (169%) 6.2 (209%) 2.0 (69%) 1.0 (32%) 2.0 (68%) 5.4 (183%)5.7 (193%) 5.4 (183%) 5.0 (168%) 2.4 (81%) 0.6 (18%)
HD Wr MB/s 6.2 (204%) 5.1 (169%) 5.2 (172%) 6.2 (205%) 6.2 (205%) 1.0 (33%) 3.0 (99%) 6.0 (199%)5.3 (177%) 6.0 (199%) 5.5 (180%) 2.8 (93%) 0.6 (19%) Network
FS Read kB/s 101 (48%) 101 (48%) 101 (48%) 101 (48%) 101 (48%) 87 (42%) 101 (48%) 101 (48%)101 (48%) 100 (48%) 101 (48%) 102 (49%) 110 (53%) ShareFS
FS Write kB/s 101 (52%) 82 (42%) 101 (52%) 101 (52%) 101 (52%) 89 (46%) 101 (52%) 101 (52%)101 (52%) 101 (52%) 101 (52%) 41 (21%) 98 (51%)
HD Read MB/s 22.1 (742%) - 21.7 (729%) 13.7 (461%) 21.9 (735%) - 17.4 (584%) 11.7 (392%)21.3 (716%) 15.7 (528%) 21.9 (735%) - - SDFS test
HD Wr MB/s 11.6 (382%) - 13.8 (456%) 10.5 (345%) 14.8 (489%) - 13.3 (438%) 18.7 (616%)16.7 (549%) 17.9 (589%) 18.2 (598%) - - using a
16 GB
FS Read kB/s 1352 (653%) - 575 (277%) 1241 (599%) 1192 (575%) - 526 (254%) 731 (353%)525 (253%) 601 (290%) 675 (326%) - - HCI class
FS Write kB/s 447 (232%) - 257 (133%) 442 (230%) 449 (233%) - 308 (160%) 338 (176%)295 (153%) 325 (169%) 335 (174%) - - 10 µSD card
HD Read MB/s 27.3 (915%) - 15.6 (523%) 18.6 (624%) 17.8 (597%) - 11.6 (389%) 18.2 (610%)20.3 (681%) 18.6 (624%) 20.8 (698%) - - SCSI Pen
HD Wr MB/s 5.5 (182%) - 5.3 (174%) 7.1 (236%) 7.5 (249%) - 3.8 (125%) 5.3 (176%)3.9 (129%) 7.3 (240%) 5.5 (180%) - - drive 16GB
FS Read kB/s 499 (241%) - 166 (80%) 163 (78%) 165 (79%) - 140 (67%) 325 (157%)141 (68%) 257 (124%) 172 (83%) - - DT R500
FS Write kB/s 108 (56%) - 83 (43%) 78 (40%) 79 (41%) - 72 (37%) 97 (50%)78 (40%) 89 (46%) 79 (41%) - - USB pen drive
HD Read MB/s 119.3 (4000%) 18.7 (629%) 181.1 (6075%) 79.5 (2667%) 21.9 (735%) 615 (20637%) 15.9 (533%) 11.8 (398%)22.7 (763%) 15.7 (528%) 22.1 (742%) 23 (774%) 1.8 (59%)
HD Wr MB/s 87.4 (2876%) 17.1 (565%) 144.5 (4753%) 91.0 (2993%) 7.3 (240%) 464 (15269%) 13.7 (453%) 4.7 (157%)21.0 (690%) 5.5 (180%) 10.9 (359%) 12 (396%) 1.7 (54%) Hard disc
FS Read kB/s 2557 (1235%) 135 (65%) 2135 (1031%) 1982 (957%) 913 (441%) 4922 (2377%) 472 (228%) 631 (384%)671 (324%) 415 (200%) 482 (232%) 1485 (717%) 789 (381%)
FS Write kB/s 2595 (1351%) 135 (70%) 2552 (1329%) 1809 (942%) 134 (69%) 1765 (919%) 219 (114%) 103 (53%)397 (206%) 148 (77%) 83 (43%) 317 (165%) 102 (53%)
Machine/Test Titanium 250/1500 MHz 5432EVM 1500 MHz IGEPv5 500/1500 MHz ARMX6
324/1008 MHz
Pandabd ES
350/1200 MHz
Virtual Risc PC
3192MHz
ARMini
BBXM
1000MHz
Raspberry Pi 600/1200MHz
Model 3 RC14+
Raspberry Pi 700/1000MHz
Zero RC14+
Raspberry Pi 600/1000MHz
Model B2 RC14+
Raspberry Pi 850MHz
Model B1+ RC14+
Iyonix
600 MHz
Risc PC Notes
Cold boot time 13s 46s 35s 15s 35s 60s 48s 14s11s 18s 16s 39s 44s Start up time
!CountDn calc. time 13cs 12cs 12cs 17cs 15cs 26cs 21cs 17cs26cs 23cs 30cs 40cs 101cs Memory plus processor
ROM unpack
(with RAMfs)
56s
(24s)
3m38
(22s)
43s
(23s)
92s
(49s)
348s
(41s)
103s 183s -320s 862s
(71s)
1062s 311s 1440s Overall performance
ROM compile
(with RAMfs)
4m19s
(3m38s)
10m38s
(3m44s)
5m2s
(3m28s)
8m32s
(7m37s)
14min
(5 min)
20min 22min -18min12s ** 22min
(8m23s)
29min 37min - Overall performance
Rendering the ArtWorks Apple 1733% - 1896% 916% 682% 494% 463% 301%300% 233% 264% - 100% Overall performance
RISC OS 5.23
17 Mar 2016
5.23
20 Aug 2015
5.23
12 Mar 2016
5.23
10 Jan 2016
5.22
8 Apr 2015
4.39
28 Apr 2004
5.20
10 Jun 2013
5.23
29 Mar 2016
5.23
29 Mar 2016
5.23
29 Mar 2016
5.23
20 Dec 2015
5.16
18 Jan 2010
4.02
10 Aug 1999
 
Screen res. 1920x1200 1680x1050 1920x1200 3440x1440 1920x1080 1920x1080 1920x1080 1920x1080 1920x1080 1920x1080 1920x1080 1440x900 1024x768
Screen colours 16M 16M 16M 16M 16M 16M 16M 16M 16M 16M 16M 16M 32k
Hard disc 250Gb Critical MX200 SSD (500MB/s) 120Gb SSD HDD via USB 120Gb SSD HDD SATA 250Gb Critical MX200 SSD (500MB/s) 32Gb Sandisk class 10 (45MB/s)
SD card
500Gb SSD HDD FAT32fs 96G SSD 8GB Samsung class 1016Gb Samsung class 10
µSD card
90MB/s
8Gb Sandisk class 10
µSD card
8Gb Sandisk class 10
µSD card
112G PATA DMA HDD 8G HDD

Benchmarks for Pandaboard ES running at 1500MHz have been withdrawn due to the unstability/limited lifetime of that platform at that speed.
Note: timings for the Compute Module are very similar to those for the model B+, reading/writing to eMMC being 10Mbytes/s.

Benchmarks for CJE Micros IGEPv5 have also now been included, updated for SmartReflex at 1500MHz. Benchmarks for the 5432EVM board from svtronics (which uses the same OMAP5432 chip) have also been added. Benchmarks for the Elesar Titanium board, which uses the TI AM5728, have also been added.

Benchmarks for the Pi model Zero using a USB hub and an AX8872B-based USB to Ethernet dongle (which requires EtherUSB 0.35 20-Dec-2015 or later) with RC14 but with the latest (Nov 2015) firmware, the necessary instructions for the Zero to run at its rated cpu speed of 1000MHz and the latest (20 Dec 2015) ROM have also been added (and are almost identical to timings with a model A+ - note ** - including ZeroPain logging reports for the DDE (!!) ).

Benchmarks for the Pi model 3, which requires an updated ROM to include ARMv8 changes, with RC14 but with the latest (29 Mar 2016) firmware, (instructions for the model 2 to be overclocked to 1000MHz, optional) and the latest (29-Mar-2016) ROM have also been added. Not all software runs yet on the model 3 - LANMAN98 requires a kludged ZeroPain module, whilst Netsurf and !UnTarBZ2 fail and need to be recompiled.

The sharefs test on the Titanium has been repeated: previously sharefswindow was 2 both on Titanium and on the ARMX6 target machine. Changing this to 1 both ends improved HD write speed from 0.016 to 6.2 MB/s, i.e. a 400-fold increase!

Benchmarks are quoted for 'hard disc' performance - in some cases this is SD card, for some it is SATA SSD, for some it is a SCSIFS pen drive and for some a PATA hard disc with DMA: in each case the nature of the hard disc is quoted. To give a comparison on equal terms, I have also quoted SDFS and SCSI pen drive speeds for a Sandisk fast HCI class 10 SD card (not all class 10 cards are equal - this card is faster than a 90MB/s Samsung card as some are optimised for sequential writes only) and for a Kingston 16GB SCSI pen drive, using the same device on all platforms.