How big is the measured performance difference?
Each chart bar shows how many times more Time or how many times more Memory one unidentified ↓ spectral-norm program used, compared to the program that used least Time or the program that used least Memory.
spectral-norm benchmark N=5,500
This table shows 5 measurements - CPU Time, Elapsed Time, Memory, Code and ~ CPU Load.
Compare how much Memory the spectral-norm programs used - sort Memory KB. Compare how much Code the programs used - sort Code B
Column × shows how many times more each program used compared to the program that used least.
| sort | sort | sort | sort | |||
|---|---|---|---|---|---|---|
| × | Program Source Code | CPU secs | Elapsed secs | Memory KB | Code B | ~ CPU Load |
| 1.0 | C GNU gcc #4 | 11.87 | 2.99 | 772 | 1139 | 99% 100% 99% 99% |
| 1.0 | C++ GNU g++ #7 | 11.89 | 2.99 | 1,196 | 1114 | 100% 99% 99% 99% |
| 1.3 | Ada 2005 GNAT #3 | 15.69 | 3.98 | 2,528 | 1702 | 98% 99% 98% 99% |
| 1.3 | Fortran Intel | 15.93 | 4.00 | 1,276 | 568 | 99% 99% 100% 100% |
| 1.4 | Haskell GHC | 16.02 | 4.11 | 2,260 | 869 | 96% 99% 96% 99% |
| 1.4 | Java 6 steady state #2 | 17.14 | 4.31 | 24,620 | 1027 | 99% 99% 99% 99% |
| 1.5 | Java 6 -server #2 | 17.33 | 4.51 | 15,208 | 950 | 98% 95% 94% 97% |
| 1.5 | Scala #2 | 17.66 | 4.56 | 20,720 | 720 | 96% 96% 97% 98% |
| 1.6 | Ada 2005 GNAT #2 | 18.75 | 4.74 | 3,012 | 1464 | 99% 99% 99% 98% |
| 1.9 | C# Mono #2 | 22.29 | 5.62 | 5,368 | 1063 | 99% 99% 99% 99% |
| 2.0 | ATS #2 | 22.06 | 5.96 | 1,656 | 2339 | 92% 92% 93% 93% |
| 2.0 | Lisp SBCL #3 | 22.22 | 6.01 | 7,476 | 883 | 92% 92% 93% 93% |
| 2.1 | OCaml #3 | 20.02 | 6.21 | 3,304 | 907 | 79% 79% 81% 81% |
| 2.2 | Go 6g 8g #2 | 26.34 | 6.59 | 1,472 | 545 | 100% 100% 100% 100% |
| 4.1 | Erlang HiPE #2 | 47.70 | 12.18 | 13,348 | 747 | 98% 98% 97% 98% |
| 5.3 | Fortran Intel #2 | 15.70 | 15.70 | 1,100 | 513 | 0% 0% 100% 0% |
| 5.3 | Lisp SBCL | 15.73 | 15.72 | 8,524 | 625 | 0% 0% 100% 0% |
| 5.3 | Haskell GHC #3 | 15.94 | 15.94 | 1,812 | 737 | 0% 0% 0% 100% |
| 5.5 | Java 6 -server | 16.57 | 16.42 | 15,908 | 514 | 100% 0% 1% 0% |
| 5.5 | Scala | 16.57 | 16.43 | 16,560 | 500 | 0% 0% 100% 0% |
| 6.3 | Pascal Free Pascal | 18.79 | 18.79 | 192 | 423 | 0% 0% 0% 100% |
| 6.8 | OCaml #2 | 20.24 | 20.24 | 1,788 | 377 | 100% 0% 0% 0% |
| 6.8 | Clean | 20.25 | 20.25 | 1,448 | 572 | 0% 0% 0% 100% |
| 7.3 | Ada 2005 GNAT | 21.76 | 21.76 | 1,612 | 710 | 0% 0% 0% 100% |
| 7.4 | ATS | 22.26 | 22.26 | 664 | 1179 | 0% 0% 100% 0% |
| 7.5 | C# Mono | 22.31 | 22.31 | 4,996 | 459 | 0% 0% 0% 100% |
| 7.5 | F# Mono | 22.37 | 22.37 | 7,364 | 514 | 0% 0% 0% 100% |
| 8.4 | Java 6 -Xint #2 | 94.67 | 25.18 | 12,952 | 950 | 93% 94% 92% 98% |
| 8.8 | Go 6g 8g | 26.32 | 26.32 | 1,548 | 420 | 100% 0% 0% 0% |
| 11 | C++ GNU g++ | 32.81 | 32.81 | 1,276 | 452 | 0% 8% 0% 100% |
| 11 | C GNU gcc | 33.77 | 33.77 | 684 | 382 | 0% 100% 0% 0% |
| 20 | JavaScript TraceMonkey | 58.40 | 58.41 | 4,428 | 311 | 0% 100% 0% 0% |
| 22 | Erlang HiPE | 64.45 | 64.45 | 11,692 | 507 | 100% 0% 0% 0% |
| 30 | JavaScript V8 | 90.45 | 90.45 | 24,040 | 311 | 0% 100% 0% 0% |
| 31 | Haskell GHC #2 | 92.61 | 91.19 | 12,256 | 396 | 1% 100% 1% 1% |
| 44 | Java 6 -Xint | 131.08 | 131.11 | 13,536 | 514 | 0% 100% 0% 0% |
| 63 | Scheme PLT #2 | 187.38 | 187.38 | 12,640 | 419 | 0% 0% 0% 100% |
| 64 | Lua | 190.68 | 190.70 | 1,492 | 329 | 61% 38% 0% 0% |
| 73 | Python CPython #5 | 14 min | 218.69 | 28,068 | 428 | 99% 99% 99% 99% |
| 73 | Lua #3 | 218.84 | 218.83 | 1,480 | 328 | 0% 0% 0% 100% |
| 74 | PHP #3 | 13 min | 222.43 | 26,320 | 1193 | 88% 89% 91% 100% |
| 96 | Perl #3 | 18 min | 285.55 | 10,976 | 846 | 100% 100% 100% 100% |
| 261 | PHP #2 | 13 min | 13 min | 7,860 | 397 | 100% 0% 0% 0% |
| 264 | Ruby JRuby | 13 min | 13 min | 230,184 | 292 | 1% 1% 1% 99% |
| 278 | Python CPython | 13 min | 13 min | 4,500 | 378 | 0% 0% 0% 100% |
| 373 | Perl #2 | 18 min | 18 min | 4,240 | 343 | 0% 0% 0% 100% |
| 477 | Perl | 23 min | 23 min | 3,748 | 355 | 16% 84% 0% 0% |
| 752 | Ruby MRI | 37 min | 37 min | 4,288 | 292 | 0% 1% 0% 100% |
| Smalltalk VisualWorks #2 | Failed | 438 | ||||
| interesting alternative programs | ||||||
| 1.5 | C GNU gcc #2 | 4.50 | 4.50 | 237,056 | 669 | |
| 3.8 | Python CPython #2 | 11.32 | 11.33 | 473,092 | 233 | |
| 222 | Python CPython #4 | 663.34 | 663.36 | 4,608 | 281 | |
spectral-norm benchmark : Eigenvalue using the power method
diff program output N = 100 with this output file to check your program is correct before contributing.
Each program should calculate the spectral norm of an infinite matrix A, with entries a11=1, a12=1/2, a21=1/3, a13=1/4, a22=1/5, a31=1/6, etc
Each program must implement 4 separate functions / procedures / methods like the C# program.
For more information see challenge #3 in Eric W. Weisstein, "Hundred-Dollar, Hundred-Digit Challenge Problems" and "Spectral Norm".
From MathWorld--A Wolfram Web Resource.
http://mathworld.wolfram.com/Hundred-DollarHundred-DigitChallengeProblems.html
http://mathworld.wolfram.com/SpectralNorm.html
Thanks to Sebastien Loisel for this benchmark.