How big is the measured performance difference?
Each chart bar shows how many times more Time or how many times more Memory some ↓ meteor-contest program used, compared to the program that used least Time or the program that used least Memory.
meteor-contest benchmark N=2,098
This table shows 5 measurements - CPU Time, Elapsed Time, Memory, Code and ~ CPU Load.
Compare how much Memory the meteor-contest programs used - sort Memory KB. Compare how much Code the programs used - sort Code B
Column × shows how many times more each program used compared to the program that used least.
| sort | sort | sort | sort | |||
|---|---|---|---|---|---|---|
| × | Program Source Code | CPU secs | Elapsed secs | Memory KB | Code B | ~ CPU Load |
| 1.0 | C++ GNU g++ #5 | 0.08 | 0.08 | ? | 5051 | 75% 0% 0% 15% |
| 1.0 | C++ GNU g++ #3 | 0.08 | 0.08 | ? | 4862 | 89% 50% 0% 0% |
| 1.1 | Pascal Free Pascal #3 | 0.09 | 0.09 | ? | 5467 | 0% 0% 100% 0% |
| 1.5 | Java 6 steady state #2 | 0.13 | 0.13 | 53,172 | 5238 | 4% 55% 45% 2% |
| 3.0 | Clean #2 | 0.24 | 0.24 | 432 | 3803 | 0% 100% 8% 0% |
| 3.1 | C++ GNU g++ #2 | 0.26 | 0.26 | 920 | 4080 | 0% 0% 100% 4% |
| 3.4 | Clean | 0.28 | 0.28 | 380 | 2893 | 0% 3% 0% 100% |
| 3.7 | Java 6 -server #2 | 0.42 | 0.31 | 3,348 | 5177 | 38% 26% 3% 71% |
| 4.8 | Lua LuaJIT #4 | 0.39 | 0.40 | 2,252 | 2047 | 0% 4% 100% 0% |
| 6.4 | Lua LuaJIT #3 | 0.52 | 0.52 | 2,124 | 1517 | 100% 0% 4% 0% |
| 6.4 | Lua LuaJIT #2 | 0.52 | 0.53 | 1,908 | 1477 | 0% 93% 0% 2% |
| 9.7 | Lua #4 | 0.79 | 0.79 | 1,892 | 2047 | 0% 100% 0% 1% |
| 11 | Haskell GHC #3 | 0.86 | 0.87 | 2,516 | 1801 | 0% 0% 1% 100% |
| 12 | Java 6 -server | 0.99 | 0.96 | 15,364 | 4368 | 89% 4% 1% 13% |
| 12 | Haskell GHC #2 | 0.98 | 0.98 | 2,612 | 1886 | 0% 0% 0% 99% |
| 12 | Lua #2 | 1.02 | 1.02 | 1,768 | 1477 | 0% 0% 1% 100% |
| 13 | Lua #3 | 1.03 | 1.03 | 1,576 | 1517 | 100% 0% 1% 0% |
| 13 | Lua LuaJIT | 1.08 | 1.09 | 2,056 | 1414 | 1% 96% 3% 1% |
| 15 | Haskell GHC | 1.25 | 1.25 | 2,548 | 2196 | 0% 100% 0% 0% |
| 18 | Java 6 -Xint #2 | 1.46 | 1.51 | 13,976 | 5177 | 1% 0% 0% 97% |
| 26 | Lua | 2.14 | 2.14 | 1,628 | 1414 | 100% 0% 0% 0% |
| 28 | Scheme PLT #2 | 2.28 | 2.28 | 10,624 | 1910 | 99% 0% 1% 1% |
| 35 | Scheme PLT | 2.87 | 2.88 | 11,120 | 1852 | 0% 0% 100% 1% |
| 41 | Haskell GHC #4 | 3.39 | 3.39 | 2,652 | 793 | 0% 0% 0% 100% |
| 71 | Scala #4 | 6.20 | 5.83 | 34,284 | 2592 | 1% 1% 99% 4% |
| 81 | Java 6 -Xint | 6.65 | 6.68 | 11,340 | 4368 | 0% 0% 0% 99% |
| 117 | Ruby JRuby #2 | 12.68 | 9.62 | 95,908 | 2786 | 13% 8% 16% 94% |
| 121 | Ruby 1.9 #2 | 9.89 | 9.89 | 3,348 | 2786 | 0% 100% 0% 0% |
| 137 | Python 3 #2 | 11.24 | 11.24 | 4,344 | 1311 | 0% 100% 0% 0% |
| 149 | Python CPython #3 | 12.20 | 12.20 | 3,360 | 1198 | 100% 0% 0% 0% |
| 157 | Python 3 #3 | 12.90 | 12.91 | 4,612 | 1206 | 100% 0% 0% 0% |
| 158 | Ruby JRuby | 16.02 | 12.93 | 89,504 | 2768 | 8% 6% 12% 98% |
| 160 | Ruby 1.9 | 13.13 | 13.12 | 3,440 | 2768 | 0% 0% 0% 100% |
| 180 | Python CPython #2 | 14.75 | 14.75 | 3,068 | 1294 | 0% 0% 0% 100% |
| 182 | Python 3 | 14.91 | 14.91 | 4,208 | 1442 | 0% 0% 100% 0% |
| 231 | Python CPython | 18.94 | 18.93 | 2,996 | 1418 | 0% 0% 0% 100% |
| 257 | Ruby MRI #2 | 21.09 | 21.09 | 2,596 | 2786 | 0% 100% 0% 0% |
| 367 | Ruby MRI | 30.13 | 30.13 | 2,832 | 2768 | 0% 0% 0% 100% |
| 35,204 | PHP | 48 min | 48 min | 11,324 | 2582 | 2% 1% 100% 1% |
| Haskell GHC #5 | Make Error | 2908 | ||||
| interesting alternative programs | ||||||
| 433 | Scala #3 | 35.74 | 35.52 | 19,576 | 2399 | |
| 1,059 | Scala #2 | 87.57 | 86.83 | 122,416 | 2355 | |
| 4,229 | Scala | 347.47 | 346.75 | 55,980 | 2364 | |
| missing programs | ||||||
| Ada 2005 GNAT | No program | |||||
| ATS | No program | |||||
| C GNU gcc | No program | |||||
| C# Mono | No program | |||||
| Erlang HiPE | No program | |||||
| F# Mono | No program | |||||
| Fortran Intel | No program | |||||
| Go 6g 8g | No program | |||||
| JavaScript TraceMonkey | No program | |||||
| JavaScript V8 | No program | |||||
| Lisaac | No program | |||||
| Lisp SBCL | No program | |||||
| Mozart/Oz | No program | |||||
| OCaml | No program | |||||
| Perl | No program | |||||
| Smalltalk VisualWorks | No program | |||||
meteor-contest benchmark : Search for solutions to shape packing puzzle
This is a contest - different algorithms may be used.
You are expected to diff the output from your program N = 2098 against this output file before you contribute your program.
The Meteor Puzzle board is made up of 10 rows of 5 hexagonal Cells. There are 10 puzzle pieces to be placed on the board, we'll number them 0 to 9. Each puzzle piece is made up of 5 hexagonal Cells. As different algorithms may be used to generate the puzzle solutions, we require that the solutions be printed in a standard order and format. Here's one approach - working along each row left to right, and down the board from top to bottom, take the number of the piece placed in each cell on the board, and create a string from all 50 numbers, for example the smallest puzzle solution would be represented by
00001222012661126155865558633348893448934747977799
Print the smallest and largest Meteor Puzzle 50 character solution string in this format to mimic the hexagonal puzzle board:
0 0 0 0 1 2 2 2 0 1 2 6 6 1 1 2 6 1 5 5 8 6 5 5 5 8 6 3 3 3 4 8 8 9 3 4 4 8 9 3 4 7 4 7 9 7 7 7 9 9
The command line parameter N should limit how many solutions will be found before the program halts, so that you can work with just a few solutions to debug and optimize your program.
Diff program output N = 2098 against the output file to check the format is correct.
Notes
- the printSolutions() method in the Scala program provides one example of how to print the solutions.
- the printBoardCellsAndNeighbours() method in the Scala program provides an example of how to print the puzzle board (Save Target As… Save Link As…) to check that the board cells are joined up correctly.
cell NW NE W E SW SE 0 -- -- -- 01 -- 05 1 -- -- 00 02 05 06 2 -- -- 01 03 06 07 3 -- -- 02 04 07 08 4 -- -- 03 -- 08 09 5 00 01 -- 06 10 11 6 01 02 05 07 11 12 7 02 03 06 08 12 13 8 03 04 07 09 13 14 9 04 -- 08 -- 14 -- 10 -- 05 -- 11 -- 15 11 05 06 10 12 15 16 12 06 07 11 13 16 17 13 07 08 12 14 17 18 14 08 09 13 -- 18 19 15 10 11 -- 16 20 21 16 11 12 15 17 21 22 17 12 13 16 18 22 23 18 13 14 17 19 23 24 19 14 -- 18 -- 24 -- 20 -- 15 -- 21 -- 25 21 15 16 20 22 25 26 22 16 17 21 23 26 27 23 17 18 22 24 27 28 24 18 19 23 -- 28 29 25 20 21 -- 26 30 31 26 21 22 25 27 31 32 27 22 23 26 28 32 33 28 23 24 27 29 33 34 29 24 -- 28 -- 34 -- 30 -- 25 -- 31 -- 35 31 25 26 30 32 35 36 32 26 27 31 33 36 37 33 27 28 32 34 37 38 34 28 29 33 -- 38 39 35 30 31 -- 36 40 41 36 31 32 35 37 41 42 37 32 33 36 38 42 43 38 33 34 37 39 43 44 39 34 -- 38 -- 44 -- 40 -- 35 -- 41 -- 45 41 35 36 40 42 45 46 42 36 37 41 43 46 47 43 37 38 42 44 47 48 44 38 39 43 -- 48 49 45 40 41 -- 46 -- -- 46 41 42 45 47 -- -- 47 42 43 46 48 -- -- 48 43 44 47 49 -- -- 49 44 -- 48 -- -- --
The Meteor Puzzle and 3 Java puzzle solvers are described in "Optimize your Java application's performance" (pdf).
