How big is the measured performance difference?
Each chart bar shows how many times more Time or how many times more Memory one unidentified ↓ regex-dna program used, compared to the program that used least Time or the program that used least Memory.
regex-dna benchmark ~50MB N=5,000,000
This table shows 5 measurements - CPU Time, Elapsed Time, Memory, Code and ~ CPU Load.
Compare how much Memory the regex-dna programs used - sort Memory KB. Compare how much Code the programs used - sort Code B
Column × shows how many times more each program used compared to the program that used least.
| sort | sort | sort | sort | |||
|---|---|---|---|---|---|---|
| × | Program Source Code | CPU secs | Elapsed secs | Memory KB | Code B | ~ CPU Load |
| 1.0 | JavaScript V8 #2 | 5.32 | 5.33 | 215,404 | 373 | 0% 0% 0% 100% |
| 2.0 | JavaScript TraceMonkey | 10.79 | 10.79 | 636,800 | 365 | 0% 0% 0% 100% |
| 2.2 | JavaScript TraceMonkey #2 | 11.78 | 11.78 | 571,392 | 373 | 0% 0% 0% 100% |
| 2.4 | C++ GNU g++ #4 | 12.64 | 12.64 | 100,436 | 1759 | 0% 0% 0% 100% |
| 3.0 | C++ GNU g++ | 15.83 | 15.84 | 100,020 | 1588 | 0% 0% 0% 100% |
| 3.7 | OCaml #3 | 19.73 | 19.74 | 389,536 | 892 | 0% 0% 0% 100% |
| 3.7 | OCaml | 19.80 | 19.80 | 389,532 | 1261 | 0% 0% 0% 100% |
| 3.8 | OCaml #2 | 20.47 | 20.46 | 389,564 | 615 | 0% 0% 0% 100% |
| 4.6 | C GNU gcc #4 | 24.47 | 24.47 | 83,264 | 1525 | 0% 0% 0% 100% |
| 4.6 | C++ GNU g++ #3 | 24.51 | 24.50 | 126,464 | 1599 | 0% 0% 0% 100% |
| 4.8 | Java 6 -server #5 | 25.35 | 25.40 | 683,724 | 929 | 0% 0% 0% 100% |
| 4.9 | Java 6 -server #4 | 25.98 | 25.98 | 817,304 | 921 | 0% 0% 0% 100% |
| 5.0 | Python CPython | 26.84 | 26.84 | 210,956 | 342 | 0% 0% 0% 100% |
| 5.9 | C GNU gcc #2 | 31.33 | 31.33 | 124,780 | 1099 | 0% 0% 0% 100% |
| 6.0 | ATS | 31.72 | 31.72 | 172,580 | 2551 | 0% 0% 0% 100% |
| 6.1 | Scala #3 | 32.27 | 32.32 | 972,872 | 659 | 0% 0% 0% 100% |
| 6.2 | Scheme PLT | 32.93 | 32.93 | 631,892 | 835 | 0% 0% 0% 100% |
| 6.2 | Scheme PLT #2 | 33.05 | 33.05 | 632,532 | 669 | 0% 0% 0% 100% |
| 6.5 | Java 6 -server #2 | 34.68 | 34.69 | 811,440 | 1534 | 0% 0% 0% 100% |
| 7.3 | Perl #2 | 38.78 | 38.78 | 165,064 | 527 | 0% 0% 0% 100% |
| 7.9 | Lisp SBCL #3 | 42.24 | 42.24 | 817,660 | 1948 | 0% 0% 0% 100% |
| 8.2 | Ada 2005 GNAT | 43.94 | 43.94 | 176,376 | 3334 | 0% 0% 0% 100% |
| 9.0 | Perl #4 | 48.21 | 48.21 | 891,368 | 440 | 0% 0% 0% 100% |
| 9.1 | PHP #2 | 48.55 | 48.55 | 194,852 | 449 | 0% 0% 0% 100% |
| 9.3 | Scala #2 | 49.48 | 49.50 | 1,034,596 | 1520 | 0% 0% 0% 100% |
| 9.8 | Lisp SBCL | 52.45 | 52.45 | 2,567,852 | 591 | 0% 0% 0% 100% |
| 10 | Ruby MRI | 52.97 | 52.97 | 350,232 | 323 | 0% 0% 0% 100% |
| 14 | Ruby JRuby | 74.33 | 74.38 | 532,756 | 323 | 0% 0% 0% 100% |
| 16 | C# Mono #6 | 83.49 | 83.50 | 627,388 | 638 | 0% 0% 0% 100% |
| 16 | C# Mono | 84.54 | 84.54 | 2,663,964 | 624 | 0% 0% 0% 100% |
| 16 | C# Mono #3 | 84.85 | 84.85 | 2,929,352 | 607 | 0% 0% 0% 100% |
| 19 | C# Mono #5 | 99.49 | 99.49 | 552,272 | 1647 | 0% 0% 0% 100% |
| 19 | Erlang HiPE #6 | 101.43 | 101.43 | 177,264 | 1058 | 0% 0% 0% 100% |
| 23 | Erlang HiPE #5 | 123.01 | 122.95 | 1,891,924 | 855 | 0% 0% 0% 100% |
| 29 | C# Mono #2 | 156.47 | 156.46 | 2,599,492 | 645 | 0% 0% 0% 100% |
| 34 | Erlang HiPE | 180.56 | 180.29 | 1,450,940 | 1022 | 0% 100% 0% 0% |
| 64 | Java 6 -Xint #5 | 5 min | 5 min | 676,912 | 929 | 0% 0% 1% 100% |
| 66 | Smalltalk VisualWorks | 5 min | 5 min | 299,348 | 584 | 0% 0% 0% 100% |
| 66 | Java 6 -Xint #4 | 5 min | 5 min | 634,380 | 921 | 0% 0% 0% 100% |
| 68 | Erlang HiPE #3 | 6 min | 6 min | 1,910,732 | 687 | 0% 100% 0% 2% |
| 78 | Go 6g 8g | 6 min | 6 min | 635,912 | 634 | 0% 1% 0% 100% |
| 108 | Java 6 -Xint #2 | 9 min | 9 min | 843,520 | 1534 | 0% 0% 0% 100% |
| Ada 2005 GNAT #3 | Failed | 1233 | ||||
| Ada 2005 GNAT #4 | Failed | 1352 | ||||
| Erlang HiPE #2 | Failed | 808 | ||||
| Haskell GHC #4 | Failed | 1672 | ||||
| JavaScript V8 | Bad Output | 365 | ||||
| Scala | Failed | 663 | ||||
| interesting alternative programs | ||||||
| Fortran Intel | Failed | 2425 | ||||
| 0.9 | Perl #6 | 4.73 | 4.73 | 189,596 | 477 | |
| 0.9 | Perl #3 | 5.00 | 5.00 | 287,800 | 440 | |
| 2.1 | Perl #5 | 11.12 | 11.12 | 190,136 | 484 | |
| 2.2 | Python CPython #2 | 11.93 | 11.93 | 213,144 | 314 | |
| 2.8 | Pascal Free Pascal #3 | 14.70 | 14.70 | 213,816 | 2932 | |
| 3.6 | Perl | 19.44 | 19.43 | 189,780 | 426 | |
| 4.5 | Pascal Free Pascal | 23.84 | 23.84 | 118,752 | 1199 | |
| 5.6 | F# Mono | 29.93 | 29.93 | 634,236 | 796 | |
| 7.0 | Lua #3 | 37.31 | 37.31 | 357,792 | 427 | |
| 7.6 | Haskell GHC | 40.54 | 40.54 | 459,276 | 519 | |
| 7.8 | Ruby MRI #2 | 41.63 | 41.63 | 424,724 | 396 | |
| 9.3 | PHP | 49.35 | 49.36 | 201,916 | 1044 | |
| 12 | Ruby JRuby #2 | 61.37 | 61.42 | 543,296 | 396 | |
| 13 | C# Mono #4 | 70.24 | 70.26 | 437,032 | 657 | |
| missing programs | ||||||
| Clean | No program | |||||
| F# Mono | No program | |||||
| Fortran Intel | No program | |||||
| Java 6 steady state | No program | |||||
| Lua | No program | |||||
| Pascal Free Pascal | No program | |||||
regex-dna benchmark : Match DNA 8-mers and substitute nucleotides for IUB codes
diff program output for this 100KB input file (generated with the fasta program N = 10000) with this output file to check your program is correct before contributing.
We use FASTA files generated by the fasta benchmark as input for this benchmark. Note: the file may include both lowercase and uppercase codes.
Each program should
- read all of a redirected FASTA format file from stdin, and record the sequence length
- use the same simple regex pattern match-replace to remove FASTA sequence descriptions and all linefeed characters, and record the sequence length
- use the same simple regex patterns, representing DNA 8-mers and their reverse complement (with a wildcard in one position), and (one pattern at a time) count matches in the redirected file
- write the regex pattern and count
- use the same simple regex patterns to make IUB code alternatives explicit, and (one pattern at a time) match-replace the pattern in the redirect file, and record the sequence length
- write the 3 recorded sequence lengths