node/benchmark
Michaël Zasso 2a1dea8a22
benchmark: output JSON-compatible numbers
This is to simplify the implementation of a JavaScript version of the
compare.R script.

PR-URL: https://github.com/nodejs/node/pull/38778
Reviewed-By: James M Snell <jasnell@gmail.com>
Reviewed-By: Antoine du Hamel <duhamelantoine1995@gmail.com>
Reviewed-By: Zijian Liu <lxxyxzj@gmail.com>
Reviewed-By: Anna Henningsen <anna@addaleax.net>
Reviewed-By: Anto Aravinth <anto.aravinth.cse@gmail.com>
2021-05-25 13:36:47 -07:00
..
assert benchmark: remove special test entries 2020-03-09 22:35:54 +01:00
async_hooks benchmark: always throw the same Error instance 2020-07-29 10:59:26 +03:00
buffers benchmark: remove special test entries 2020-03-09 22:35:54 +01:00
child_process benchmark: reduce code duplication 2020-12-21 13:43:30 +01:00
cluster
crypto crypto: reconcile oneshot sign/verify sync and async implementations 2021-04-08 10:08:26 +02:00
dgram
diagnostics_channel http: report request start and end with diagnostics_channel 2020-10-31 21:24:12 +00:00
dns benchmark: use let instead of var in dns 2020-03-30 10:16:14 +02:00
domain
es tools: enable no-unused-expressions lint rule 2020-12-07 20:33:45 +01:00
esm module: use Wasm CJS lexer when available 2020-10-12 04:24:41 -07:00
events events: use nullish coalencing operator 2021-05-17 12:26:29 -07:00
fixtures benchmark: add benchmark for NODE_V8_COVERAGE 2021-01-27 14:31:37 -08:00
fs benchmark: add benchmark for fsPromises.writeFile 2021-03-13 13:41:00 +01:00
http benchmark: fix http/headers.js with test-double 2021-01-06 21:18:47 -08:00
http2 benchmark: fix http2 benchmarks 2021-01-10 20:26:54 -08:00
https benchmark: add simple https benchmark 2020-12-25 18:11:44 +00:00
misc errors: eliminate all overhead for hidden calls 2020-12-22 11:09:55 +01:00
module module: only set cache when finding module succeeds 2021-02-12 22:08:40 +08:00
napi benchmark: fix build warnings 2020-11-19 19:01:38 -08:00
net benchmark: add test and all options and improve errors" 2020-03-09 22:35:53 +01:00
os
path
perf_hooks perf_hooks: complete overhaul of the implementation 2021-02-22 08:46:11 -08:00
policy policy: add startup benchmark and make SRI lazier 2020-07-14 13:03:04 -05:00
process benchmark: add benchmark for NODE_V8_COVERAGE 2021-01-27 14:31:37 -08:00
querystring querystring: improve stringify() performance 2020-06-12 18:21:44 -04:00
streams stream: make Readable.from performance better 2021-03-22 11:19:35 +02:00
string_decoder tools: enable no-unused-expressions lint rule 2020-12-07 20:33:45 +01:00
timers benchmark: use let instead of var in timers 2020-03-30 10:16:16 +02:00
tls tls: allow reading data into a static buffer 2020-10-28 16:07:29 +03:00
url test,benchmark: stop requiring URL and URLSearchParams 2021-01-18 13:44:33 -08:00
util benchmark: use let instead of var in util 2020-03-30 10:16:21 +02:00
v8
vm
worker worker: add eventLoopUtilization() 2020-10-27 09:43:20 +01:00
zlib benchmark: use let instead of var in zlib 2020-03-30 10:16:24 +02:00
_benchmark_progress.js tools: enable no-unused-expressions lint rule 2020-12-07 20:33:45 +01:00
_cli.js benchmark: add test and all options and improve errors" 2020-03-09 22:35:53 +01:00
_cli.R
_http-benchmarkers.js benchmark: fix http elapsed time 2021-05-23 14:52:14 +08:00
_test-double-benchmarker.js benchmark: fix http2 benchmarks 2021-01-10 20:26:54 -08:00
.eslintrc.yaml tools: simplify eslint comma-dangle configuration 2021-03-23 13:15:09 -07:00
common.js benchmark: output JSON-compatible numbers 2021-05-25 13:36:47 -07:00
compare.js benchmark: make output RFC 4180 compliant 2021-01-25 07:05:31 -08:00
compare.R benchmark: improve compare.R output 2021-04-12 14:28:46 -07:00
README.md perf_hooks: add idleTime and event loop util 2020-08-29 07:02:31 -07:00
run.js benchmark: use let instead of var in run.js 2020-03-30 10:16:15 +02:00
scatter.js tools: enable no-else-return lint rule 2020-05-16 06:42:16 +02:00
scatter.R

Node.js Core Benchmarks

This folder contains code and data used to measure performance of different Node.js implementations and different ways of writing JavaScript run by the built-in JavaScript engine.

For a detailed guide on how to write and run benchmarks in this directory, see the guide on benchmarks.

Table of Contents

Benchmark Directories

Directory Purpose
assert Benchmarks for the assert subsystem.
buffers Benchmarks for the buffer subsystem.
child_process Benchmarks for the child_process subsystem.
crypto Benchmarks for the crypto subsystem.
dgram Benchmarks for the dgram subsystem.
domain Benchmarks for the domain subsystem.
es Benchmarks for various new ECMAScript features and their pre-ES2015 counterparts.
events Benchmarks for the events subsystem.
fixtures Benchmarks fixtures used in various benchmarks throughout the benchmark suite.
fs Benchmarks for the fs subsystem.
http Benchmarks for the http subsystem.
http2 Benchmarks for the http2 subsystem.
misc Miscellaneous benchmarks and benchmarks for shared internal modules.
module Benchmarks for the module subsystem.
net Benchmarks for the net subsystem.
path Benchmarks for the path subsystem.
perf_hooks Benchmarks for the perf_hooks subsystem.
process Benchmarks for the process subsystem.
querystring Benchmarks for the querystring subsystem.
streams Benchmarks for the streams subsystem.
string_decoder Benchmarks for the string_decoder subsystem.
timers Benchmarks for the timers subsystem, including setTimeout, setInterval, .etc.
tls Benchmarks for the tls subsystem.
url Benchmarks for the url subsystem, including the legacy url implementation and the WHATWG URL implementation.
util Benchmarks for the util subsystem.
vm Benchmarks for the vm subsystem.

Other Top-level files

The top-level files include common dependencies of the benchmarks and the tools for launching benchmarks and visualizing their output. The actual benchmark scripts should be placed in their corresponding directories.

  • _benchmark_progress.js: implements the progress bar displayed when running compare.js
  • _cli.js: parses the command line arguments passed to compare.js, run.js and scatter.js
  • _cli.R: parses the command line arguments passed to compare.R
  • _http-benchmarkers.js: selects and runs external tools for benchmarking the http subsystem.
  • common.js: see Common API.
  • compare.js: command line tool for comparing performance between different Node.js binaries.
  • compare.R: R script for statistically analyzing the output of compare.js
  • run.js: command line tool for running individual benchmark suite(s).
  • scatter.js: command line tool for comparing the performance between different parameters in benchmark configurations, for example to analyze the time complexity.
  • scatter.R: R script for visualizing the output of scatter.js with scatter plots.

Common API

The common.js module is used by benchmarks for consistency across repeated tasks. It has a number of helpful functions and properties to help with writing benchmarks.

createBenchmark(fn, configs[, options])

See the guide on writing benchmarks.

default_http_benchmarker

The default benchmarker used to run HTTP benchmarks. See the guide on writing HTTP benchmarks.

PORT

The default port used to run HTTP benchmarks. See the guide on writing HTTP benchmarks.

sendResult(data)

Used in special benchmarks that can't use createBenchmark and the object it returns to accomplish what they need. This function reports timing data to the parent process (usually created by running compare.js, run.js or scatter.js).