NYC taxi benchmark

This benchmark is based on the data from New York City Taxi & Limousine Commission. From the official site, the data includes:

taxi trip records include fields capturing pick-up and drop-off dates/times, pick-up and drop-off locations, trip distances, itemized fares, rate types, payment types, and driver-reported passenger counts. The data used in the attached datasets were collected and provided to the NYC Taxi and Limousine Commission (TLC) by technology providers authorized under the Taxicab & Livery Passenger Enhancement Programs (TPEP/LPEP). The trip data was not created by the TLC, and TLC makes no representations as to the accuracy of these data.

The commands in the documentation assume that your current working directory is the root directory of the GreptimeDB source code.

Get the data

First, create a directory to store test data.

mkdir -p ./benchmarks/data

You can find the data in this page. We support all the Yellow Taxi Trip Records since 2022-01. For example, to get the data for January 2022, you can run:

curl "https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2022-01.parquet" -o ./benchmarks/data/yellow_tripdata_2022-01.parquet

Run benchmark

Before running the benchmark, please make sure you have started the GreptimeDB server. You can start GreptimeDB by using the following command:

cargo run --release standalone start

Our benchmark tools are included in the source code. You can run it by:

cargo run --release --bin nyc-taxi -- --path "./benchmarks/data/"