Traceroute Data Set

Raw Datasets 2013 – present

About this dataset

For every TCP connection to an M-Lab server, the Traceroute core service collects network path information from the M-Lab server back to the client IP that initiated the connection. This traceroute collection is done by M-Lab's traceroute-caller which uses traceroute tools like Paris Traceroute and scamper (from the Center for Applied Internet Data Analysis) to collect the actual traceroute data between the M-Lab server and the client. For every TCP connection, traceroute-caller generates two files: traceroute data (scamper1 datatype) and hop annotations (hopannotation1 datatype), which are archived in Google Cloud Storage and parsed into Google BigQuery tables.

Access the data

tgz

NDT scamper1 (March 2019 to Present)

Compressed tar files containing JSONL-formatted scamper traceroute data for NDT measurement services, organized by date.

tgz

Host scamper1 (March 2019 to Present)

Compressed tar files containing JSONL-formatted scamper traceroute data for the M-Lab host server, organized by date.

tgz

Neubot scamper1 (March 2019 to Present)

Compressed tar files containing JSONL-formatted scamper traceroute data for Neubot measurement services, organized by date.

tgz

Paris Traceroute (May 2013 to November 2019)

Compressed tar files containing unstructured text .paris files from the Paris Traceroute tool, organized by M-Lab server and date.

BigQuery

scamper1 BigQuery Table

BigQuery table for scamper1 traceroute data using standard columns: measurement-lab.ndt_raw.scamper1

BigQuery

paris1_legacy BigQuery Table

BigQuery table for legacy Paris Traceroute data: measurement-lab.ndt_raw.paris1_legacy. Note: M-Lab is no longer using the Paris Traceroute tool.

Dataset info

Geography
Global
Updated
Continuous
Publisher
Measurement Lab

Documentation

Citing this dataset

M-Lab data is released without restriction under a Creative Commons Zero waiver. Please cite this dataset as:

The M-Lab Traceroute Data Set, 2013-05-01–present. https://mlab.draftlab.dev/datasets/traceroute/

Or in BibTeX format: 

@misc{traceroute,
        author="{Measurement Lab}",
        title="{Traceroute Data Set}",
        year="(2013-05-01 -- present)",
        howpublished="\url{https://mlab.draftlab.dev/datasets/traceroute/}",
        comment="For every TCP connection to an M-Lab server, the Traceroute core service collects network path information from the M-Lab server back to the client IP that initiated the connection. This traceroute collection is done by M-Lab's traceroute-caller which uses traceroute tools like Paris Traceroute and scamper (from the Center for Applied Internet Data Analysis) to collect the actual traceroute data between the M-Lab server and the client. For every TCP connection, traceroute-caller generates two files: traceroute data (scamper1 datatype) and hop annotations (hopannotation1 datatype), which are archived in Google Cloud Storage and parsed into Google BigQuery tables.",
        note="NDT scamper1 (March 2019 to Present) {\tt https://console.cloud.google.com/storage/browser/archive-measurement-lab/ndt/scamper1/}",
        note1="Host scamper1 (March 2019 to Present) {\tt https://console.cloud.google.com/storage/browser/archive-measurement-lab/host/scamper1/}",
        note2="Neubot scamper1 (March 2019 to Present) {\tt https://console.cloud.google.com/storage/browser/archive-measurement-lab/neubot/scamper1/}",
        note3="Paris Traceroute (May 2013 to November 2019) {\tt https://console.cloud.google.com/storage/browser/archive-measurement-lab/paris-traceroute/}",
        note4="scamper1 BigQuery Table {\tt https://console.cloud.google.com/bigquery?project=measurement-lab\&d=ndt\_raw\&t=scamper1\&page=table}",
        note5="paris1\_legacy BigQuery Table {\tt https://console.cloud.google.com/bigquery?project=measurement-lab\&d=ndt\_raw\&t=paris1\_legacy\&page=table}"
}

Related datasets