laixinn / TGB

Temporal Graph Benchmark project repo

Temporal Graph Benchmark for Machine Learning on Temporal Graphs (NeurIPS 2023 Datasets and Benchmarks Track)

Overview of the Temporal Graph Benchmark (TGB) pipeline:

• TGB includes large-scale and realistic datasets from five different domains with both dynamic link prediction and node property prediction tasks.
• TGB automatically downloads datasets and processes them into numpy, PyTorch and PyG compatible TemporalData formats.
• Novel TG models can be easily evaluated on TGB datasets via reproducible and realistic evaluation protocols.
• TGB provides public and online leaderboards to track recent developments in temporal graph learning domain.

To submit to TGB leaderboard, please fill in this google form

See all version differences and update notes here

Pip Install

You can install TGB via pip. Requires python >= 3.9

pip install py-tgb

Our Results and Reproduction

• link property prediction efficacy

	coin	wiki	review	comment	flight
tgn	2361.62136	8.50554	990.14922	7613.05138	2361.62136
ours	1021.69194	8.91294	172.91594	1627.74388	2348.8223

• node property prediction efficacy

	trade	token	genre	reddit
tgn	9.6529	2191.2975	354.65202	1726.59832
ours	4.88492	1302.21666	248.07684	1036.38446

• For the dynamic link property prediction task, see the examples/linkproppred/*/tgn-ours.py
• For the dynamic node property prediction task, see the examples/nodeproppred/*/tgn-ours.py

Key Modification

• Tensorized TGN can be found in modules/memory_module.py
• Workflow

Citation

If code or data from this repo is useful for your project, please consider citing our paper:

@article{huang2023temporal,
  title={Temporal graph benchmark for machine learning on temporal graphs},
  author={Huang, Shenyang and Poursafaei, Farimah and Danovitch, Jacob and Fey, Matthias and Hu, Weihua and Rossi, Emanuele and Leskovec, Jure and Bronstein, Michael and Rabusseau, Guillaume and Rabbany, Reihaneh},
  journal={Advances in Neural Information Processing Systems},
  year={2023}
}