yhy-2000 / Socialformer

The implement of Socialformer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Socialformer

Source code of "Socialformer: Social Network Inspired Long Document Modeling for Document Ranking".

  • For double-blind review, we use anonymous github to hide the information that may reveal the identity.
  • We would like to express our deep appreciation for all reviewers.

Requirements

  • python >= 3.6.0
  • pytorch >= 1.9.0 (with GPU support)
  • Transformers >= 4.5.1
  • pytrec-eval == 0.5

Dataset

PreProcess

  • Referring to /dataprocess, including probability computing, graph construction, and graph partition.
bash ./dataprocess/run.sh

Model training

  • Referring to /model, train and test the model.
bash ./model/run.sh

About

The implement of Socialformer

License:MIT License


Languages

Language:Python 98.6%Language:Shell 1.4%