Code for generating dataset and training of BertChunker, a semantic chunker for unstructured documents.
Run
bash train.sh
See test.py
If this work is helpful, please kindly cite as:
@article{BertChunker,
title={BertChunker: Efficient and Trained Chunking for Unstructured Documents},
author={Yannan Luo},
year={2024},
url={https://github.com/jackfsuia/BertChunker}
}