This repository contains the Latvian Twitter Eater Corpus. Repository structure:
- full-corpus - the full corpus in several formats
- sub-corpora - task-specific sub-corpora derrived from the full corpus
- scripts - scripts for data preparation and analyis
This directory contains the LTEC. All information from the corpus is hidden, and only the tweet ID are available due to Twitter data usage rights. To gain the full corpus information, please, contact the repos owner.
The directory contains sub-corpora of tweets: 1) tweets representing questions and their replies gathered from the Twitter API; 2) sentiment annotated tweets containing tweets where sentiment is automatically marked by usage of positive or negative emoticons while tweets from media and restaurant accounts marked as neutral, and manually annotated tweets which we used to train and test a our sentiment analyser. They are labeled as:
- ltec-questions-answers.json - contains tweets which express questions along with replies to those tweets
- ltec-answers-questions.json - contains tweets which express questions and are replies to other tweets along with the tweets that they are replying to
- ltec-sentiment-annotated.json - contains tweets with human annotated sentiment
- ltec-sentiment-automatic.json - contains tweets with automatically assigned sentiment based on emoticons and media/restaurant users
This directory contains script files writen in Python and shell, used to gather information from the Latvian Twitter Eater Corpus or LTEC for short. Here's a short summary about each of them:
- analysis - scripts, which give analysis of the corpus.
- data-preparation - scripts, used to create the corpus from MySQL database data.
- experiments - scripts, for data preparation and training for QA model and sentiment analysis
If you use this corpus or scripts, please cite the following paper:
Uga Sproģis and Matīss Rikters (2020). "What Can We Learn From Almost a Decade of Food Tweets." In Proceedings of the 9th Conference Human Language Technologies - The Baltic Perspective (Baltic HLT 2020) (2020).
@inproceedings{SprogisRikters2020BalticHLT,
author = {Sproģis, Uga and Rikters, Matīss},
booktitle={In Proceedings of the 9th Conference Human Language Technologies - The Baltic Perspective (Baltic HLT 2020)},
title = {{What Can We Learn From Almost a Decade of Food Tweets}},
address={Kaunas, Lithuania},
year = {2020}
}