Giters

kbenoit / ITAUR-Short

A Brief Introduction to Text Analysis Using R

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Quantitative Text Analysis Using R: The Short Version

Kenneth Benoit, Department of Methodology, LSE
Paul Nulty, Department of Methodology, LSE

Previously presented at:

Version: 27 October 2016

This repository contains the workshop materials for a short workshop format Quantitative to Text Analysis Using R. This project is supported through European Research Council grant ERC-2011-StG 283794-QUANTESS.

Instructions for using this resource

You have three options for downloading the course material found on this page:

  1. You can download the materials by clicking on each link.

  2. You can "clone" repository, using the buttons found to the right side of your browser window as you view this repository. This is the button labelled "Clone in Desktop". If you do not have a git client installed on your system, you will need to get one here and also to make sure that git is installed. This is preferred, since you can refresh your clone as new content gets pushed to the course repository. (And new material will get actively pushed to the course repository at least once per day as this course takes place.)

  3. Statically, you can choose the button on the right marked "Download zip" which will download the entire repository as a zip file.

You can also subscribe to the repository if you have a GitHub account, which will send you updates each time new changes are pushed to the repository.

Objectives

This workshop covers how to perform common text analysis and natural language processing tasks using R. When used properly, R is a fast and powerful tool for managing even very large text analysis tasks.

The course consists of instructor presentations in three sets, followed by exercises that students are meant to do in class. Computers should be available, but we suggest you bring your own.

We will cover how to format and input source texts, how to structure their metadata, and how to prepare them for analysis. This includes common tasks such as tokenisation, including constructing ngrams and "skip-grams", removing stopwords, stemming words, and other forms of feature selection. We show how to: get summary statistics from text, search for and analyse keywords and phrases, analyse text for lexical diversity and readability, detect collocations, apply dictionaries, and measure term and document associations using distance measures. Our analysis covers basic text-related data processing in the R base language, but most relies on the quanteda package for the quantitative analysis of textual data. We also cover how to pass the structured objects from quanteda into other text analytic packages for doing topic modelling, latent semantic analysis, regression models, and other forms of machine learning.

Prerequisites

While it is designed for those who have used R in some form previously, expertise in R is not required, and even those with no previous knowledge of R are welcome.

Part 1: Getting Started and Basic Text Analysis

Setting up RStudio and quanteda:

  • CRAN for downloading and installing R
  • GitHub page for the quanteda package
  • Additional packages to install: STM, topicmodels, glmnet
  • Configuration test: Try running this RMarkdown file: test_setup.Rmd. If it builds without error and looks like this, then you have successfully configured your system.

Basic Text Analysis:

Part 2: Descriptive text analysis using R

You also might want to look at the following:

Part 3: Advanced analysis and working with other text packages

Extension packages:

  • LIWCalike: replicate the Linguistic Inquiry and Word Count program's functionality.
  • readtext: read texts into R (replaces the textfile() function from quanteda).
  • preText: Diagnostics to assess the effects of text "pre-processing" decisions.

Upcoming API revision in quanteda >= 0.9.9

See API.md for full details.

Additional Resources

Designed to be done before the course or after, to augment what is presented during the course. These are just suggestions -- no reading for the course is required.

About

A Brief Introduction to Text Analysis Using R

License:GNU General Public License v3.0

Languages

Language:HTML 99.9%Language:R 0.1%