text-as-data

There are 7 repositories under text-as-data topic.

• JasonKessler / scattertext

  Beautiful visualizations of how language differs among document types.

  nlpd3word-embeddingsmachine-learningnatural-language-processingvisualizationword2vectext-visualizationtext-miningjapanese-languagecomputational-social-sciencesentimentedaexploratory-data-analysistext-as-datascatter-plottopic-modelingstylometrystylometricsemiotic-squares
  Language:Python 2323

• MilaNLProc / contextualized-topic-models

  A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

  topic-modelingberttransformerembeddingstext-as-datatopic-coherencemultilingual-topic-modelsmultilingual-modelsneural-topic-modelsnlpnlp-librarynlp-machine-learning
  Language:Python 1250
• textnets

  jboynyc / textnets

  Text analysis with networks.

  nlpnetwork-analysissociologyvisualizationtext-analysistext-as-datacomputational-social-science
  Language:Python 290

• ryanjgallagher / shifterator

  Interpretable data visualizations for understanding how texts differ at the word level

  natural-language-processingsentiment-analysisinformation-theorycomputational-social-sciencedigital-humanitiestext-analysistext-as-datadata-visualization
  Language:Python 283

• JasonKessler / Scattertext-PyData

  Notebooks for the Seattle PyData 2017 talk on Scattertext

  pydatanlpvisualizationtext-visualizationword2veccomputational-social-sciencenatural-language-processinggendertext-as-datapolitical-sciencepolitical-parties
  Language:HTML 142

• chkla / CSS-Events

  Summer/ winter schools, workshops and conferences in computational social science 🫂

  computational-social-scienceconferenceseventssummer-schoolstext-as-datawinter-schoolsworkshops
  43

• umanlp / SemScale

  A tool for Semantic Scaling of Political Text (branch of Topfish, a suite of tools for Political Text Analysis)

  text-scalingtext-as-datacomputational-social-science
  Language:Python 28

• chkla / Populism-Text-Analysis

  Literature 📄 and datasets 📚 on automatic populism detection

  nlppolitical-sciencepopulismtext-as-dataliterature-review
  19

• tweedmann / 3x8emotions

  Code and models for 3 different tools to measure appeals to 8 discrete emotions in German political text

  emotionspolitical-sciencetext-as-datapolitical-communication
  Language:Jupyter Notebook 16

• fedenanni / Computational-Text-Analysis-2018-19

  2018 Computational Text Analysis Notebooks, University of Mannheim

  text-as-datacomputational-social-sciencenatural-language-processingteaching-materials
  Language:Jupyter Notebook 13
• LinkOrgs-software

  cjerzak / LinkOrgs-software

  LinkOrgs: An R package for linking linking records on organizations using half a billion open-collaborated records from LinkedIn

  machine-learningrecord-linkagetext-as-datacommunity-detectionorganizational-unitsequinoxjaxtransformer-architecture
  Language:HTML 12

• wesslen / summer2017-socialmedia

  Summer 2017 Social Media Analytics Workshop Series

  twitter-apifacebook-apitext-as-datageospatialr
  Language:HTML 11

• davidycliao / bisCrawler

  An Automation Webcrawler for Extracting Central Bankers' Speeches

  bank-for-international-settlementscentral-bankercentral-bankers-speechespythonscraperscrapingspeechestext-as-data
  Language:Python 10

• thieled / dictvectoR

  'dictvectoR' measures the similarity between a concept dictionary and documents, using fastText word vectors. Implements the "Distributed-Dictionary-Representation" (Garten et al. 2018) method in R.

  dictionaryideologynatural-language-processingrscalingtext-analysistext-as-dataword-embeddingsword-representationsword-vectors
  Language:R 9
• KED2022

  aflueckiger / KED2022

  The ABC of Computational Text Analysis. BA Seminar, Spring 2022, University of Lucerne

  computational-social-sciencesocial-sciencesociologyteachingtext-as-data
  Language:HTML 6

• WZBSocialScienceCenter / tm_corona

  A small showcase for topic modeling with the tmtoolkit Python package. I use a corpus of articles from the German online news website Spiegel Online (SPON) to create a topic model for before and during the COVID-19 pandemic.

  coronacovid-19newspythonscrapingtext-analysistext-as-datatext-miningtopic-modelingtopicmodelingwebscraping
  Language:Jupyter Notebook 4

• adamlauretig / gensim_in_R

  Code for estimating word embeddings with gensim in R.

  gensimrtext-as-data
  3

• jfjelstul / regular-expressions-tutorial

  A tutorial on using regular expressions in R

  rregular-expressionsstringrtext-analysistext-as-datatext-datatidyversetutorial
  2

• thelautiff / UN_meeting_records

  From using xpdf, rvest, and quanteda on United Nations Digital Library search results to applying dictionaries to speeches in United Nations meeting records

  pdfpdfsquantedarregular-expressionrvesttext-as-dataunited-nationsxpdf
  Language:R 2

• varvarailyina / mds_thesis

  all code and results for my MDS thesis at the hertie school

  emotionsllmspolitical-communicationtext-as-data
  Language:Jupyter Notebook 2

• aflueckiger / KED2021

  The ABC of Computational Text Analysis. BA Seminar, Spring 2021, University of Lucerne

  computational-social-sciencesocial-sciencesociologyteachingtext-analysistext-as-data
  Language:HTML 1

• CT-P / portuguese_open_data

  Empirical framework applied to parliament discourses and Twitter data, with a Discourse Polarization Index.

  computational-social-sciencediscoursepolitical-polarizationtext-as-datagentzkow
  Language:Jupyter Notebook 1

• marek-chadim / Empirical-Economics

  PhD Applied empirical economics at Stockholm University

  gismachine-learningprogrammingreplicationtext-as-dataversion-controlwebscrapingworkflow
  Language:HTML 1

• BenjaminFReese / american_constitutional_praxis

  This repository uses text-as-data methods alongside traditional primary source reading to analyze early American state constitutions. The R scripts create a function to scrape and clean the constitutional text, run sentiment analysis, calculate tf-idf, and perform LDA. This is a work-in-progress.

  constitutionlatent-dirichlet-allocationpolitical-theorysentiment-analysistext-as-datatf-idf
  Language:HTML 0

• bgonzalezbustamante / TextClass-Benchmark

  TextClass Benchmark Leaderboards

  deepseekelo-ratinggpt-4gpt-4oleaderboardsllamallmllms-benchmarkingmisinformationmistralnous-hermesollamaopenaiperspective-apiqwen2-5text-as-datatext-classificationtoxicitytoxicity-classificationzero-shot-classification
  Language:Jupyter Notebook 0
• Refugee-Text-as-Data

  graceadcox / Refugee-Text-as-Data

  Original corpus of articles relating to refugees scraped from Tennessee newspaper The Chattanoogan along with simple code for text-as-data word cloud.

  text-as-dataword-cloudr
  Language:R 0

• ichalkiad / datadescriptor_uselections2020

  Code for collecting and cleaning speeches (text) of the US 2020 election campaign. Corresponding publication: "A text dataset of campaign speeches of the main tickets in the 2020 US presidential election", by Ioannis Chalkiadakis, Louise Anglès d’Auriac, Gareth W. Peters, and Divina Frau-Meigs

  natural-language-processingpolitical-sciencerhetorictext-analysistext-as-dataus-election-2020us-elections
  Language:Python 0

• Jszabo16 / EU-sentiments_NRSR

  Replication script for mining sentiments towards the EU from Parliamentary Speeches in the National Council of the Slovak Republic (1994-2023)

  european-unionslovakiatext-as-dataaspect-based-sentiment-analysisbertstructural-topic-modelingnational-council-of-the-slovak-republicparliamentary-speeches
  0

• Sam-Gartenstein / Machine-Learning-for-the-Social-Sciences

  Material from my Machine Learning for the Social Sciences course

  neural-networkssupervised-machine-learningunsupervised-machine-learningtext-as-data
  Language:Jupyter Notebook 0

• smkerr / news-israel-gaza

  🇮🇱🇵🇸 News coverage of Israel-Hamas War 🇵🇸🇮🇱

  text-as-datar
  Language:R