The main objective of this workshop is to introduce researchers to user-friendly analytical tools. ITMS and LVS are two web-based tools for visualization and quantitative analysis. In contrast to existing software programs (e.g., SAS, SPSS, and Tableau), these two applications are built in R and require no installation or programming skills.
This hands-on workshop will provide an overview of available statistical and text-mining techniques in these tools. You will learn how to import csv, text and pdf files, create plots, and run statistical analysis, including conditional trees and random forest tests. You will also learn about natural language pre-processing techniques, such as stopwords removal and stemming. Finally, you will be able to perform topic modeling and cluster analysis.
Part 1: Quantitative Methods – Language Variation Suite LVS slides
Part 2: Text Mining Methods – Interactive Text Mining Suite ITMS slides
Workshop exercice materials:
- sample of categorical data csv file – link
- sample of continuous data csv file – link
Language Variation Suite has been released with more customizable features for language variation analysis.
New features include:
Plot Customization – titles, labels, colors
Redesigned user-friendly interface
Tuning parameters for cluster analysis
- Customized url link: www.languagevariationsuite.com
- R code snippets
Do not hesitate to contact if you have any issues or if you like to request new features.
Our workshop Optimizing Language Variation Analysis: Language Variation Suite is held on 11/03/16 at Simon Fraser University, Vancouver, Canada!
“Mastery of quantitative methods is increasingly becoming a vital component of linguistic training” (Johnson 2008:1)
“The science of analytical reasoning facilitated by visual interactive interfaces” (Thomas et al. 2005)
- Categorical data csv – Use of R in New York (Labov 1966)
- Continuous data csv – Intervocalic /d/ (Díaz-Campos et al. 2016)
- Language Variation Suite
Please come and learn how to perform advanced statistical methods with a user-friendly interactive toolkit for (socio)linguistic analysis. Do not hesitate to contact us if you have any questions and suggestions (obscrivn AT indiana DOT edu)
Olga, Manuel and Rafael
LVS provides three types of model comparison (LRT, AIC, and BIC) using the package MASS. The stepwise regression uses both directions (step up and step down) and selects the best model (best predictors).
All three criteria assess model fit. LRT is based on log likelihood ratio (k = qchisq(1-p, df=1), where for p=0.05, k = 3.84). For more information on AIC ( Akaike Information Criterion ) and BIC (Bayesian information criterion) – see http://www.jmp.com/support/help/Likelihood_AICc_and_BIC.shtml.
Steps to perform stepwise regression in LVS:
- Upload csv or excel file – Panel DATA
- Go to Panel INFERENTIAL STATISTICS – tab MODELING
- Select your regression model (dependent and independent factors), type of regression (see tab REGRESSION) and click RUN regression.
- Go to STEPWISE REGRESSION tab and click RUN stepwise model.
- Return to Modeling and Regression and update your selection with the best fitted model.
As always, your feedback and suggestions are greatly appreciated! (LVS Team)
Language Variation Suite has added a Varbrul analysis. Varbrul is “an implementation of logistic regression that is used by many sociolinguists” (Keith Johnson, 2008, 174). At present LVS calculates Varbrul weights for a binary dependent variable and categorical independent variables. Varbrul output format is based on chapter 5.7 (K.Johnson,2008): inverse logit (inv.logit) is used from the package gtools. Contrasts option in logistic regression is set to contr.sum. For a binary variable, the calculation is inv.logit(coeficient*1) and inv.logit(coeficient*-1), which outputs weights for two values (e.g. men and women).
Shiny application allows for an interactive quantitative analysis and it is based on R programming language. Since this toolkit is still under development, we will greatly appreciate its evaluation, comments, and feedback!
LVS (an interactive toolkit for sociolinguists) has been enhanced with new features: 1) Excel and CSV formats, 2) Recoding and factor modification, and 3) Token Frequency extraction from text files.
New menu Adjust Data (Data Panel) allows for an interactive data modification, such as excluding and recoding certain factors or adding logarithmic transformation to continuous data.
New menu Frequency (Data Panel) allows for frequency extraction from text files. This feature makes it possible to add a frequency column to your dataset. The dataset should have a column named token containing words (a single word per cell).
Feel free to explore LVS – it also works with SmartPhones and IPads. Please let us know your feedback and suggestions.