vignettes/web_only/ggstatsplot_paper.Rmd
ggstatsplot_paper.Rmd
(This publication is still a work in progress)
“What is to be sought in designs for the display of information is the clear portrayal of complexity. Not the complication of the simple; rather … the revelation of the complex.”
 Edward R. Tufte
The ggstatsplot
package is an opinionated collection of plots made with ggplot2
and is designed for exploratory data analysis or for producing publicationready statistical graphics. All plots share an underlying principle of displaying informationrich plots with all necessary statistical details included in the plots themselves. Although the plots produced by ggstatsplot
are still ggplot
objects and can thus be further modified using ggplot2
commands, there is a limit to how many such modifications can be made. That is, it is less flexible than ggplot2
, but that’s a feature and not a bug. The original intent behind this package is to offload struggles associated with constructing the plot and focus more on the interpretation of that data displayed in the plot.
Graphical perception involves visual decoding of the encoded information in graphs. ggstatsplot
incorporates the paradigm proposed in Cleveland (1985, Chapter 4) to facilitate making visual judgments about quantitative information effortless and almost instantaneous. Based on experiments, Cleveland proposes that there are ten elementary graphicalperception tasks that we perform to visually decode quantitative information in graphs (organized from most to least accurate; Cleveland, 1985, p.254)
So the key principle of Cleveland’s paradigm for data display is
“We should encode data on a graph so that the visual decoding involves [graphicalperception] tasks as high in the ordering as possible.”
For example, decoding the data point values in ggbetweenstats
requires position judgments along a common scale (Figure1):
# for reproducibility
set.seed(123)
# plot
ggstatsplot::ggbetweenstats(
data = dplyr::filter(.data = ggstatsplot::movies_long,
genre %in% c("Action", "Action Comedy", "Action Drama", "Comedy")),
x = genre,
y = rating,
title = "Figure1: IMDB rating by film genre",
xlab = "Genre",
ylab = "IMDB rating (average)",
bf.message = TRUE,
pairwise.comparisons = TRUE,
p.adjust.method = "bonferroni",
ggtheme = hrbrthemes::theme_ipsum_tw(),
ggstatsplot.layer = FALSE,
outlier.tagging = TRUE,
outlier.label = title,
messages = FALSE
)
There are few instances where ggstatsplot
diverges from recommendations made in Cleveland’s paradigm:
ggstatsplot
uses pie charts (see Figure2) which rely on angle judgments, which are less accurate (as compared to bar graphs, e.g., which require position judgments). This shortcoming is assuaged to some degree by using plenty of labels that describe percentages for all slices. This makes angle judgment unnecessary and prevacates any concerns about inaccurate judgments about percentages.# for reproducibility
set.seed(123)
# plot
ggstatsplot::ggpiestats(
data = ggstatsplot::movies_long,
main = genre,
condition = mpaa,
title = "Figure2: Distribution of MPAA ratings by film genre",
legend.title = "layout",
caption = substitute(paste(
italic("MPAA"), ": Motion Picture Association of America"
)),
bf.message = TRUE,
palette = "Paired",
messages = FALSE
)
grouped_
variants of the function (see Figure3). Note that the range for Yaxes are no longer the same across juxtaposed subplots and so visually comparing the data becomes difficult. On the other hand, in the superposed plot, all data have the same range and coloring different parts makes the visual discrimination of different components of the data, and their comparison, easier. But the goal of grouped_
variants of functions is to not only show different aspects of the data but also to run statistical tests and showing detailed results for all aspects of the data in a superposed plot is difficult. Therefore, this is a compromise ggstatsplot
is comfortable with, at least to produce plots for quick exploration of different aspects of the data.# for reproducibility
set.seed(123)
# plot
ggstatsplot::combine_plots(
# plot 1: superposition
ggplot2::ggplot(
data = dplyr::filter(ggstatsplot::movies_long, genre == "Comedy" 
genre == "Drama"),
mapping = ggplot2::aes(x = length,
y = rating,
color = genre)
) +
ggplot2::geom_jitter(size = 3, alpha = 0.5) +
ggplot2::geom_smooth(method = "lm") +
ggplot2::labs(title = "superposition (recommended in Cleveland's paradigm)") +
ggstatsplot::theme_ggstatsplot(),
# plot 2: juxtaposition
ggstatsplot::grouped_ggscatterstats(
data = dplyr::filter(ggstatsplot::movies_long, genre == "Comedy" 
genre == "Drama"),
x = length,
y = rating,
grouping.var = genre,
bf.message = TRUE,
marginal = FALSE,
messages = FALSE,
title.prefix = "Genre",
title.text = "juxtaposition (`ggstatsplot` implementation in `grouped_` functions)",
title.size = 12
),
# combine for comparison
title.text = "Two ways to compare different aspects of data",
nrow = 2,
labels = c("(a)", "(b)")
)
The grouped_
plots follow the Shrink Principle (Tufte, 2001, p.1667) for highinformation graphics, which dictates that the data density and the size of the data matrix can be maximized to exploit maximum resolution of the available datadisplay technology. Given the large maximum resolution afforded by most computer monitors today, saving grouped_
plots with appropriate resolution ensures no loss in legibility with reduced graphics area.
Graphical excellence consists of communicating complex ideas with clarity and in a way that the viewer understands the greatest number of ideas in a short amount of time all the while not quoting the data out of context. The package follows the principles for graphical integrity (as outlined in Tufte, 2001):
The physical representation of numbers is proportional to the numerical quantities they represent (e.g., Figure1 and Figure2 show how means (in ggbetweenstats
) or percentages (ggpiestats
) are proportional to the vertical distance or the area, respectively).
All important events in the data have clear, detailed, and thorough labeling (e.g., Figure1 plot shows how ggbetweenstats
labels means, sample size information, outliers, and pairwise comparisons; same can be appreciated for ggpiestats
in Figure2 and gghistostats
in Figure5). Note that data labels in the data region are designed in a way that they don’t interfere with our ability to assess the overall pattern of the data (Cleveland, 1985; p.4445). This is achieved by using ggrepel
package to place labels in a way that reduces their visual prominence.
None of the plots have design variation (e.g., abrupt change in scales) over the surface of a same graphic because this can lead to a false impression about variation in data.
The number of informationcarrying dimensions never exceed the number of dimensions in the data (e.g., using area to show onedimensional data).
All plots are designed to have no chartjunk (like moiré vibrations, fake perspective, dark grid lines, etc.) (Tufte, 2001, Chapter 5).
There are some instances where ggstatsplot
graphs don’t follow principles of clean graphics, as formulated in the Tufte theory of data graphics (Tufte, 2001, Chapter 4). The theory has four key principles:
In particular, default plots in ggstatsplot
can sometimes violate one of the principles from 24. According to these principles, every bit of ink should have reason for its inclusion in the graphic and should convey some new information to the viewer. If not, such ink should be removed. One instance of this is bilateral symmetry of data measures. For example, in Figure1, we can see that both the box and violin plots are mirrored, which consumes twice the space in the graphic without adding any new information. But this redundancy is tolerated for the sake of beauty that such symmetrical shapes can bring to the graphic. Even Tufte admits that efficiency is but one consideration in the design of statistical graphics (Tufte, 2001, p. 137). Additionally, these principles were formulated in an era in which computer graphics had yet to revolutionize the ease with which graphics could be produced and thus some of the concerns about minimizing dataink for easier production of graphics are not as relevant as they were.
As an extension of ggplot2
, ggstatsplot
has the same expectations about the structure of the data. More specifically,
The data
should be an object of class data.frame
(a tibble
dataframe will also work).
The data should be organized following the principles of tidy data, which specify how statistical structure of a data frame (variables and observations) should be mapped to physical structure (columns and rows). More specifically, tidy data means all variables have their own columns and each row corresponds to a unique observation (Wickham, 2014).
All ggstatsplot
functions remove NA
s from variables of interest (similar to ggplot2
; Wickham, 2016, p.207) in the data and display total sample size (n) in the subtitle to inform the user/reader about the number of observations included for both the statistical analysis and the visualization. But, when sample sizes differ across tests in the same function, ggstatsplot
makes an effort to inform the user of this aspect (Figure4).
# creating a new dataset without any NAs in variables of interest
msleep_no_na <
dplyr::filter(
.data = ggplot2::msleep,
!is.na(sleep_rem),
!is.na(awake),
!is.na(brainwt),
!is.na(bodywt)
)
# variable names vector
var_names < c("REM sleep",
"time awake",
"brain weight",
"body weight")
# combining two plots
ggstatsplot::combine_plots(
# plot *without* any NAs
ggstatsplot::ggcorrmat(
data = msleep_no_na,
corr.method = "kendall",
sig.level = 0.001,
p.adjust.method = "holm",
cor.vars = c(sleep_rem, awake:bodywt),
cor.vars.names = var_names,
matrix.type = "upper",
colors = c("#B2182B", "white", "#4D4D4D"),
title = "Correlalogram for mammals sleep dataset",
subtitle = "sleep units: hours; weight units: kilograms",
messages = FALSE
),
# plot *with* NAs
ggstatsplot::ggcorrmat(
data = ggplot2::msleep,
corr.method = "kendall",
sig.level = 0.001,
p.adjust.method = "holm",
cor.vars = c(sleep_rem, awake:bodywt),
cor.vars.names = var_names,
matrix.type = "upper",
colors = c("#B2182B", "white", "#4D4D4D"),
title = "Correlalogram for mammals sleep dataset",
subtitle = "sleep units: hours; weight units: kilograms",
messages = FALSE
),
labels = c("(a)", "(b)"),
nrow = 1
)
Functions  Description  Parametric  Nonparametric  Robust  Bayes Factor 

ggbetweenstats 
Between group/condition comparisons  \(\checkmark\)  \(\checkmark\)  \(\checkmark\)  \(\checkmark\) 
gghistostats 
Distribution of a numeric variable  \(\checkmark\)  \(\checkmark\)  \(\checkmark\)  \(\checkmark\) 
ggcorrmat 
Correlation matrix  \(\checkmark\)  \(\checkmark\)  \(\checkmark\)  \(\times\) 
ggscatterstats 
Correlation between two variables  \(\checkmark\)  \(\checkmark\)  \(\checkmark\)  \(\checkmark\) 
ggpiestats 
Association between categorical variables  \(\checkmark\)  \(\times\)  \(\times\)  \(\checkmark\) 
ggcoefstats 
Regression model coefficients  \(\checkmark\)  \(\times\)  \(\checkmark\)  \(\times\) 
Functions  Type  Test  Effect size  95% CI available? 

ggbetweenstats 
Parametric  Student’s and Welch’s ttest  Cohen’s d, Hedge’s g  \(\checkmark\) 
ggbetweenstats 
Parametric  Fisher’s and Welch’s oneway ANOVA  \[\eta^2_p, \omega^2_p\]  \(\checkmark\) 
ggbetweenstats 
Nonparametric  MannWhitney Utest  r  \(\checkmark\) 
ggbetweenstats 
Nonparametric  KruskalWallis Rank Sum Test  \[\eta^2_H\]  \(\checkmark\) 
ggbetweenstats 
Robust  Yuen’s test for trimmed means  \[\xi\]  \(\checkmark\) 
ggbetweenstats 
Robust  Heteroscedastic oneway ANOVA for trimmed means  \[\xi\]  \(\checkmark\) 
ggpiestats 
Parametric  \[\text{Pearson's}~ \chi^2 ~\text{test}\]  Cramer’s V  \(\checkmark\) 
ggpiestats 
Parametric  McNemar’s test  odds ratio (OR)  \(\checkmark\) 
ggscatterstats /ggcorrmat

Parametric  Pearson’s r  r  \(\checkmark\) 
ggscatterstats /ggcorrmat

Nonparametric  \[\text{Spearman's}~ \rho\]  \[\rho\]  \(\checkmark\) 
ggscatterstats /ggcorrmat

Robust  Percentage bend correlation  r  \(\checkmark\) 
gghistostats /ggdotplotstats

Parametric  Onesample ttest  Cohen’s d  \(\checkmark\) 
gghistostats 
Nonparametric  Onesample Wilcoxon signed rank test  Cohen’s d  \(\times\) 
gghistostats /ggdotplotstats

Robust  Onesample percentile bootstrap  robust estimator  \(\checkmark\) 
gghistostats /ggdotplotstats

Parametric  Regression models  \[\beta\]  \(\checkmark\) 
For the ggbetweenstats
function, the following posthoc tests are available for (adjusted) pairwise multiple comparisons:
Type  Design  Equal variance assumed?  Pairwise comparison test  pvalue adjustment? 

Parametric  betweensubjects  No  GamesHowell test  \(\checkmark\) 
Parametric  betweensubjects  Yes  Student’s ttest  \(\checkmark\) 
Parametric  withinsubjects  NA 
Student’s ttest  \(\checkmark\) 
Nonparametric  betweensubjects  No  DwassSteelCrichtlowFligner test  \(\checkmark\) 
Nonparametric  withinsubjects  No  DurbinConover test  \(\checkmark\) 
Robust  betweensubjects  No  Yuen’s trimmed means test  \(\checkmark\) 
Robust  withinsubjects  NA 
Yuen’s trimmed means test  \(\checkmark\) 
Bayes Factor  betweensubjects  No  \(\times\)  \(\times\) 
Bayes Factor  betweensubjects  Yes  \(\times\)  \(\times\) 
Bayes Factor  withinsubjects  NA 
\(\times\)  \(\times\) 
Note
NA
: not applicableOne of the important functions of a plot is to show the variation in the data, which comes in two forms:
ggstatsplot
, the actual variation in measurements is shown by plotting a combination of (jittered) raw data points with a boxplot laid on top (Figure1) or a histogram (Figure5). None of the plots, where empirical distribution of the data is concerned, show the sample standard deviation because they are poor at conveying information about limits of the sample and presence of outliers (Cleveland, 1985, p.220).# for reproducibility
set.seed(123)
# plot
ggstatsplot::gghistostats(
data = morley,
x = Speed,
test.value = 792,
test.value.line = TRUE,
bf.message = TRUE,
xlab = "Speed of light (km/sec, with 299000 subtracted)",
title = "Figure5: Distribution of Speed of light",
caption = "Note: Data collected across 5 experiments (20 measurements each)",
messages = FALSE
)
ggstatsplot
plots instead use 95% confidence intervals (e.g., Figure6). This is because the interval formed by error bars correspond to a 68% confidence interval, which is not a particularly interesting interval (Cleveland, 1985, p.222225).# for reproducibility
set.seed(123)
# plot
ggstatsplot::ggcoefstats(x = lme4::lmer(
total.fruits ~ nutrient + rack + (nutrient 
popu / gen),
data = lme4::Arabidopsis
),
p.kr = FALSE)
#> singular fit
#> Computing pvalues via Waldstatistics approximation (treating t as Wald z).
The default setting in ggstatsplot
is to produce plots with statistical details included. Most often than not, the results are displayed as a subtitle
in the plot. Great care has been taken into which details are included in statistical reporting and why.
Default statistical tests:
Dealing with null results:
Avoiding the “pvalue error”:
The pvalue indexes the probability that the researchers have falsely rejected a true null hypothesis (Type I error, i.e.) and can rarely be exactly 0. And yet over 97,000 manuscripts on Google Scholar report the pvalue to be p = 0.000
(Lilienfeld et al., 2015), putatively due to relying on default computer outputs. All pvalues displayed in ggstatsplot
plots avoid this mistake. Anything less than p < 0.001
is displayed as such (e.g, Figure1). The package deems it unimportant how infinitesimally small the pvalues are and, instead, puts emphasis on the effect size magnitudes and their 95% CIs.
There are three main documents one can rely on to learn how to use ggstatsplot
:
Manual:
The CRAN
reference manual provides detailed documentation about arguments for each function and examples : https://cran.rproject.org/web/packages/ggstatsplot/ggstatsplot.pdf
README:
The GitHub README
document provides a quick summary of all available functionality without going too much into details: https://github.com/IndrajeetPatil/ggstatsplot/blob/master/README.md
Vignettes:
Vignettes contain probably the most detailed exposition. Every single function in ggstatsplot
has an associated vignette which describes in depth how to use the function and modify the defaults to customize the plot to your liking. All these vignettes can be accessed from the package website: https://indrajeetpatil.github.io/ggstatsplot/articles/
If you find any bugs or have any suggestions/remarks, please file an issue on GitHub
repository for this package: https://github.com/IndrajeetPatil/ggstatsplot/issues
Summarizing session information for reproducibility.
options(width = 200)
devtools::session_info()
#>  Session info 
#> setting value
#> version R Under development (unstable) (20181130 r75724)
#> os Windows 10 x64
#> system x86_64, mingw32
#> ui RTerm
#> language (EN)
#> collate English_United States.1252
#> ctype English_United States.1252
#> tz Asia/Calcutta
#> date 20181216
#>
#>  Packages 
#> package * version date lib source
#> assertthat 0.2.0 20170411 [1] CRAN (R 3.5.1)
#> backports 1.1.3 20181214 [1] CRAN (R 3.6.0)
#> BayesFactor 0.9.124.2 20180519 [1] CRAN (R 3.5.1)
#> bayesplot 1.6.0 20180802 [1] CRAN (R 3.5.1)
#> bindr 0.1.1 20180313 [1] CRAN (R 3.5.1)
#> bindrcpp * 0.2.2 20180329 [1] CRAN (R 3.5.1)
#> boot 1.320 20170806 [2] CRAN (R 3.6.0)
#> broom 0.5.1.9000 20181209 [1] Github (tidymodels/broom@9a85f75)
#> broom.mixed 0.2.3.9000 20181128 [1] Github (bbolker/broom.mixed@b3ad950)
#> ca 0.71 20181010 [1] CRAN (R 3.5.1)
#> callr 3.1.0 20181210 [1] CRAN (R 3.6.0)
#> cellranger 1.1.0 20160727 [1] CRAN (R 3.5.1)
#> cli 1.0.1.9000 20181030 [1] Github (rlib/cli@56538e3)
#> cluster 2.0.71 20180413 [2] CRAN (R 3.6.0)
#> coda 0.192 20181008 [1] CRAN (R 3.5.1)
#> codetools 0.215 20161005 [2] CRAN (R 3.6.0)
#> coin 1.22 20171128 [1] CRAN (R 3.5.1)
#> colorspace 1.32 20161214 [1] CRAN (R 3.5.1)
#> commonmark 1.7 20181201 [1] CRAN (R 3.6.0)
#> cowplot 0.9.99 20181029 [1] Github (wilkelab/cowplot@a4ccd77)
#> crayon 1.3.4 20170916 [1] CRAN (R 3.5.1)
#> data.table 1.11.8 20180930 [1] CRAN (R 3.5.1)
#> DEoptimR 1.08 20161119 [1] CRAN (R 3.5.0)
#> desc 1.2.0 20181030 [1] Github (rlib/desc@7c12d36)
#> devtools 2.0.1 20181026 [1] CRAN (R 3.5.1)
#> digest 0.6.18 20181010 [1] CRAN (R 3.5.1)
#> dplyr * 0.7.8 20181110 [1] CRAN (R 3.5.1)
#> effsize 0.7.1 20170321 [1] CRAN (R 3.5.1)
#> emmeans 1.3.1 20181213 [1] CRAN (R 3.6.0)
#> estimability 1.3 20180211 [1] CRAN (R 3.5.0)
#> evaluate 0.12 20181009 [1] CRAN (R 3.5.1)
#> exact2x2 1.6.3 20180727 [1] CRAN (R 3.5.1)
#> exactci 1.33 20171002 [1] CRAN (R 3.5.0)
#> extrafont 0.17 20141208 [1] CRAN (R 3.5.0)
#> extrafontdb 1.0 20120611 [1] CRAN (R 3.5.0)
#> fit.models 0.514 20170406 [1] CRAN (R 3.5.1)
#> forcats * 0.3.0 20180219 [1] CRAN (R 3.5.1)
#> foreign 0.871 20180720 [2] CRAN (R 3.6.0)
#> fs 1.2.6 20180823 [1] CRAN (R 3.5.1)
#> generics 0.0.2 20181129 [1] CRAN (R 3.6.0)
#> ggcorrplot 0.1.2.9000 20181028 [1] local
#> ggExtra 0.8 20181108 [1] Github (daattali/ggExtra@f2a04df)
#> ggplot2 * 3.1.0.9000 20181215 [1] Github (tidyverse/ggplot2@9292832)
#> ggrepel 0.8.0 20180509 [1] CRAN (R 3.5.1)
#> ggridges 0.5.1 20180927 [1] CRAN (R 3.5.1)
#> ggsignif 0.4.0 20170803 [1] CRAN (R 3.5.1)
#> ggstatsplot * 0.0.7.9000 20181216 [1] local
#> glmmTMB 0.2.2.0 20180703 [1] CRAN (R 3.5.1)
#> glue 1.3.0 20180717 [1] CRAN (R 3.5.1)
#> gnm 1.10 20180621 [1] CRAN (R 3.5.1)
#> groupedstats 0.0.4.9000 20181212 [1] local
#> gtable 0.2.0 20160226 [1] CRAN (R 3.5.1)
#> gtools 3.8.1 20180626 [1] CRAN (R 3.5.0)
#> haven 2.0.0 20181122 [1] CRAN (R 3.6.0)
#> highr 0.7 20180609 [1] CRAN (R 3.5.1)
#> hms 0.4.2 20180310 [1] CRAN (R 3.5.1)
#> hrbrthemes 0.5.0.1 20180819 [1] CRAN (R 3.5.1)
#> htmltools 0.3.6 20170428 [1] CRAN (R 3.5.1)
#> httpuv 1.4.5 20180719 [1] CRAN (R 3.5.1)
#> httr 1.4.0 20181211 [1] CRAN (R 3.6.0)
#> jmv 0.9.6 20181211 [1] CRAN (R 3.6.0)
#> jmvcore 0.9.5.2 20181210 [1] CRAN (R 3.6.0)
#> jsonlite 1.6 20181207 [1] CRAN (R 3.6.0)
#> knitr 1.21 20181210 [1] CRAN (R 3.6.0)
#> labeling 0.3 20140823 [1] CRAN (R 3.5.0)
#> later 0.7.5 20180918 [1] CRAN (R 3.5.1)
#> lattice 0.2038 20181104 [2] CRAN (R 3.6.0)
#> lazyeval 0.2.1 20171029 [1] CRAN (R 3.5.1)
#> lme4 1.119 20181110 [1] CRAN (R 3.6.0)
#> lmtest 0.936 20180404 [1] CRAN (R 3.5.1)
#> lubridate 1.7.4 20180411 [1] CRAN (R 3.5.1)
#> magrittr 1.5 20141122 [1] CRAN (R 3.5.1)
#> MASS 7.351.1 20181101 [2] CRAN (R 3.6.0)
#> Matrix 1.215 20181101 [1] CRAN (R 3.5.1)
#> MatrixModels 0.41 20150822 [1] CRAN (R 3.5.1)
#> mc2d 0.118 20170306 [1] CRAN (R 3.5.1)
#> memoise 1.1.0 20170421 [1] CRAN (R 3.5.1)
#> metafor 2.00 20170622 [1] CRAN (R 3.5.1)
#> mime 0.6 20181005 [1] CRAN (R 3.5.1)
#> miniUI 0.1.1.1 20180518 [1] CRAN (R 3.5.1)
#> minqa 1.2.4 20141009 [1] CRAN (R 3.5.1)
#> mnormt 1.55 20161015 [1] CRAN (R 3.5.0)
#> modelr 0.1.2 20180511 [1] CRAN (R 3.5.1)
#> modeltools 0.222 20180716 [1] CRAN (R 3.5.1)
#> multcomp 1.48 20171108 [1] CRAN (R 3.5.1)
#> munsell 0.5.0 20180612 [1] CRAN (R 3.5.1)
#> mvtnorm 1.08 20180531 [1] CRAN (R 3.5.0)
#> nlme 3.1137 20180407 [2] CRAN (R 3.6.0)
#> nloptr 1.2.1 20181003 [1] CRAN (R 3.5.1)
#> nnet 7.312 20160202 [2] CRAN (R 3.6.0)
#> paletteer 0.1.0 20180710 [1] CRAN (R 3.5.1)
#> pbapply 1.34 20180110 [1] CRAN (R 3.5.0)
#> pcaPP 1.973 20180114 [1] CRAN (R 3.5.0)
#> pillar 1.3.1 20181215 [1] CRAN (R 3.6.0)
#> pkgbuild 1.0.2 20181016 [1] CRAN (R 3.5.1)
#> pkgconfig 2.0.2 20180816 [1] CRAN (R 3.5.1)
#> pkgdown 1.3.0 20181207 [1] CRAN (R 3.6.0)
#> pkgload 1.0.2 20181029 [1] CRAN (R 3.6.0)
#> plyr 1.8.4 20160608 [1] CRAN (R 3.5.1)
#> prediction 0.3.6.1 20181204 [1] CRAN (R 3.6.0)
#> prettyunits 1.0.2 20150713 [1] CRAN (R 3.5.1)
#> processx 3.2.1 20181205 [1] CRAN (R 3.6.0)
#> promises 1.0.1 20180413 [1] CRAN (R 3.5.1)
#> ps 1.2.1 20181106 [1] CRAN (R 3.6.0)
#> psych 1.8.11.15 20181116 [1] local
#> purrr * 0.2.5.9000 20181128 [1] Github (tidyverse/purrr@b4ae036)
#> purrrlyr 0.0.3.9000 20181117 [1] Github (hadley/purrrlyr@3feae44)
#> pwr 1.22 20180303 [1] CRAN (R 3.5.1)
#> qvcalc 0.91 20170919 [1] CRAN (R 3.5.1)
#> R6 2.3.0 20181004 [1] CRAN (R 3.5.1)
#> Rcpp 1.0.0 20181107 [1] CRAN (R 3.6.0)
#> readr * 1.3.0.9000 20181212 [1] Github (tidyverse/readr@27da43e)
#> readxl 1.1.0 20180420 [1] CRAN (R 3.5.1)
#> relimp 1.05 20160330 [1] CRAN (R 3.5.1)
#> remotes 2.0.2 20181030 [1] CRAN (R 3.6.0)
#> reshape 0.8.8 20181023 [1] CRAN (R 3.6.0)
#> reshape2 1.4.3 20171211 [1] CRAN (R 3.5.1)
#> rjson 0.2.20 20180608 [1] CRAN (R 3.5.0)
#> rlang * 0.3.0.1 20181025 [1] CRAN (R 3.5.1)
#> rmarkdown 1.11 20181208 [1] CRAN (R 3.6.0)
#> robust 0.418 20170427 [1] CRAN (R 3.5.1)
#> robustbase 0.933 20180921 [1] CRAN (R 3.5.1)
#> roxygen2 6.1.1 20181107 [1] CRAN (R 3.6.0)
#> rprojroot 1.32 20180103 [1] CRAN (R 3.5.1)
#> rrcov 1.47 20181115 [1] CRAN (R 3.6.0)
#> rstudioapi 0.8 20181002 [1] CRAN (R 3.5.1)
#> Rttf2pt1 1.3.7 20180629 [1] CRAN (R 3.5.0)
#> rvest 0.3.2 20160617 [1] CRAN (R 3.5.1)
#> sandwich 2.50 20180817 [1] CRAN (R 3.5.1)
#> scales 1.0.0 20180809 [1] CRAN (R 3.5.1)
#> sessioninfo 1.1.1 20181105 [1] CRAN (R 3.6.0)
#> shiny 1.2.0 20181102 [1] CRAN (R 3.5.1)
#> sjlabelled 1.0.15 20181122 [1] CRAN (R 3.6.0)
#> sjmisc 2.7.6 20181106 [1] CRAN (R 3.6.0)
#> sjstats 0.17.2 20181115 [1] CRAN (R 3.6.0)
#> skimr 1.0.3 20180607 [1] CRAN (R 3.5.1)
#> snakecase 0.9.2 20180814 [1] CRAN (R 3.5.1)
#> ssanv 1.1 20150623 [1] CRAN (R 3.5.0)
#> stringdist 0.9.5.1 20180608 [1] CRAN (R 3.5.1)
#> stringi 1.2.4 20180720 [1] CRAN (R 3.6.0)
#> stringr * 1.3.1 20180510 [1] CRAN (R 3.5.1)
#> survival 2.433 20181126 [2] CRAN (R 3.6.0)
#> testthat 2.0.1 20181013 [1] CRAN (R 3.5.1)
#> TH.data 1.09 20180710 [1] CRAN (R 3.5.1)
#> tibble * 1.4.99.9006 20181129 [1] Github (tidyverse/tibble@a248cf1)
#> tidyr * 0.8.2 20181028 [1] CRAN (R 3.6.0)
#> tidyselect 0.2.5 20181011 [1] CRAN (R 3.5.1)
#> tidyverse * 1.2.1 20171114 [1] CRAN (R 3.5.1)
#> TMB 1.7.15 20181109 [1] CRAN (R 3.6.0)
#> usethis 1.4.0.9000 20181212 [1] Github (rlib/usethis@923dd75)
#> vcd 1.44 20171206 [1] CRAN (R 3.5.1)
#> vcdExtra 0.71 20170929 [1] CRAN (R 3.5.1)
#> withr 2.1.2 20180315 [1] CRAN (R 3.5.1)
#> WRS2 0.100 20180615 [1] CRAN (R 3.5.1)
#> xfun 0.4 20181023 [1] CRAN (R 3.6.0)
#> xml2 1.2.0 20180124 [1] CRAN (R 3.5.1)
#> xtable 1.83 20180829 [1] CRAN (R 3.5.1)
#> yaml 2.2.0 20180725 [1] CRAN (R 3.5.1)
#> zoo 1.84 20180919 [1] CRAN (R 3.5.1)
#>
#> [1] C:/Users/inp099/Documents/R/winlibrary/3.6
#> [2] C:/Program Files/R/Rdevel/library