Posted on Friday, March 24, 2023
The New England Statistical Society
(NESS) is delighted to launch a new webinar series on
selected papers published in the New England Journal of Statistics in Data
Science (NEJSDS). The webinar series is held
online and open to everyone. We cordially invite you to the inaugural webinar
of this series.
Speaker: Xiao-Li Meng, Whipple V. N. Jones Professor of Statistics, Harvard University
Panelist:
- Christine Franklin, ASA K-12 Statistical Ambassador
- Thomas R. Junk, Fermi National Accelerator Laboratory
- Nicole A Lazar, Department of Statistics, Penn State University
- Grace Y. Yi (Chair), Canada Research Chair in Data Science (Tier 1), University of Western Ontario
Date: Tuesday, May 16, 2023
Time: 1PM - 2PM Eastern Time
The webinar includes discussions from the panelist, and Q&A with the audience.
Discussions by the authors and panelists, including Q&A with the audience. The
webinar will be recorded and posted online at the
NEJSDS website afterwards.
Abstract:
This article expands upon my presentation to the panel on “The Radical
Prescription for Change” at the 2017 ASA (American Statistical Association)
symposium on A World Beyond p<0.05. It emphasizes that, to greatly enhance the
reliability of—and hence public trust in—statistical and data scientific
findings, we need to take a holistic approach. We need to lead by example,
incentivize study quality, and inoculate future generations with profound
appreciations for the world of uncertainty and the uncertainty world. The four
“radical” proposals in the title—with all their inherent defects and
trade-offs—are designed to provoke reactions and actions. First, research
methodologies are trustworthy only if they deliver what they promise, even if
this means that they have to be overly protective, a necessary trade-off for
practicing quality-guaranteed statistics. This guiding principle may compel us
to doubling variance in some situations, a strategy that also coincides with
the call to raise the bar from p<0.05 to p<0.005. Second, teaching principled
practicality or corner-cutting is a promising strategy to enhance the
scientific community’s as well as the general public’s ability to spot—and
hence to deter—flawed arguments or findings. A remarkable quick-and-dirty Bayes
formula for rare events, which simply divides the prevalence by the sum of the
prevalence and the false positive rate (or the total error rate), as featured
by the popular radio show Car Talk, illustrates the effectiveness of this
strategy. Third, it should be a routine mental exercise to put ourselves in the
shoes of those who would be affected by our research finding, in order to
combat the tendency of rushing to conclusions or overstating confidence in our
findings. A pufferfish/selfish test can serve as an effective reminder, and can
help to institute the mantra “Thou shalt not sell what thou refuseth to buy” as
the most basic professional decency. Considering personal stakes in our
statistical endeavors also points to the concept of behavioral statistics, in
the spirit of behavioral economics. Fourth, the current mathematical education
paradigm that puts “deterministic first, stochastic second” is likely
responsible for the general difficulties with reasoning under uncertainty, a
situation that can be improved by introducing the concept of histogram, or
rather kidstogram, as early as the concept of counting.
Discussions:
- Radical and Not-So-Radical Principles and Practices: Discussion of
Meng, by Ronald
L. Wasserstein, Allen L. Schirm, Nicole A. Lazar
- Comment on “Double Your Variance, Dirtify Your Bayes, Devour Your
Pufferfish, and Draw your Kidstogram” by Xiao-Li
Meng, by
Christine Franklin
- Comment on Meng’s “Double Your Variance, Dirtify Your Bayes, Devour Your
Pufferfish, and Draw Your
Kidstogram” by
Eric D. Kolaczyk
- Comment on “Double Your Variance, Dirtify Your Bayes, Devour Your
Pufferfish, and Draw Your Kidstogram” by Xiao-Li
Meng by Thomas
R. Junk
- Comments on Xiao-Li Meng’s Double Your Variance, Dirtify Your Bayes,
Devour Your Pufferfish, and Draw Your
Kidstogram by
Dennis K.J. Lin
- A Not-so-radical Rejoinder: Habituate Systems Thinking and Data (Science)
Confession for Quality
Enhancement by
Xiao-Li Meng
Video Recoding Link:
Click here to view the video recoding