Chapter page 3 / 38Preface
English

Preface

Welcome to the second edition of “Introduction to Modern Statistics”!

We hope readers will take away three ideas from this book in addition to forming a foundation of statistical thinking and methods.

  1. Statistics is an applied field with a wide range of practical applications.
  2. You don’t have to be a math guru to learn from interesting, real data.
  3. Data are messy, and statistical tools are imperfect. However, when you understand the strengths and weaknesses of these tools, you can use them to learn interesting things about the world.

Textbook overview

  • Part 1: Introduction to data. Data structures, variables, summaries, graphics, and basic data collection and study design techniques.
  • Part 2: Exploratory data analysis. Data visualization and summarization, with particular emphasis on multivariable relationships.
  • Part 3: Regression modeling. Modeling numerical and categorical outcomes with linear and logistic regression and using model results to describe relationships and make predictions.
  • Part 4: Foundations for inference. Case studies are used to introduce the ideas of statistical inference with randomization tests, bootstrap intervals, and mathematical models.
  • Part 5: Statistical inference. Further details of statistical inference using randomization tests, bootstrap intervals, and mathematical models for numerical and categorical data.
  • Part 6: Inferential modeling. Extending inference techniques presented thus-far to linear and logistic regression settings and evaluating model performance.

Each part contains multiple chapters and ends with a case study. Building on the content covered in the part, the case study presents a high-level overview using the tools and techniques from the part.

In the chapters that cover statistical inference, we have presented a parallel structure that walks the student through both computational and mathematical approaches to every inferential topic. Trying to cover every approach for every topic is likely too much material for a one semester class. We suggest that you make deliberate choices for navigating the book with your students. A few potential paths through the book (with chapter numbers in parentheses) are given as follows:

  • Focus on parallel structure of computational and mathematical methods: Introduction to data (1, 2), Exploratory data analysis (4, 5), Regression (7), Foundations (11, 12, 13, 14), Inference (a subset of: 16, 17, 18, 19, 20, 21, 22; potentially: 16, 17, 19, 20).
  • Focus on computational methods: Introduction to data (1, 2), Exploratory data analysis (4, 5), Regression (7), Foundations (11, 12, 14), Inference (computational methods only for some subset of: 16, 17, 18, 19, 20, 21, 22).
  • Focus on mathematical methods: Introduction to data (1, 2), Exploratory data analysis (4, 5), Regression (7), Foundations (11, 12, 13, 14), Inference (mathematical methods only for some subset of: 16, 17, 18, 19, 20, 21, 22).
  • Focus on modeling: Introduction to data (1, 2), Exploratory data analysis (4, 5), Regression (7, 8, 9), Foundations (11, 12, 13, 14), Inference (19), Inferential modeling (24, 25, 26).

We expect that most courses following a classical syllabus will not have time to cover the chapters in the last part, Inferential modeling (24, 25, 26).

Each chapter ends with a review which contains a chapter summary as well as a list of key terms introduced in the chapter. If you’re not sure what some of these terms mean, we recommend you go back in the text and review their definitions. We purposefully present them in alphabetical order, instead of in order of appearance, so they will be a little more challenging to locate. However, you should be able to easily spot them as bolded text.

Changes for the second edition

While the second edition does not represent a major change from the first edition, we have worked hard to improve content, to add exercises, and to update text and code to reflect changes in best practices (e.g., the book is now written in Quarto).

A brief summary of the biggest changes follows:

  • Twenty-five completely new exercises were added. Most of the new exercises are concatenated onto existing exercises so as to retain similar numbering across editions. However, a few exercises have been moved in order to produce both odd exercises (with solutions) and even exercises (without solutions) on the same topic.

  • Multiple datasets were added or updated. For example, the pm25_2022_durham data on air quality in Durham, NC in 2022 can be found in the openintro R package.

  • Chapter 3  Applications: Data was re-written with an updated context and data example. Additionally, in Chapter 3  Applications: Data, we explore Simpson’s Paradox.

  • Throughout the text and the exercises, “statistically significant” has been changed to “statistically discernible” so as to distance ourselves from the more colloquial use of the word “significant.”

Examples and exercises

Examples are provided to establish an understanding of how to apply methods.

This is an example. When a question is asked here, where can the answer be found?


The answer can be found here, in the solution section of the example!

When we think the reader is ready to try determining a solution on their own, we frame it as Guided Practice.

The reader may check or learn the answer to any Guided Practice problem by reviewing the full solution in a footnote.1

Exercises are also provided at the end of each chapter. Solutions are given for odd-numbered exercises in Appendix Appendix A — Exercise solutions.

Datasets and their sources

A large majority of the datasets used in the book can be found in various R packages. Each time a new dataset is introduced in the narrative, a reference to the package like the one below is provided. Many of these datasets are in the openintro R package that contains datasets used in OpenIntro’s open-source textbooks.2

The textbooks data can be found in the openintro R package.

The datasets used throughout the book come from real sources like opinion polls and scientific articles, except for a handful of cases where we use toy data to highlight a particular feature or explain a particular concept. References for the sources of the real data are provided at the end of the book.

Computing with R

The narrative and the exercises in the book are computing language agnostic, however while it’s possible to learn about modern statistics without computing, it’s not possible to apply it. Therefore, we invite you to navigate the concepts you have learned in each part using the interactive R tutorials and the R labs that are included at the end of each part.

Interactive R tutorials

The self-paced and interactive R tutorials were developed using the learnr R package, and only an internet browser is needed to complete them.

Each part comes with a tutorial comprised of 4-10 lessons and listed like this.

Each of these lessons is listed like this.

You can access the full list of tutorials supporting this book here.

R labs

Once you feel comfortable with the material in the tutorials, we also encourage you to apply what you’ve learned via the computational labs that are also linked at the end of each part. The labs consist of data analysis case studies, and they require access to R and RStudio. The first lab includes installation instructions. If you’d rather not install the software locally, you can also try Posit Cloud for free.

Labs for each part are listed like this.

You can access the full list of labs supporting this book here.

OpenIntro, online resources, and getting involved

OpenIntro is an organization focused on developing free and affordable education materials. We encourage anyone learning or teaching statistics to visit openintro.org and to get involved.

All OpenIntro resources are free and anyone is welcomed to use these online tools and resources with or without this textbook as a companion.

We value your feedback. If there is a part of the project you especially like or think needs improvement, we want to hear from you. For feedback on this specific book, you can open an issue on the GitHub repository of the book at github.com/openintrostat/ims. You can also provide feedback on this book or any other OpenIntro resource via our contact form at openintro.org.

Acknowledgements

The OpenIntro project would not have been possible without the dedication and volunteer hours of all those involved, and we hope you will join us in extending a huge thank you to all those who volunteer with OpenIntro.

The authors would like to thank the following individuals:

  • David Diez and Christopher Barr for their work on the 1st Edition of this book,
  • Ben Baumer and Andrew Bray for their contribution rethinking how and which order we present this material as well as their work as original authors of the interactive tutorial content,
  • Yanina Bellini Saibene, Florencia D’Andrea, and Roxana Noelia Villafañe for their work on creating the interactive tutorials in learnr,
  • Peter Baumgartner for review and revisions of the interactive learnr tutorials,
  • Will Gray for conceptual diagrams,
  • Allison Theobold, Melinda Yager, and Randy Prium for their valuable feedback and review of the book,
  • Colin Rundel for feedback on content and technical help with conversion from LaTeX to R Markdown,
  • Christophe Dervieux for help with multi-output bookdown issues, and
  • Müge Çetinkaya and Meenal Patel for their design vision.

We would like to also thank the developers of the open-source tools that make the development and authoring of this book possible, e.g., Quarto, tidyverse, tidymodels, and icons8.

We are also grateful to the many teachers, students, and other readers who have helped improve OpenIntro resources through their feedback.


  1. Guided Practice problems are intended to stretch your thinking, and you can check yourself by reviewing the footnote solution for any Guided Practice.↩︎

  2. Mine Çetinkaya-Rundel and David Diez and Andrew Bray and Albert Y. Kim and Ben Baumer and Chester Ismay and Nick Paterno and Christopher Barr (2024). openintro: Datasets and Supplemental Functions from ‘OpenIntro’ Textbooks and Labs. R package version 2.5.0. https://github.com/openintrostat/openintro.↩︎

中文

前言

欢迎阅读《现代统计学导论》第二版!

我们希望读者在建立统计思维和方法的基础之外,还能从本书中获得三个理念。

  1. 统计学是一个应用性领域,具有广泛的实际应用。
  2. 你不必是数学高手,也能从有趣的真实数据中学习。
  3. 数据是杂乱的,统计工具也不完美。然而,当你理解了这些工具的优点和缺点之后,就可以利用它们来了解世界上有趣的事情。

教材概览

  • 第1部分:数据导论。 数据结构、变量、汇总、图形,以及基本的数据收集与研究设计技术。
  • 第2部分:探索性数据分析。 数据可视化与汇总,特别强调多变量关系。
  • 第3部分:回归建模。 使用线性回归和逻辑回归对数值型和分类型结果进行建模,并利用模型结果描述关系和进行预测。
  • 第4部分:推断基础。 通过案例研究,借助随机化检验、自助法区间和数学模型介绍统计推断的思想。
  • 第5部分:统计推断。 进一步详细介绍针对数值型和分类型数据的随机化检验、自助法区间和数学模型的统计推断。
  • 第6部分:推断建模。 将此前介绍的推断技术扩展到线性回归和逻辑回归的场景中,并评估模型性能。

每个部分包含多个章节,并以一个案例研究结束。案例研究基于该部分所涵盖的内容,使用该部分的工具和技术提供高层次的概述。

在涵盖统计推断的章节中,我们采用了一种并行结构,引导学生通过计算和数学两种方法学习每个推断主题。试图涵盖每个主题的所有方法,对于一个学期的课程来说内容可能过多。我们建议您在与学生一起使用本书时做出审慎的选择。以下是贯穿本书的几条可能的路径(括号中为章节编号):

  • 专注于 计算与数学方法的并行结构:数据导论(1、2),探索性数据分析(4、5),回归(7),基础(11、12、13、14),推断(16、17、18、19、20、21、22 的一个子集;可选:16、17、19、20)。
  • 专注于 计算方法:数据导论(1、2),探索性数据分析(4、5),回归(7),基础(11、12、14),推断(16、17、18、19、20、21、22 中某个子集的计算方法)。
  • 专注于 数学方法:数据导论(1、2),探索性数据分析(4、5),回归(7),基础(11、12、13、14),推断(16、17、18、19、20、21、22 中某个子集的数学方法)。
  • 专注于 建模:数据导论(1、2),探索性数据分析(4、5),回归(7、8、9),基础(11、12、13、14),推断(19),推断建模(24、25、26)。

我们预计,遵循经典教学大纲的大多数课程将没有时间涵盖最后一部分“推断建模”(第24、25、26章)的内容。

每章末尾都有一个复习部分,其中包含本章小结以及本章所介绍的关键术语列表。如果你不确定其中某些术语的含义,我们建议你回到正文中复习它们的定义。我们特意按字母顺序而非出现顺序呈现这些术语,因此查找起来会稍有难度。不过,你应该能够轻松地找到它们,因为它们以 粗体文本.

第二版的变化

虽然第二版相对于 第一版并没有重大改动,但我们努力改进了内容、增加了习题,并更新了文本和代码以反映最佳实践的变化(例如,本书现在是用 Quarto).

以下是最大变化的简要总结:

  • 新增了25道全新的习题。大部分新习题被附加在现有习题之后,以保持各版本之间编号的相似性。不过,为了在同一主题下同时提供奇数题(附解答)和偶数题(不附解答),少数习题被移动了位置。

  • 新增或更新了多个数据集。例如, pm25_2022_durham 数据集包含2022年北卡罗来纳州达勒姆的空气质量数据,可在 openintro R 包中找到。

  • 第 3 应用:数据 进行了重写,更新了背景和数据示例。此外,在 第 3 应用:数据中,我们探讨了辛普森悖论。

  • 在全书正文和习题中,“statistically significant(统计学上显著)”已改为“statistically discernible(统计学上可辨识)”,以避免与“significant(显著)”一词更口语化的用法相混淆。

示例与习题

书中提供了示例,以帮助建立对如何应用各种方法的理解。

这是一个示例。当这里提出一个问题时,答案可以在哪里找到?


答案可以在本页示例的解答部分找到!

当我们认为读者已经准备好尝试自己确定解决方案时,我们会将其框定为“引导练习”。

读者可以通过查看脚注中的完整解答来核对或学习任何引导练习题的答案。1

每章末尾还提供了练习题。奇数编号练习的解答在 附录 附录A — 练习题解答.

数据集及其来源

本书中使用的大部分数据集都可以在各种 R 包中找到。每当叙述中引入新数据集时,都会提供如下所示的包引用。其中许多数据集都在 openintro 这个 R 包中,该包包含 OpenIntro的开源教科书所使用的数据集。2

textbooks 数据可以在 openintro R 包中找到。

本书中使用的数据集来自真实的来源,如民意调查和科学文章,只有少数情况下我们会使用玩具数据来突出某个特定特征或解释某个特定概念。真实数据来源的参考文献在书末提供。

使用 R 进行计算

本书的叙述和练习与计算语言无关,然而虽然可以在不使用计算的情况下学习现代统计学,但无法将其付诸应用。因此,我们邀请您通过每部分末尾附带的交互式 R 教程和 R 实验来温习您在各部分中学到的概念。

交互式 R 教程

这些自学式交互式 R 教程是使用 learnr R 包开发的,只需一个互联网浏览器即可完成。

每部分都附带一个由 4-10 节课程组成的教程,列出方式如下。

每节课的列出方式如下。

你可以访问支持本书的完整教程列表 这里.

R 实验课

一旦你对教程中的内容感到熟悉,我们还鼓励你通过计算实验课来应用所学知识,这些实验课的链接也附在每部分末尾。实验课由数据分析案例研究组成,需要使用 RRStudio。第一个实验课包含安装说明。如果你不想在本地安装软件,也可以免费试用 Posit Cloud

每部分的实验课列出方式如下。

你可以访问支持本书的完整实验课列表 这里.

OpenIntro、在线资源与参与其中

OpenIntro 是一个专注于开发免费和低价教育材料的组织。我们鼓励任何学习或教授统计学的人访问 openintro.org 并参与其中。

所有 OpenIntro 资源都是免费的,任何人都可以使用这些在线工具和资源,无论是否将本教科书作为配套教材。

我们重视你的反馈。如果你特别喜欢本项目的某个部分,或者认为某个部分需要改进,我们希望听到你的意见。关于本书的反馈,你可以在本书的 GitHub 仓库中提交 issue,网址为 github.com/openintrostat/ims。您也可以通过我们的联系表单(网址为 openintro.org.

致谢

OpenIntro 项目的完成离不开所有参与者的奉献和志愿付出,我们希望您能与我们一起向所有 OpenIntro 的志愿者致以巨大的 感谢

作者们要感谢以下人士:

  • David Diez 和 Christopher Barr,感谢他们为本书第 1 版所做的工作,
  • Ben Baumer 和 Andrew Bray,感谢他们重新思考我们呈现这些材料的方式和顺序,以及他们作为交互式教程内容最初作者所做的工作,
  • Yanina Bellini Saibene、Florencia D’Andrea 和 Roxana Noelia Villafañe,感谢他们使用 learnr 创建交互式教程的工作,
  • Peter Baumgartner,感谢他对交互式 learnr 教程的审阅和修订,
  • Will Gray,感谢他制作的概念图,
  • Allison Theobold、Melinda Yager 和 Randy Prium,感谢他们对本书宝贵的反馈和审阅,
  • Colin Rundel,感谢他对内容的反馈以及从 LaTeX 转换为 R Markdown 的技术帮助,
  • Christophe Dervieux,感谢他对 bookdown 多输出问题的帮助,以及
  • Müge Çetinkaya 和 Meenal Patel,感谢他们的设计理念。

我们还要感谢那些开源工具的开发者们,正是这些工具使本书的开发和编写成为可能,例如: Quarto, tidyverse, tidymodelsicons8.

我们同样感谢众多教师、学生和其他读者,他们通过反馈帮助改进了 OpenIntro 的资源。


  1. “引导练习”(Guided Practice)题目旨在拓展你的思维,你可以通过查看脚注中的解答来自行核对任何引导练习。↩︎

  2. Mine Çetinkaya-Rundel and David Diez and Andrew Bray and Albert Y. Kim and Ben Baumer and Chester Ismay and Nick Paterno and Christopher Barr (2024). openintro: Datasets and Supplemental Functions from ‘OpenIntro’ Textbooks and Labs. R package version 2.5.0. https://github.com/openintrostat/openintro.↩︎