Philosophy of Science Association - Event Information
Event Name:
Phil Stat Wars Forum: "Testing with Models That Are Not True" (Christian Hennig)
Event Type(s):
Event
Description:
Christian Hennig on Testing with Models That Are Not True, at the 6th meeting of the Phil Stat Forum: The Statistics Wars and Their Casualties.
Event Date:
2/18/2021
Event Time:
10:00 AM - 11:45 AM Eastern
Location:
on-line
Details:
If you would like to constructively engage with us, see this pdf for instructions: https://philstatwars.files.wordpress.com/2020/09/info-phil-stat-forum-september.pdf
TESTING WITH MODELS THAT ARE NOT TRUE
Christian Hennig (Dept. of Statistical Sciences, University of Bologna)
ABSTRACT: The starting point of my presentation is the apparently popular idea that in order to do hypothesis testing (and more generally frequentist model-based inference) we need to believe that the model is true, and the model assumptions need to be fulfilled. I will argue that this is a misconception. Models are, by their very nature, not "true" in reality. Mathematical results secure favourable characteristics of inference in an artificial model world in which the model assumptions are fulfilled. For using a model in reality we need to ask what happens if the model is violated in a "realistic" way. One key approach is to model a situation in which certain model assumptions of, e.g., the model-based test that we want to apply, are violated, in order to find out what happens then. This, somewhat inconveniently, depends strongly on what we assume, how the model assumptions are violated, whether we make an effort to check them, how we do that, and what alternative actions we take if we find them wanting. I will discuss what we know and what we can't know regarding the appropriateness of the models that we "assume", and how to interpret them appropriately, including new results on conditions for model assumption checking to work well, and on untestable assumptions.
TESTING WITH MODELS THAT ARE NOT TRUE
Christian Hennig (Dept. of Statistical Sciences, University of Bologna)
ABSTRACT: The starting point of my presentation is the apparently popular idea that in order to do hypothesis testing (and more generally frequentist model-based inference) we need to believe that the model is true, and the model assumptions need to be fulfilled. I will argue that this is a misconception. Models are, by their very nature, not "true" in reality. Mathematical results secure favourable characteristics of inference in an artificial model world in which the model assumptions are fulfilled. For using a model in reality we need to ask what happens if the model is violated in a "realistic" way. One key approach is to model a situation in which certain model assumptions of, e.g., the model-based test that we want to apply, are violated, in order to find out what happens then. This, somewhat inconveniently, depends strongly on what we assume, how the model assumptions are violated, whether we make an effort to check them, how we do that, and what alternative actions we take if we find them wanting. I will discuss what we know and what we can't know regarding the appropriateness of the models that we "assume", and how to interpret them appropriately, including new results on conditions for model assumption checking to work well, and on untestable assumptions.
Email Reminder: