Greetings! We are Manuel Voelkle from the Max Planck Institute for Human Development in Berlin (Germany) and Han Oud from Radboud University in Nijmegen (The Netherlands). We are both interested in longitudinal data analysis and are trying to advance statistical methods for the analysis of change, as well as to improve their use and communication.
Hot Tip: Longitudinal data analysis is special!
Consider the following model which postulates an effect of Z (e.g., an intervention) on an outcome variable Y:
This model can be interpreted in two different ways: Either in a descriptive way (i.e., it describes the relationship between two variables and can be used to predict Y from Z) or in a causal way (i.e., Z causes Y). Which of the two interpretations is correct is up to the evaluator to find out by means of clever research designs.
What about longitudinal data analysis? In the figure below, we replaced Z by time. This is what we do when we use multilevel models or latent growth curve models as illustrated by the equation to the right.
It is important to realize that this model always remains at the descriptive level. Time never causes anything!
If we are interested in causal mechanisms, we should aim at models like the one shown below, that allow us to study the relationship between variables as they evolve and unfold over time, without time being a predictor.
Hot Tip: Most real-world processes develop continuously over time!
Although extremely useful and popular in modern evaluation research, the latter class of models suffers from the problem that only the order, but not the actual time intervals are taken into account. This causes problems when time intervals are different. For example if a time interval of 1 week is used in one study, but a time interval of 2 weeks in another study, the parameter estimates will be different, but it is unclear whether this is because the actual process, or the time intervals, differed.
Hot Tip: Use continuous time models!
Put more generally, most phenomena in the real world develop continuously over time and should be modeled as such. For this purpose continuous time models have been developed. In short, instead of predicting X directly, we predict the derivative of X with respect to time. This provides us with parameter estimates that are independent of the discrete time intervals a researcher happens to have chosen, and allows us to compare parameter estimates across studies (or individuals) based on different time intervals.
This contribution is from the aea365 Tip-a-Day Alerts, by and for evaluators, from the American Evaluation Association. Please consider contributing – send a note of interest to email@example.com. Want to learn more from Manuel and Han? They’ll be presenting as part of the Evaluation 2012 Conference Program, October 24-27 in Minneapolis, MN.