5984 | Assessment |
Research Question | The general area of the research question is clear, but not very well specified. Identifying the difference in average outcomes between the two types of schools is okay, but does not tell us much unless the research can explain that difference. This does not now appear as part of the research question. |
Relevant Literature | Plan is okay, but seems to neglect the most important goal, which is to explore the existing research on the central question. The central contribution of this research seems to be that it is pursuing a well-known empirical question in a different social context. So, the first goal of the literature review is to fully examine the past work on this question, particularly to identify the range of research strategies that have been used. The research design for this project should build directly on these past research efforts. |
Causal Interpretations | The loose discussion of conditions that might produce a difference is okay for a start, but it seems to be disconnected from the research plan. We normally want to have indicators for the relevant causal conditions we are studying, otherwise we won't have much to say about them. |
Data | The data mentioned seems a fair start if you have access to it.
Make certain of that. However,
it is still not obvious how effective the research can be if all the data are
aggregate characteristics of schools and average outcomes for their
students. For example, a critical
issue concerns selection effects - the likelihood that those who attend the
newer schools differ in ways that have causal significance. If the more ambitious students, and those
with more supportive parents, disproportionately go to the new schools, then
the average outcomes for those schools will be higher as a composition or
selection effect, even if the schools have no differential effect. How can you address such issues with the
data available? You plan to use a “simple regression” of test score on charter school status. Try to clarify what you would include in your regression model. You will want to indicate which potential cofounding influences will be represented in the data set and what important ones are not available to you. Also, you describe varied reasons why charter school status might be associated with better or worse test scores, but you don’t explain how or if you will address these potential mediators using your dataset. |
Research Value | Okay. |
Timetable | A bit vague, and potentially optimistic if the required data are not immediately available. |
Priorities for Developing a Full Draft | Focus on clarifying the research goals and specific research strategy for achieving them. Discover if the data needed to pursue this research strategy are actually readily available to you. |
Miscellaneous Notes |