Students may find it valuable to consult a textbook on methodology
in sociology with respect to many aspects of developing a research
project. Any good one should suffice, however, I particularly
recommend the relatively new text The Art and Science of Social
Research by Deborah Carr, et al. for its clarity and
attention to practical concerns.
The Topics
1. Introduction.
Let us start by thinking about
the task ahead of us.
- Analytical
Task
Our initial goal is to
discover what social scientists have to say about the
phenomena that have captured your attention as a possible
site for research. Try to provide a brief
overview of the following.
- What are the fields (and subfields) within sociology
(and neighboring disciplines) that include work
relevant to the study of your project area?
- What stand out as the theoretical and/or empirical
questions that seem most important or to have captured
the most attention, highlighting those potentially
related to your research topic?
- What kinds of data and research strategies seem
dominant in the scholarly work that is relevant to your
interest?
- Itemize ten or more scholarly publications that you
think might help you find a focus, direction, or
strategy for your project. Present these in the
form of an annotated bibli-ography (that is, list the
citations as in a bibliography, adding a brief summary
of the highlights for each one after its citation)
- Common Readings
- Edwards, Mark. "Turning
Ideas into Researchable Questions ." Chap. 2 In Writing
in Sociology, 7-18. Thousand Oaks, California: SAGE
Publications Inc, 2015. [doi:10.4135/9781483384467.n2]
- Edwards, Mark. "Overview
of Writing a Research Paper an Extended Analogy."
Chap. 3 In Writing in Sociology, 19-24. housand
Oaks, California: SAGE Publications Inc, 2015.
[doi:10.4135/9781483384467.n3]
- Edwards, Mark. "Borrowing
Well from the Literature." Chap. 4 In Writing in
Sociology, 25-30. Thousand Oaks, California: SAGE
Publications Inc, 2015. [doi:10.4135/9781483384467.n4]
- Jackson, Robert Max. "How to
Develop a Literature Review – Some Suggestions."
- Recommended
Readings
- Related
Readings
2. Elements of research design.
Research design, not statistical or
theoretical expertise, largely decides if a research project
succeeds. What does it take to go from a question
about how things work in the world to an answer that can be
defended with evidence and sound logic? It takes knowledge
about the specific issue, about the relevant social processes,
and about how to do good research; it requires a thoughtful plan
that balances scientific aspirations with practical
possibilities; it takes a lot of work over time; and it takes a
nimble responsiveness to the unexpected. To do it really
well also requires a disciplined willingness to recognize and
respond to the limits of the research and to that which very few
researchers can abide: evidence that we are wrong.
- Analytical
Task
- The general
analytical problem. Academic departments
in universities vary considerably in size.
Why? What explains which are large and which are
small?
- Transform this general problem into a research
project. Consider the elements of a research
project that are discussed in the readings. Among
others, these include: clear formulation of the question,
alternative explanations, measurement, appropriate data,
sampling design, and analytic strategy.
- This week's task will be done in assigned groups.
- Common Readings:
- Ultee, Wout. "Problem
Selection in the Social Sciences: Methodology." International
Encyclopedia of the Social and Behavioral Sciences
(2015): 49-55.
[doi:10.1016/b978-0-08-097086-8.44043-2]
- Review Chapters 2 & 3 from Edwards above. Also
review the sections on creating projects and finding data
in the Harvard and Yale guides to honors programs.
- Statistics Canada, Social Survey Methods Division. Survey
Methods and Practices. 2003. Read Chs.
1-3. This is a book prepared by practicing social
survey professionals to guide others. The full book
is available to download and is a valuable resource. These
first chapters do a nice job reviewing things we worry
about when deciding what data to collect (whether or not it
is through a survey).
- Recommended
Readings
- Related
Readings
3. A First Look at the research Project
While every aspect of a research
design requires careful development, it is a good idea to
consider early on how the entire project hangs together.
This helps us assess its plausibility, identify what we need to
do, and get feedback from others.
- Analytical
Task
Major Task: Present a
basic description of your current research plan as
now conceived. If you remain uncertain about the
choice between two or more possibilities, do this for the
two that seem most likely. At this point, these
will necessarily be provisional and underdeveloped.
Still, try to indicate:
- What is the research problem or research question?
- What is the principal literature relevant to the
question.
- What, initially, are two or more likely causal
interpretations? These should be stated as simply
and clearly as possible.
- What data might you use? Indicate the data source
and, if possible, the principal "variables."
- If possible, state how the data could be used to answer
the research question. Do not attempt details such
as the type of statistical analysis or the content of an
anticipated questionnaire, but rather give us more a
substantive statement about what comparisons might be
used and how this data will be adequate to answer the
research question. It is fine to use diagrams or
the like.
- Why is this research worth doing? This should
stress how the research intends to add new knowledge,
although it may also include mention of its possible
social, policy, or political value.
- Try to indicate what you believe are the research or
analysis skills you will need to improve to complete the
project successfully. Examples might be (1) that
you want to interview a sample but you need to learn how
to develop a questionnaire and to gain some interviewing
skill, or (2) you want to use the data from an existing
longitudinal data set but need to gain the specific
statistical skills relevant to this strategy.
Each of the
above points and others are covered in greater detail in
the analytical task description for Section 8 of the
course below. Please look there if any of the above
is unclear.
Try to keep the project
description(s) reasonably brief. These are each meant
to be a précis; they should be clear but they should suggest
what each project might look like, not describe
it in detail.
Responsibilities for peer
commentaries and discussion preparation are at
⇒ Click
Here ⇐
- Common Readings:
- Milardo, Robert M. "Writing
Journal Articles." Chap. 2 In Crafting
Scholarship in the Behavioral and Social Sciences:
Writing, Reviewing, and Editing, 11-42. New York ;
London: Routledge, Taylor & Francis Group, 2015.
[doi:10.4324/9781315766089]
- White, Lynn. "Writes
of Passage: Writing an Empirical Journal Article." Journal
of Marriage and Family 67, no. 4 (2005): 791-98.
[doi:10.1111/j.1741-3737.2005.00175.x]
- Goldberg, Abbie E., and Katherine R. Allen. "Communicating
Qualitative Research: Some Practical Guideposts for
Scholars." Journal of Marriage and Family 77,
no. 1 (2015): 3-22. [doi:10.1111/jomf.12153]
- Harmon, Justin, and Kyle M. Woosnam. "Pulling
Survivors from the Wreckage: Resuscitating Rejected
Papers." SCHOLE: A Journal of Leisure Studies and
Recreation Education 34, no. 1 (2019): 29-35.
[doi:10.1080/1937156X.2019.1589801]
- Recommended
Readings
- Related
Readings
4. Causality - What are causes, mechanisms, and the like?
We casually refer to causes and
effects in normal interactions all the time. We all conduct our
lives – choosing actions, making decisions, trying to influence
others – based on theories about why and how things happen in the
world. From the early stages of childhood we attribute causes,
building a vision of the social (and physical) world that makes
it understandable. Every action, every choice about what to do,
is based on our anticipation of its effects, our understandings
of consequences. Analytical and scientific reasoning has a
similar form, but requires that we approach causation more
systematically and self-consciously. Without becoming
philosophers of science, effective social science researchers
must have a reasonable grip on thinking about causality.
Even most social research not aimed at questions about social
causation usually relies on critical assumptions about causation
and can only be used in arguments or policies that overrun with
causal thinking. Unfortunately, causal thinking is
difficult and fads guide causal argument choices as much as (and
often more than) rigorous logic. For the purposes of
designing a senior thesis, we need to achieve a practical grasp
of causal thinking. So here we want to get the basic ideas
used in sociology clear. At the same time, for a contrast,
it is worth looking carefully at the practical strategy for
assessing causality put forth by the epidemiologist and
statistician, Sir Austin Bradford Hill a half-century ago that
had profound and lasting influence on real-world assessments of
causality and public health. This should remind us that in
science and in life, causality is ultimately a practical problem,
not a philosophical one.
- Analytical
Task
Major Task:
With respect to your project, as now conceived, try to
develop a clear causal analysis of the conditions and
processes that matter. Most sociological research,
whatever the subject and method, has causal assumptions
in the background and causal concerns integral to the
inquiry. We want to know when and why things look
one way rather than another. We have alternative
outcomes or processes or conditions. And these
alternatives are not the result of simple chance, but the
effect of some circumstances that precede or impinge on
that which we explain.
So, with for your research project, attempt the
following:
- List what are the social outcomes or conditions
being explained. For each, indicate
- what are the alternative states possible
(stress the ones you expect to look at, but
mention if others absent from your project are
also possible)?
- why is this worth explaining?
- List the social circumstances or processes that
might have causal significance. For each,
indicate
- what are the alternative states possible?
- What are the possible causal relationships that
connect the various causes and outcomes?
Remember that some kinds of conditions or actions may
function as both causes and outcomes.
- How can your anticipated research possibly
adjudicate between competing causal
explanations? Not all sociological research
stresses causation, seeks to locate causes, but it
all aims to further our understanding of how the
world of people, groups, organizations, and societies
work. And causation is always implicit, if not
explicit, to making sense of the ways things work in
social worlds. Why? and How?
are the questions that drive our work.
Responsibilities for peer
commentaries and discussion preparation are at
⇒ Click
Here ⇐
- Common Readings
- Freese, Jeremy, and J. Alex Kevern. "Types
of Causes." In Handbook of Causal Analysis for
Social Research, edited by Stephen L. Morgan, 27-41.
Dordrecht: Springer Netherlands, 2013.
[doi:10.1007/978-94-007-6094-3_3]
- Stinchcombe, Arthur L. "The
Logic of Scientific Inference." Chap. 2 In Constructing
Social Theories, 15-56. New York: Harcourt, 1968.
- Hill, Sir Austin Bradford. "The
Environment and Disease: Association or Causation?."
Journal of the Royal Society of Medicine 108, no. 1
(2015 [orig 1965]): 32-37. [doi:10.1177/0141076814562718]
- Supplementary Class Notes:
- Recommended
Readings
- Related
Readings
5. Observation and gathering data
Data have to be collected and
processed. This may seem obvious if we are doing our own
interviews, but even if we use existing data from past censuses,
surveys, or government records, our research depends crucially on
the processes that produced our data. If we treat data as
simple, easily interpreted, unambiguous, valid indicators of what
we want to know, our plan is likely to be sunk before we leave
the dock. To have a good idea what we need to look for and
worry about, we need to understand how data comes into being,
what good practices are, and what are the many reasons that our
data might not represent what we want.
- Analytical
Task
- The general problem of data for your project
. Prepare a description and critical assessment of the
data you anticipate using for your project.
- What will be the source of your data?
- What is the unit of analysis? (Look this up
in a methods text if you cannot recall how to think
about it.)
- Of what population is the data a sample and what
kind of sample is it?
- What are the principal data items that are crucial
for your project. Consider the indicators for
causes, outcomes, mediators, and so forth.
- If you are going to collect original data, how will
you do that? What will be the means for getting
your observations? How will you record the
data? How will you process it into a form for
analysis?
- If you are going to use existing data, how do you
need to adapt it for your project? Do you need
to change the unit of analysis, transform some of the
data, merge data sets, or create sub-samples?
- How is this data a good choice for your research
objectives? Include consideration how you would
be able to have better data if you had much better
resources and more time, and what that implies about
the shortcomings of the data you will use.
- Describe two other examples of data that would be a
good fit for your analytical objectives. In
particular, consider data alternatives based on
different research strategies. How does the
analytical potential of the data you now plan to use
compare to that of these alternative kinds of data?
- Try to conclude your assessment of the data by
summarizing the suitability and quality
of the data for solving the research question. For
a brief note on suitability and quality,
⇒ Click
Here ⇐
Responsibilities for peer
commentaries and discussion preparation are at
⇒ Click
Here ⇐
- Common Readings
- Gideon, Lior. "The
Art of Question Phrasing." Chap. 7 In Handbook of
Survey Methodology for the Social Sciences, edited by
Lior Gideon, 91-107. New York, NY: Springer New York, 2012.
[doi:10.1007/978-1-4614-3876-2_7]
- Adler, Patricia A., and Peter Adler. "The
Promise and Pitfalls of Going into the Field." Contexts
2, no. 2 (2016): 41-47. [doi:10.1525/ctx.2003.2.2.41]
- Schuman, Howard. "Sense
and Nonsense About Surveys." Contexts 1, no.
2 (2016): 40-47. [doi:10.1525/ctx.2002.1.2.40]
- Recommended
Readings
- Related
Readings
- Katz, Jack. "Ethnography’s
Expanding Warrants." The ANNALS of the American
Academy of Political and Social Science 642, no. 1
(2012): 258-75. [doi:10.1177/0002716212437342]
- Katz, Jack. "Ethnography's
Warrants." Sociological Methods & Research
25, no. 4 (1997): 391-423.
[doi:10.1177/0049124197025004002]
6. Research is an ethical issue.
The professional who conducts
social research is a scientist, and we expect scientists to
conform to ethical codes. In academic environments (and many
non-profit research organizations), this is made salient to
social scientists by the requirement that research must be
approved by institutional review boards (IRBs), that try to
ensure we do not mistreat people. Other ethical concerns, such as
selectively presenting only research findings that support the
researcher's argument, are all too often neglected. Only when
someone is exposed as flagrantly violating rules, such as
inventing the data, do our ethics get much recognition (and even
then, social scientists commonly cope with the issue as one of
public perception). The misuse of social science in public
controversies has led many to believe that we can always
manipulate the numbers to match our argument. Every time social
scientists bend the rules - and this happens with embarrassing
regularity - we contribute to the erosion of trust in social
scientists ... by the public, by decision makers, and by other
scientists. Without integrity, we become known as modern
alchemists, practicing pseudo-science.
7. Theory and Conceptualization
Sociological research seeks the why
and how of all things social. Knowledge of how
the world works is always causal, regardless whether the
knowledge is right or wrong, precise or vague, well-documented
empirically or speculative. Some of our work stresses
description, but we do it because the accurate descriptive
knowledge is essential to effective causal analysis. If we
spend a lot of time trying to clarify the specifics of
demographic transitions or what people do after divorce or who
supports capital punishment, it is because we want to discover
what explains these conditions and what effects they have.
Causal or theoretical analysis always relies on abstraction from
the specifics. Concepts are the theoretical
abstractions we use to refer to classes or types of people,
actions, groups, structures, and the like. Explanations and
theories involve the relationships we formulate between the
concepts, relationships that aim to mirror, explain, and
predict. Generally, we start with the theories and
arguments that already appear in the literature relating to our
research question. To engage the research and theories that
already exist and to exchange ideas with others working in a
research area, we need to know what they consider the existing
knowledge, to use the terminology they share, and to translate
our ideas and objectives into their terms.
- Analytical
Task
- The general analytical problem.
Summarize the principal theoretical models relevant to
your research project and provide operational definitions
that are consistent with the anticipated data.
- While doing this, clearly identify the core
concepts that apply to the key actors, processes, and
background conditions associated with the research
project.
- Take into account Becker's analysis of concepts.
- See if you can reformulate your research question
around Alford's multivariate, interpretive, or
historical paradigm. Or some alternative
paradigm.
- Indicate how the concepts you provide relate to the
most important arguments in the relevant
literature. (Note that claiming a research
project will be inductive, qualitative, exploratory,
or the like does not absolve one from the
responsibilities of knowing and responding to
pre-existing research and theory. Any "theory"
or interpretation arising from research must build
upon what is already known.
- In summary, the goal is to catalog and
critically examine the most important concepts relevant
to the intended research project, showing how they serve
to bridge between the concrete specifics of the data and
the ideas and relationships that the research hopes to
illuminate and that have already been established in the
relevant literature.
Responsibilities for peer
commentaries and discussion preparation are at
⇒ Click
Here ⇐
- Common Readings
- Becker, Howard Saul. "Concepts."
Chap. 4 In Tricks of the Trade: How to Think About Your
Research While You're Doing It, 109-45. Chicago,
Ill.: University of Chicago Press, 1998
- Alford, Robert R. "The
Construction of Arguments." Chap. 3 In The Craft
of Inquiry: Theories, Methods, Evidence, 32-53. New
York: Oxford University Press, 1998
- Recommended
Readings
- Related
Readings
8. Assembling the pieces of a research project. Good
aspirations and causal concerns.
Midway through our journey, let us
pause, stand back, and consider the research project as a whole,
given our understandings up to this point.
- Analytical
Task
Major Task:
Present a thesis topic proposal. This will be
your initial full sketch of the proposal. It will be
followed by a full rough draft in several weeks.
In this preliminary version you should include all the
sections below. For each, provide a brief statement of what
you now think will be the substance of this part and
indicate what you believe you need to do to complete the
section effectively. For example, for the literature review
section, you might here give a brief assessment of what
literature is relevant and what you expect it will show,
then indicate what you need to do to produce a full
literature review.
-
What is the research problem or research question?
(click to open/close)
- Be succinct.
- If needed, review discussion of research questions
from our readings or a methods textbook.
-
Who are the expected audiences? (click to
open/close)
- For our purposes, the audiences will usually be
scholars, other social scientists. Yet, we
want to consider which social scientists
we anticipate will find our research of
interests. Is the group broad or
narrow? Is it confined to one discipline or
does it go across discipline boundaries? Will
public officials or practitioners of some kind want
to know the answers from our research?
- The motive here is not to justify the research,
but to identify whose existing knowledge and
expectations concern us.
- This part should be brief. Just state who
are the audiences and why. The goal is to
keep them in mind while completing everything
else.
-
What are the relevant literatures that need to be
explored? (click to open/close)
- You are not expected to have completed a literature
review for these project sketches, beyond what you
need to know to complete the sketch. Still, you
should show you know where to start, what are some of
the principal works that inform the kind of work you
are proposing, and what do they say that is important
to the project design. Try to explain what
strategy you will use to pursue a full literature
search for this project.
- To put it differently, try to give a sense of the
scope and direction of the literature review that is
broad, yet explicit enough that someone else who read
it carefully could begin to carry out the literature
for you.
- If needed, review materials on preparing a
literature review.
-
What, initially, are believed to be the competing
causal interpretations? (click to open/close)
- Your research design should state Cn
competing causal explanations (where n is 2
or higher). Do this even if you aim at an
inductive or exploratory research project.
Realistically, the phenomena you choose to study will
involve varied, relevant causal processes that can be
related to existing research and theory.
Characterizing a project as inductive, exploratory,
or the like does not excuse us from the obligation to
demonstrate our familiarity with the literature and
to show how what we want to study is nested within
social processes involving known causal issues.
- These competing explanations should have at least
surface plausibility, in the sense that it should not
be easy to show an explanation is wrong based on
common knowledge or ten minutes research on the
internet.
- The competing explanations should also permit
representation with the kinds of "variables" in
existing social data sets or that allow
straightforward definition as behaviors or conditions
that can be observed and distinguished.
- As needed, review materials on causality.
- Be wary of the pitfalls involved in causal
reasoning, for example
- Sometimes two conditions have the capacity to
influence each other so that we cannot easily
talk about one being the cause. For
example, harsh parenting my produce rebellious
children but rebellious children may produce
harsh parenting. Without further
data, we cannot call one side of this
relationship the leading cause for it escalating
over time.
- Sometimes the composition of the groups being
compared is influenced by the condition we would
like to assess as a cause. For example, a
new charter school serving an area of a city may
appear a success given its relatively high
graduation rate, but that could reflect its
selective admission of the best students rather
than it providing better education. Without
further information, we cannot distinguish the
causal effects of the selection process and the
educational process.
- What if the central goal of your research project
is descriptive, not causal?
- Research that aims to discover telling
empirical conditions can be valuable without
seeking to test any causal arguments. For
example, no one really knows just how much police
violence occurs against different ethnic groups
under varying conditions in the U.S. or how often
police have to make spontaneous decisions under
dangerous conditions - any research that could
provide an accurate assessment would be very
important. How are economically successful
adults who come from poor families different from
those who come from affluent families? How
do young adults who are American Vietnamese,
American Korean, American Japanese, and American
Chinese and others cope with their common
characterization as Asians?
- If the project goals are primarily descriptive,
causal facets will be secondary, but they are
rarely absent. Our expectations about
police violence, the effects of economic
mobility, or the experience of a frustrated
ethnic identity all hinge on ideas about causal
processes, even if probing those causes is not
our research agenda.
- Therefore, if the project is primarily
descriptive, aiming to discover new knowledge
about the way things look rather than why they
look that way, we should make that clear, but
spend some effort exploring the related causal
processes. By showing knowledge of the
possible causal processes, we demonstrate our
command of the problem and validate the goal of
establishing the empirical conditions.
-
What comparisons do you anticipate are possible
starting points for a research design? (click
to open/close)
- The simplest research design usually implies a two
by two table: we have two possible causal conditions
and two possible outcomes. For example, some
subjects get the trial drug while the others get a
placebo, some subjects improve over time while some
do not. Or, some people are identified as
ethnically Caucasian and others ethnically Asian, and
some people get post graduate degrees and some do
not.
- Social research questions commonly involve more
complex comparisons, but they always focus on
comparisons. Selecting the right comparisons is
critical for research success.
- Hypotheses are statements about the expected
outcomes of these comparisons, based, hopefully, on
sound theoretical premises.
- Again, if the project goals are descriptive,
inductive, exploratory, or the like, comparisons are
still critical. We cannot make judgments, even
crude judgments, about what we observe without
comparisons. Comparisons allow us to start
seeing when something we observe varies or remains
similar across known contexts, and that is the
beginning point for any sociological insight, even
descriptive.
-
What data might you use? (click to open/close)
- The basic requirement here is that the project
proposal identifies some appropriate data that we can
expect will work to solve the research
question. This could mean identifying one or
more existing data sets, indicating the key variables
needed from those data sets, and stating why the
samples from those data sets are appropriate for the
research objectives. It could mean describing
the sources available to research comparable aspects
of historical cases intended for comparison and how
you will extract analytically interpretable data from
those sources. It could mean describing how you
will interview samples from relevant populations,
what information you seek that responds to the
research problem, and how you will get it. In
short, whatever the research strategy, this should
clarify what are the target data.
- Clarify the relevant units of analysis for the
research. What are the "cases" the study looks
at? Are they individuals, households, firms,
cities, or what? Note that the unit of analysis
for a project may differ from the original cases in a
data set. For example, we could take households
as our unit of analysis while using data that has
cases for all individuals in all surveyed households;
or we could have city neighborhoods as our unit of
analysis but use individual level data from the
public use samples of census data that we aggregate
to the neighborhood level.
- What kind of sampling applies to using these data
for your research? If we use existing data
sets, the initial sample concerns the sampling
procedure used for that data set. If we plan to
use only some of the cases (e.g., only married
couples with both spouses employed) or to aggregate
cases, than we have to consider the sampling
implications of our procedure on top of the original
sampling for the data set. If we are gathering
data ourselves by any strategy, we have to start with
a sampling procedure.
- Even though this is an early proposal for the
project, a sketch, try to be as clear as you can
about the factors (represented by variables) that are
the elements of your anticipated research and how
they will be used.
-
What plausible timetable could the project be
designed around? (click to open/close)
- Every stage of a research project takes time, most
take longer than we expect. To protect
ourselves and to appear moderately reliable to
others, we need to have a practical plan.
The goal for these projects is to function as the
basis for an honors thesis. So, consider how
much time you can reasonably have available for this
activity, given that you must complete the thesis by
sometime in April, after the time required for your
studies, for any jobs you will hold, for your other
obligations, and the time you will have available
each week to work on a thesis project. Then,
consider how to budget time for each part of the
project.
- As this is just the initial proposal for the thesis
topic, this should be brief. Still, try to
paint a rough picture of a schedule. You and we
need a starting point for considering the viability
of the project in terms of its size (i.e., the time
and effort required).
-
Why is this research worth doing? (click
to open/close)
- In our circumstances, the honest answer is that it
is a means toward getting a degree. We should
not lose sight of this criterion. An honors
thesis needs to demonstrate the capacity to carry out
a basic research project from beginning to end.
Realistically, it does not need to make an important
contribution to scholarly literature, and rarely will
do so.
- Nonetheless, to produce an appropriate research
proposal, we want to claim that our project has a
purpose that is relevant to our audience.
Generally this means that it should resolve a
question that is apparently not answered in the
existing literature, if the proposal is being judged
by scholars. Alternatively, it should claim to
supply an answer to a practical question or evidence
to support a policy position if the proposal is being
judged by a commercial employer, a policy
organization, or the like.
- Always think through and stress discovery.
The aim of social research is to find out something
we did not know before we did the research.
This would be true even of research that seeks to
replicate previous findings, as the goal would be to
discover how confident we can be in those prior
findings.
- In more general terms, research is potentially
important only if the outcome has bearing on
theoretical claims that matter to scholars or
the outcome has bearing on practical policies in the
world that some people care about. Essentially,
the research results must have the potential to alter
some people's future behavior.
- For research to have this potential, two things
must be true.
- First, either some people must feel
they do not know what the outcome will be or
some must believe something about the world that
we could plausibly show was wrong by the
research. This means the answer to the
research question must be open to disagreement
and the research must have the potential to
provide evidence toward resolving that
disagreement. Doing research to show that
desperately poor people given an opportunity are
more likely to steal small amounts of money and
valuables than are the very affluent is probably
a waste of time. Absent some considerable
class difference in cultural prohibitions against
theft or casual indifference to antisocial
behavior, many more poor people will experience
circumstances making small thefts valuable.
In contrast, research on whether affluent or poor
people are more likely to steal amounts that are
significant relative to their current
circumstances, given equivalent opportunities,
asks a question for which we cannot confidently
predict the answer.
- Research also can have significance only if
relevant people are open to being swayed by the
research results. Will those who would
make wrong predictions about the outcomes, or
those who believe no one knows the answer, be
convinced by the research? Are there people
defending a position whose expectations would be
confirmed by the research, and whose resolve or
sense of purpose might be bolstered even if the
research results are neglected by their
opponents?
- Thus, the research plan seeks to show that it
can provide evidence that has bearing on a point
of contention and the evidence should be
convincing to (rational) people concerned about
the questions.
- Common Readings
- Hagan, John. "Testing
Propositions About Gender and Crime." In Criminological
Controversies : A Methodological Primer, edited by
John Hagan, A. R. Gillis and David Brownfield, 17-46.
Boulder, Colo.: Westview Press, 1996
- Lofland, John, and Lyn H. Lofland. "Developing
Analysis." Chap. 9 In Analyzing Social Settings:
A Guide to Qualitative Observation and Analysis,
181-203. Belmont, Calif.: Wadsworth, 1995
- Recommended
Readings
- Mahoney, James, and Gary Goertz. "A
Tale of Two Cultures: Contrasting Quantitative and
Qualitative Research." Political Analysis
14, no. 3 (2017): 227-49. [doi:10.1093/pan/mpj017]
(Read this not for insights on differences between
quantitative and qualitative research strategies, but for
the way it makes you think about research opportunities
and choices.)
- Lieberson, Stanley. "Modeling
Social Processes: Some Lessons from Sports." Sociological
Forum 12, no. 1 (1997): 11-35. (Read this for
insights on how you can broaden your ways of thinking
through analytical problems and strategies.
Lieberson uses sports, but the lessons are about
expansive and imaginative thinking.)
- Erren, Thomas C., Paul Cullen, Michael Erren, and
Philip E. Bourne. "Ten
Simple Rules for Doing Your Best Research, According to
Hamming." PLOS Computational Biology 3, no.
10 (2007): e213. [doi:10.1371/journal.pcbi.0030213]
- Related
Readings
9. Measurement and Propositions
Let us consider two aspects of social
research that are usually examined separately, measurement and
propositions. Measurement, in its general form,
refers to our ability to distinguish different states of anything
that varies in ways that matter to our research question. All
social research depends on the assumption that we can assess the
characteristics of actors, relationships among actors, and events
accurately and realistically enough to allow us to describe them
and analyze how the influence each other. Our capacity to do
effective analyses depend crucially on the processes by which we
categorize and count social phenomena. These processes are
prone to errors at many levels. A sociological proposition
is a claim about the way things work in the world. They run
the gamut from hypotheses derived from theories to conclusions
derived from evidence with interpretive observations somewhere in
between. They are statements about social arrangements and
social causation that we seek to conceive, discover, and
demonstrate. The relationships we believe to exist between
concepts are theoretical propositions that we expect to correspond
to empirical relationships between the measured values of
operational representations of those concepts (and vice versa).
- Analytical
Task
- Analytical Task:
Develop three propositions about what you could
expect to find in your research project that are both
consistent with the relevant scholarly literature and
related to the research objectives. For each
of these, explicate how you will measure the
associated phenomena, as operationalized.
Responsibilities for peer
commentaries and discussion preparation
for last week's topic proposal
are at
⇒ Click
Here ⇐
- Common Readings
- Carr, Deborah S., Elizabeth Heger Boyle, and Benjamin
Cornwell. "From
Concepts to Models; Hypotheses, Operationalization, and
Measurement." Chap. 4 In The Art and Science of
Social Research, 101-31. New York: W. W. Norton &
Company, Inc., 2018
- Hagan, John. "Testing
Propositions About Gender and Crime." In Criminological
Controversies : A Methodological Primer, edited by
John Hagan, A. R. Gillis and David Brownfield, 17-46.
Boulder, Colo.: Westview Press, 1996
- Lofland, John, and Lyn H. Lofland. "Developing
Analysis." Chap. 9 In Analyzing Social Settings:
A Guide to Qualitative Observation and Analysis,
181-203. Belmont, Calif.: Wadsworth, 1995
- Recommended
Readings
- Schaeffer, Nora Cate, and Stanley Presser. "The
Science of Asking Questions." Annual Review of
Sociology 29, no. 1 (2003): 65-88.
[doi:10.1146/annurev.soc.29.110702.110112]
- Billiet, Jaak. "What
Does Measurement Mean in a Survey Context?." In The
Sage Handbook of Survey Methodology, 193-209, 2016.
[doi:10.4135/9781473957893.n14]
- Schwarz, Norbert. "Attitude
Measurement." International Encyclopedia of the
Social and Behavioral Sciences (2015): 178-82.
[doi:10.1016/b978-0-08-097086-8.24006-3]
- European Commission, Joint Research Centre. "10
Step Guide" to creating composite indicators.
Read through all 10 steps (see the Handbook on
Constructing Composite Indicators in Recommended
Readings for a fuller treatment).
- Related
Readings
10. How to Prepare a Good Literature Review.
Preparing a good literature review
is a task easily overlooked. Yet, a weak literature review
in the early stages can jeopardize one's chances of developing a
good research design. At later stages, a poor literature
review can damage a paper that otherwise reflects good
research. A good literature review depends on two critical
skills: (1) knowing how to find the existing research and
theoretical work that is relevant to one's project and (2)
knowing how to select and present the important ideas and
findings in that literature.
- Analytical
Task
- Prepare a basic literature review, aimed at the topic
of the thesis proposal.
- This literature review should conform to
recommendations about good standards for a literature
review from the readings.
- Among other goals, the literature review should:
- Give a full account of existing research (and
theoretical work) on the same question - or very
similar questions - as the research question of this
proposal. Depending on what is available, this
should include the most important publications of the
past and the most recent publications (for recent
publications, we include all that seem plausible).
- Provide a selective account of the research that
informs the previous work and your own proposal, but is
not directly on the research topic. For example,
if we were doing a research project asking how having a
baby during the first two years of marriage influences
the likelihood of divorce in the subsequent three
years, we would want to include a selective review of
the literature on the determinants of reproduction in
marriage and of divorce.
- Pay close attention to what has been discovered and
what we do not know about the issue that is the aim of
your research proposal. Also pay attention to what
are sources of disagreement in the literature.
Responsibilities for peer
discussion preparation for this week's literature review
are at
⇒ Click
Here ⇐
- Common Readings
- Becker, Howard Saul, and Pamela Richards. "Terrorized by the Literature." Chap. 8
In Writing for Social Scientists: How to Start and Finish
Your Thesis, Book, or Article, 135-49. Chicago:
University of Chicago Press, 2007
- The following offer advice about literature
reviews. Use these as practical guides.
- Knopf, Jeffrey W. "Doing
a Literature Review." PS: Political Science
& Politics 39, no. 1 (2006): 127-32.
[doi:10.1017/S1049096506060264]
- Graham, Charles R. "Reviewing
the Literature When There Is So Much of It."
Chap. 3 In Conducting Research in Online and
Blended Learning Environments, edited by Anthony
G. Picciano, Charles D. Dziuban, Charles R. Graham and
Patsy D. Moskal, 28-42: Routledge, 2015.
[doi:10.4324/9781315814605]
- Boote, David N., and Penny Beile. "Scholars
before Researchers: On the Centrality of the
Dissertation Literature Review in Research
Preparation." Educational Researcher 34,
no. 6 (2005): 3-15. [doi:10.3102/0013189x034006003]
- Jackson, Robert Max. "How
to Develop a Literature Review – Some Suggestions."
- Recommended
Readings
- The following offer further advice about literature
reviews. Take a quick look at them, read further if
their approach or specific information seems to better
fit your needs than those above.
- Denney, Andrew S., and Richard Tewksbury. "How
to Write a Literature Review." Journal of
Criminal Justice Education 24, no. 2 (2013):
218-34. [doi:10.1080/10511253.2012.730617]
- Hart, Chris. Doing a Literature Review: Releasing
the Social Science Research Imagination. London:
Sage Publications, 1998.
- Porter, Alan L., Alisa Kongthon, and Jye-Chyi Lu. "Research
Profiling: Improving the Literature Review." Scientometrics
53, no. 3 (March 01 2002): 351.
- Related
Readings
11. Sampling
Selecting a subset of the target
population for research is fundamental to all social science
research. Even research that seems to observe every member
of a population generally depends on sampling ideas. A
population census, for example, has to be sampled to produce the
public use samples made available to scholars for research.
Experimental designs often neglect sampling concerns, relying on
random assignment to comparison groups; yet, such randomization
occurs within the sample of subjects (people or otherwise)
available for research. Generalization to the full
population or beyond depends on the implicit sampling that has
occurred. Research using organizations, nations, or other
collective entities faces significant issues establishing the
population being studied, often reversing the logical sequence by
trying to define the population based on the available
sample. Small sample research, such as projects in which
the researcher interviews all the subjects or codes all the
materials for a content analysis raise critical problems about
how representative they are and how much then allow disentangling
multiple causes and effects. In short, all social research
must contend with sampling as a crucial facet of research design
and defense of inferences. Since acquiring data involves
time, effort, and expense, and may be curtailed by many
obstacles, sampling is both a practical and a conceptual problem
for research.
- Analytical
Task
- The general
analytical problem. This week we will
expand on our effort to clarify how we will select and
use data. This will have two main parts. First,
update and revise the data discussions from previous weeks,
taking into account feedback and the general discussion
we have had about data. Second, focus
particularly on the problem of sample selection. We
want to consider some of the standard sampling strategies
that might be appropriate for this project. Assess
how the research aims would be better or worse served by
these alternate strategies.
- As shown in the readings, alternative
sampling strategies involve trade-offs in costs,
richness of the data collected, ability to study
sub-samples, applicable statistical procedures, how
far we can generalize results, and the like.
These are the concerns you should bear in mind while
assessing the strengths and weaknesses of a sampling
strategy for your project.
- Consider a fair range of sampling possibilities,
such as simple random, stratified random, some form
of non-probability sampling with constrained sample
size, and longitudinal sampling. Try to show
how and why your research objective would be better
or worse served by the various sampling
strategies.
- Include consideration of varying scope
possibilities for the research project, such as that
you have to collect the data personally, that you are
asked to include a comparison across countries or
other appropriate locations (which could be defined
by organizational or cultural boundaries, rather than
geographical ones). While some of these may be
implausible as practical possibilities for your
project, considering them can reveal otherwise
unnoticed implications of the sampling strategies
being considered.
- After completing the general assessment of fit
between your research agenda and possible sampling
strategies, examine what this implies about the
possible fit between your proposed project and
alternative research strategies that you could
consider using.
- In short, for your selected research project,
you will present a revised consideration of data
possibilities, adding an assessment of the
trade-offs of competing sampling strategies, under
varying conditions about the intended scope of the
research project, and decide what this assessment
of sampling implications suggests about a good approach
to data for your project. Remember, sampling decisions
critically affect the quality of your data and your
findings.
- Common Readings
- Statistics Canada, Social Survey Methods Division. Survey
Methods and Practices. 2003. Read Ch. 6
"Sample Designs" and Ch 8 "Sample Size".
- Guest, Greg, Emily E. Namey, and Marilyn L. Mitchell. "Sampling
in Qualitative Research." In Collecting
Qualitative Data: A Field Manual for Applied Research.
55 City Road, London: SAGE Publications, Ltd, 2013.
[doi:10.4135/9781506374680.n2]
- Recommended
Readings
- Duncan, Greg J. "Panel
Surveys: Uses and Applications." In International
Encyclopedia of the Social & Behavioral Sciences
(Second Edition), edited by James D Wright, 462-67.
Oxford: Elsevier, 2015.
- Lopez, Violeta, and Dean Whitehead. "Sampling
Data and Data Collection in Qualitative Research."
In Nursing & Midwifery Research: Methods and
Appraisal for Evidence-Based Practice, edited by
Zevia Schneider and Dean Whitehead, 123-40: Elsevier,
2013.
- Fienberg, Stephen E., and Judith M. Tanur. "
Sample Survey Methodology, History Of." International
Encyclopedia of the Social and Behavioral Sciences
(2015): 875-80. [doi:10.1016/b978-0-08-097086-8.03229-3]
- Statistics Canada, Social Survey Methods Division. Survey
Methods and Practices. 2003. Pp.
119-130 on weighting. "Sample Designs" and Ch 8 "Sample
Size".
- Related
Readings
12. The Research Proposal, Initial Full Draft
Ultimately, the foundational bridge
between planning a research project and carrying it out is the
research proposal. Research proposals are required by
agencies that provide research funds, by academic programs that
give credentials based (in part) on completed research projects,
and by any other body having a reason to review the quality of a
research plan before the research is done. A good research
proposal convinces its reviewers that the authors have a good plan,
that they know the relevant scholarly literature well enough to do
the research properly, and that the research promises to supply
findings that will result in a worthwhile, original contribution to
existing scholarship. A good proposal will give an overview
efficiently, but will provide enough detail and clarity that
some other knowledgeable scholar in the field could conduct the
project based on the proposal.
- Analytical
Task
- Analytical Task: Full rough draft of thesis
research proposal.
- All parts of the future proposal should exist in this
draft and be analytically developed.
- All comments received for the thesis topic proposal
should be addressed in this draft.
- Common Readings
- For a research proposal outline, ⇒
Click
Here ⇐. This is a generic proposal
outline. You can use it as a suggestive template, but
you do not need to follow it in detail.
- Carr, Deborah S., Elizabeth Heger Boyle, and
Benjamin Cornwell. "Research
Proposals." Section in Chap. 17 in The Art and
Science of Social Research, 592-94. New York: W. W.
Norton & Company, Inc., 2018
- Review in full the Harvard and Yale guides to writing a
thesis. You will discover this is more helpful than you
anticipate for pulling together your proposal. Do not
skip this by telling yourself that you have already read
these in the past.
- Recommended
Readings
- Related
Readings
13 (&14). Oral presentations of research proposals.
Each student will offer an oral
presentation of the proposed research in class.
- Analytical
Task
- This section will take the last two class meetings.
One half the class, chosen by volunteering or randomly as
needed, will do presentations in the first week and the
other half will do it the second week.
- Each presenting student will have a maximum of ten
minutes for this presentation (there is no
minimum).
- All class members are expected to read the draft
proposals for those presenting each week. All
students must be prepared to offer feedback to all
presenters.
- Common Readings
- Draft proposals of those presenting.
- Optional advice for oral presentations:
- Recommended
Readings
- Related
Readings