Jane Allyn Piliavin- Sociology at UW Madison, bascom graphic

Sociology 357: Methods of Sociological Inquiry


Lectures 2 and 3

Fall, 2003

Room 6112 Social Science

TR 8:00-9:15;
MW 2:25-3:40

Professor Jane Allyn Piliavin Office Hours: MW 4:00-5:00, F 2:00-4:00 and by appointment
Phones: 262-4344(O),
233-9090(H);
Office: 2450 Social Science
EMAIL:Jpiliavi@ssc.wisc.edu  

 

This is a basic course in how to do social science research and how to evaluate the research of others. It assumes no background in research methods or statistics. It provides a general overview of the ways sociologists collect information about social phenomena with a special emphasis on what can be done to yield information that is trustworthy and useful for our theoretical understanding of social life. If you have had any other research methods courses you will probably find this course to be too elementary and should discuss alternatives with me.

There are several basic goals I hope to achieve in this course:

  1. to introduce you to the elements of research design so that you will have a good foundation for future learning,
  2. to teach you how to read a research report with a critical eye, so that you can know how trustworthy its information is,
  3. to convince you that research is not an esoteric or arcane activity that can be performed only by slightly eccentric professors, but rather a relatively straightforward, systematic set of procedures by which you can get answers to questions you have,
  4. to teach you the limitations and problems of doing research into human behavior and therefore the caution that is necessary in drawing broad conclusions on the basis of any one study, and
  5. to show you that doing research can, indeed, even be fun, in the same way that learning about the world was fun for you before they spoiled it by making you do it in school.

Required Texts

There are two required texts for the basic course:

  • (S) Schutt, R.K. Investigating the Social World. 2001. Thousand Oaks, CA: Pine Forge Press, 3rd edition (paper). A basic text in how to do social research.
  • (G) Golden, M.P. The Research Experience. Itasca, Ill: F.E. Peacock, 1976. (paper) A collection of sociological research reports coupled with behind-the-scenes discussions of what really happened in the research. The articles are antiques; you will learn some 60's history as well. The book is no longer in print (some used copies may be available), so the assigned chapters are on electronic reserve in the social science reading room, each one under the name of the chapter author.

In addition, there are instructions for the exercises, and other illustrative materials, which you must print out from my website or purchase from Bob's Copy Shop in the form of a workbook or CD. Some readings will be assigned on reserve in the social science reading room and/or on electronic reserve. These should all be indicated here, but there may be some glitches.

Requirements and Grading


Your grade is based principally on three data collection exercises : a field observation (15%), a small questionnaire (20%), and an experiment (20%), and on an article analysis (25%). Details on these four assignments are given in the workbook and on the website. The last 20% of your grade is based on how much of the assigned homework you do (15%) and on your comments on the lectures and readings (5%). Please purchase a package of 3 X 5 index cards for the purpose of writing the comments.

The homework assignments are given in the syllabus. Homework will be skimmed and counted but not graded. The goal of assigning homework is that you will have done the assigned reading and thought about it before you come to class. Thus, it must be clear from what you write that you actually read the assigned material: vague comments that make no specific reference to the reading are not acceptable. To receive credit, the homework must be submitted at the beginning of class on the day it is due. If you omit no more than two of the 15 assignments, you will receive an A for the homework portion of your grade. If you do fewer than half of the assignments, you will receive an F. Between these extremes, you will receive a pro-rated grade. Late homework will be accepted for half credit only when there is clear justification, and even then, only at the next class meeting after the original due date. (Exceptions may be made for catastrophes.) Absence from class is not a sufficient justification for late homework; you may submit homework early in anticipation of an absence.


At the end of each Wednesday class, I will collect "comment cards", on which you may ask general questions, make comments, and ask for clarifications regarding lectures and readings. I will read these and may use them to structure later classes. I will not accept other sizes of cards or strips of paper. Again, you will receive a grade based on how many cards with comments you turn in. Just a card with your name on it will not suffice; this is not just a sneaky way of taking attendance in lecture (although it does give me some information about that). I strongly suggest that you keep a journal of questions and comments as they occur to you as you read and as you sit in class (perhaps in a small notebook or pad). This can help you decide what to put on your comment cards; it can also serve as a record for you of what you have and haven't figured out, if you go back over it now and then.


I would like to stress that you can get an A for 20% of your grade simply by doing mechanical things having to do with comments and homework. This can make a big difference in your final grade.


There is a great deal of work to do in this course. The subject matter requires an active rather than a passive stance toward learning. The way to learn research methods is to read real research reports and get your hands dirty doing real data collection. The homework is an integral part of the class, for it is the vehicle for learning to read a research report. All these activities take time and effort, but there are no shortcuts. I hope you will find at least some of what you do to be fun; at least you should not be able to complain that all you were asked to do was to spit back what the professor said.

Procedural Matters

Class sessions will involve a mixture of lectures and discussion. Some classes will include discussion and workshop-type experiences. You are responsible for obtaining information you miss if you are absent. Please obtain the telephone numbers and e-mail addresses of several class members so you can call or e-mail them if you miss class. I believe it is inappropriate to use office hours (or telephone calls) to compensate for instruction you missed more or less by choice. But if you are attending regularly and making the effort to learn (or if your absence is for reasons beyond your control), I will do all that I can to help you. Past students have suggested that I stress that the absence of formal examinations on the assigned reading does not mean that you don't need to do it. Some report learning too late in the term that the assigned readings and our discussions of them help you do a better job on the graded exercises and article analysis.


When we are working on one of the exercises always bring the instructions for it to class. Many students find that it works well to have a looseleaf binder in which both the instructions and other notes may be kept. Or get one of those spirals with big pockets for other materials. It is also useful to bring Golden when readings have been assigned from it. I sometimes get behind, so if I haven't covered a Golden reading, please continue to bring the book to class until I do.


I have given you my home phone number, because I want you to feel free to call me when you have questions. BUT PLEASE TRY TO REMEMBER THAT WHEN YOU HAVE QUESTIONS IS WHEN OTHERS DO TOO -- WHEN PROJECTS ARE DUE. Try to realize that I have another life and be considerate. For example, when writing up an exercise, please work all the way through the exercise, noting questions you have as you go. Then make ONE phone call to try to get the answers, rather than making a new call every time you get stumped!

SCHEDULE

The exact pacing of topics from day to day will depend upon the flow of the class. HOMEWORK AND PROJECT DUE DATES GIVEN IN THE SYLLABUS ARE CORRECT, even if I do not remind you in class, unless a WRITTEN note on the blackboard or an e-mail message alters them. You are expected to check your e-mail; if you have not activated your account, please do so.


Three additional laboratory sessions are scheduled across the semester, based on your available times, on Thursday and Friday mornings. These are to teach you the "hands on" details of data analysis; the first two are REQUIRED. These are held in the Social Science Data and Computation Center, 3218 Social Science Building. Your assigned time will be set up during the first week or two of class.


S refers to readings in the Schutt methods book. For example, S 7 refers to all of chapter 7. S, pp 100-105 means pages 100-105 only. G refers to readings in the Golden reader. The articles will be indicated by the author's name, e.g. G: Humphreys. In Golden, always read both the research report and the personal journal that follows it. There is a lot of material in the personal journals that will help you with your exercises; do not neglect them. Some of them are even entertaining.

NOTE: A * BEFORE A DATE MEANS THERE IS SOMETHING DUE THAT DAY.

The readings are given class by class. Because the classes meet on different days, I have indicated classes by order, e.g., Class 1, Class 2. For the MW lectures, the odd numbers are Wednesdays. For the TR lectures, they are Tuesdays, up through Thanksgiving.

You should have read the material indicated or done the hework by the date shown. Deadlines for all assignments are indicated on the schedule.

Note: There are additional readings for those in the Honors section. See your paper syllabus.

Date Subjects, Readings, and Homework
Class 1 Sept 2,3 First Class. The usual introductory remarks. Introduction of Article Analysis as the overall framework for the course. It is strongly recommended that you have an approved article by OCTOBER 10. This will be explained in class.
Class 2 Sept 4,8 Overview of research design. READ S 1; G 1. Discussion of propositions, concepts, variables, and operational definitions.

Class 3 Sept 9,10

Begin Systematic Observation and Field Research. Read S 8. Read excerpt on crack research and the selections from Bosk, Forgive and Remember, and Duneier, Sidewalk, on doing field work (all on Electronic Reserve (reached through http://my.wisc.edu/portal/)). Also read the instructions for the OBSERVATION EXERCISE (15% of your grade, also in Workbook packet) and think about what you might want to observe. Today you will form two-person groups for the observation exercise. Decide with your partner on the setting you will use for your observation. Between now and Wednesday, September 19, do your unstructured observations.
* Class 4 Sept 11,15

Read S 2 (all), 3 (pages 64-73 only).

HOMEWORK #1: Pick up a newspaper (any one will do). Develop one or more propositions about some topic discussed in the paper. State the concepts involved and try to operationalize them. Attach the clipping of the article that is your "inspiration" to your homework. This will form the basis for discussion in class.

I will also lecture on some "classic" studies and their methodology.

* * Class 5 Sept 16,17

Applying the basic concepts. Read G: Doob and Gross, "Status of Frustrator as an Inhibitor of Horn-honking Responses," and "How I Did It" .

HOMEWORK #2:

  1. Give the major independent variable and dependent variable in the Doob and Gross article; tell how each was measured (operationalized).
  2. State the major theoretical hypothesis of the research and the operational hypothesis that flows from it.
  3. See if you can construct the logical framework leading from the theory to the specific prediction. (Hint: This involves the "frustration-aggression hypothesis," the theoretical hypothesis, and the measurement assumptions, and it is not obvious.)
  4. Be prepared to discuss the results of this research, in terms of what it demonstrates (I never say "proves").

HOMEWORK #3: Turn in xerox copy of rough notes from unstructured observation. Bring the original to class. You will need it for the WORKSHOP on interpreting unstructured observations and developing a hypothesis and structured observation design. You should now be ready to do your structured observation.

* Class 6 Sept 18,22

Ethics of Research. Matters of ethics come up in all research but are especially acute in participant observation. Read the following two sections of the sociologists' code of ethics:

http://www.asanet.org/members/ecostand.html#11

http://www.asanet.org/members/ecostand2.html

Read only section 11 from the first one and section 12 in the second one.

Also, go to the following website and take the tutorial:

http://info.gradsch.wisc.edu/research/compliance/humansubjects/tutorial/

Read G: Humphreys "Tearoom Trade" and "Methods".

HOMEWORK #4:

  1. Discuss the methods of observation used by Humphreys. Would you call this participant or non-participant observation? Overt or covert?
  2. What methods in addition to observation did he use in this article?
  3. Briefly give your opinion of the ethics of the research reported in Humphreys' article. We will hold a debate in class.
* Class 7 Sept 23,24 Analyzing Observational Data. Read S 12, writing a research report (pp. 436-442); S 10, (pp. 346-380, skimming section on variance) Discussion of observation exercise with emphasis on how you write up a research report and how you prepare a statistical table to summarize your results. You should have your structured data collection completed and your data with you. WORKSHOP on data analysis and writeup of observation exercise. Report is due on Class 9 at class time.
Sept. 25/26
R&F, Lab sessions for hands on work with SPSS. In Microlab, 3218 Social Science Building.
Class 8 Sept 25,29 Begin surveys and index construction. Read S 3 ( pp. 73-91). Chapter 7, Surveys (all). Start thinking about a topic for the questionnaire. I will lecture on particular types of question format. QUESTIONNAIRE EXERCISE DISCUSSED. (See workbook packet.)
*Class 9 Sept 30, Oct 1 OBSERVATION EXERCISE DUE AT CLASS TIME. Read Newman questionnaire (see workbook packet) as a NEGATIVE example: how NOT to write questions. This fake questionnaire was devised as a teaching tool to illustrate common mistakes made in writing questions. Pick out your two favorite lousy questions; I will discuss what makes a bad question. I will also give hints on writing good questions. Form groups for questionnaire exercise; begin to write questions to be completed over the weekend and turned in on Wednesday, October 10 at class time or, at the very latest, Friday noon.
* Class 10 Oct 2, 6

G: Schuman, "Two sources of antiwar sentiment in America", and the personal journal.

HOMEWORK #5: What do you see as the strengths and weaknesses of open-ended questions? When would they be better than structured questions? Would there be some groups of people you wouldn't want to use them with? Identify the major variables; summarize the sampling procedures.

Clarifications of what is wanted in the Questionnaire Exercise. Instructions.

* Class 11, Oct 7,8

Sampling. Read S, Chapter 4, Sampling.

HOMEWORK #6: Drafts of questions due at class time, or at the latest by 4:30 P. M. Make sure all questions from your group are handed in together.

* Class 12, Oct 9, 13

Read G: Ransford, "Isolation, Powerlessness, and Violence," and the personal journal.Read

HOMEWORK #7: Identify the major variables and how they were operationalized -- that is, what questions were used to get at the ideas he was interested in; add any comments you have about the subject matter or process of his research. I will discuss this article in class.
* Class 13, Oct 14,15

Read "External Validity" section of Article Analysis in preparation for homework described below.

HOMEWORK #8: Apply article analysis section B: External Validity to the Ransford, the Humphreys, the Doob and Gross article, or your own approved article. If you choose to do an analysis of your own article, I will give you feedback on it, which should help you to do a better job on your final article analysis. (I will need a copy of your article to do this). See example article analysis in workbook for help. Your question drafts returned with comments. Some time at end of class will be left for groups to consult on these corrections. After you correct them, your questionnaire should be ready for the field, and you should begin collecting data. At least half of the data should be collected by next Wednesday.

* Class 14 Oct 16,20

Read S 3, (pp. 91-101). The idea of construct validity. Read G: Rubin "Measurement of Romantic Love" and journal.

HOMEWORK #9:

  1. Explain in your own words the relation between what Rubin is doing and the ideas of validity explained in your text.
  2. List three findings in his article that support the claim that his measure of "love" is valid.
  3. Comment very briefly on your feelings about this approach to measuring love.
Class 15, Oct 21,22 Workshop on open-end coding and rostering of data. AT LEAST HALF OF DATA SHOULD BE COLLECTED BY NOW. BRING ALL DATA YOU HAVE TO CLASS. ALL DATA MUST BE COLLECTED AND ROSTERED BY MONDAY.
23/24 Lab sessions for data entry and initial analysis of questionnaire data.
* Class 16, Oct 23, 27

Reread S 10 (pp. 346-380 ) Carefully read the example of a student project in the
Questionnaire Exercise writeup in the workbook. I will hand out computer output that corresponds to the example, and I will discuss it. Meet with your groups on last minute work and with me on questions about your data sheets.

HOMEWORK #10>>> SUBMIT COPIES OF YOUR DATA SHEETS AND CODE BOOKS AND A DISK CONTAINING YOUR SPSS data file, syntax file, and output file with your frequency distributions before 4:30 P.M. today in my office or mailbox.

* Class 17, Oct 28,29

Read Section C: Construct Validity of Measures of Variables in Article Analysis. I will discuss this section in class.

HOMEWORK #11: Apply Section C of the Article Analysis to either the Doob and Gross, the Ransford or your own article. Discussion of this section of the article analysis as it relates not only to these articles but also to the questionnaire exercise.

Class 18, Oct 30, Nov 3 Read S, Chapter 5, Causation and research design. Computer analysis of questionnaire data returned. WORKSHOP on interpreting and reporting results. I will be available Tuesday, 1:00 to 4:00, Wednesday 4:00 - 5:00, and Thursday, 1:00-3:00, in addition to regular office hours, for consultation. If you want reanalyses, you must request them by Thursday afternoon. By now, you should have written a draft of the questionnaire exercise up to where the data analysis section begins, to save yourself time later.
* Class 19, Nov 4,5

Read Experiment Exercise. Begin discussing experimental design. Read S 6, Experiments (pp. 175-184); G : Darley and Batson, "From Jerusalem to Jericho" and the personal journal. Ignore the material on measures of religiosity (pp. 200-202).

HOMEWORK #12:

  1. Identify the independent and dependent variables and tell how each was measured;
  2. Summarize the key findings. Focus on finding the relevant numbers, not just the words.
  3. What procedures were used to ensure internal validity of the findings, in terms of the logic of experiments? (Note: Although it does not say so explicitly, this is a randomized experiment.) Be prepared to discuss anything else that seems relevant. Start thinking about an experiment
Class 20, Nov 6,10

Lecture and discussion on internal validity: How can you support a judgment that A is a cause of B? (As contrasted with B causing A, or other possibilities.) Campbell & Stanley pre-, true, and quasi - experimental designs.

Read S 6 (pp. 183-204); Stern, Chapter 3 (book on reserve, Soc. Sci. Reading Room, 8th floor, back; electronic reserve).

* Class 21, Nov 11,12

QUESTIONNAIRE EXERCISE DUE today, at CLASS TIME.

Continue discussion of experiments, causation. Bring your ideas for experiments to class. There will be an experimental design workshop. You should then begin collecting data.

* Class 22, Nov 13,17

Read G: Goldberg, "Misogyny and the College Girl," and the personal journal.

HOMEWORK #13:

  1. Identify the independent and dependent variables and tell how each was measured,
  2. Summarize the key findings, again focusing on finding the relevant numbers.
  3. What procedures were used to ensure internal validity in this research? How is the design of this experiment different from that of the Darley and Batson study?
*Class 23, Nov 18,19

Field experiments have more external validity but more complex internal validity problems. Read G: Goldstein and Arms, "Effects of Observing Athletic Contests on Hostility," and the personal journal.

HOMEWORK #14: Identify the independent and dependent variables and tell what procedures were used to insure internal validity.

20/21

OPTIONAL labs. You know how to roster data by now. But we can go over appropriate statistical techniques for your data.

* Class 24, Nov 20,24

Read Article Exercise Section D: Internal Validity; S, Appendix D, How to read a research article.. Read article "Divorce among sociologists married to sociologists" and the student analysis of it in the Workbook. (The analysis precedes the article.)

You should have a draft of the entire exercise report written up to the data analysis by now, and have half or more of your data collected. Data analysis and report write-up WORKSHOP today.

Nov 25,26

No class!! Work on your experiments. They are due in 9 days!

Class 25, Dec 1,2 Read S 11, 380-388; read Babbie chapter,"The Elaboration model". Discussion of internal validity in connection with elaboration model. (Electronic Reserves).
* Class 26, Dec 3,4 EXPERIMENT EXERCISE DUE today, at class time. Further discussion of elaboration model; begin to discuss regression. Questions about article analysis.
* Class 27, Dec 8,9

Using Census Materials and controlling for extraneous variables with multiple regression. Read G: Kasarda, "The Impact of Suburban Population Growth on Central City Functions" and the personal journal.

HOMEWORK #15: What is the main point of this article? What is being controlled by the use of multiple regression? (In this case, it is just two-predictor regression.) Do not worry that you have not learned about regression in statistics. You do NOT need to know how to compute these statistics to be able to understand what they mean in tables. Questions about anything. Discussion of the elaboration model, third-variable analysis, and internal-external validity issues as they relate to your article analysis. If I have graded experiments, discussion of final grade based on computer projections.

Class 28, Dec 10,11 END OF SEMESTER PARTY AND MINI-CONVENTION. Experiments returned. Reports on what you found in your experiments. Discussion of final grade based on computer projections. Attendance is required today. I will bring refreshments and I urge you to do the same.
  I will have extended office hours on December 11, 12, and 15 for questions concerning your article analyses.
 

ARTICLE ANALYSIS DUE Tuesday, December 16

If you need an extension on this time, I will be happy to negotiate it, but understand that it might lead to your getting an incomplete temporarily.

Top

Questions? Comments? Please contact jpiliavi@ssc.wisc.edu

Home

Vita

Sociology 236

Sociology 357

Sociology 647

Sociology 965

Sociology Homepage

 

Sociology Homepage