Memesis - Human Subject Study

  1. Title of Proposal and date of submission:
    "Virtual Reality Environment Experiment 1: A Comparison of Physiological Measures of Fear Arousal" 
    Submitted September 26, 2003
    Approved September 29, 2003
     
  2. Name and address of the primary investigator:
    Alison McMahan
    [email protected]
     

  3. Department of origin of the proposal:
    Media Studies Development Project

  4. Name of student research assistant:
    Rebecca Tortell

  5. Design Overview (Answer Yes or No):

    1. Is your research free of deception?
      YES

    2. Are the risks to participants less than minimal (see 8C)? 
      The risks to participants in this study these risks are similar to those evoked when watching a mainstream Hollywood film, as the clips will be taken from Hollywood films, in other words, the risk is similar to that ordinarily encountered in daily life. The hypoallergenic gel used for attaining a good electrical connection between the electrodes and the skin may cause a rash in people with sensitive skin. There is an extremely small possibility of getting a small electric buzz from the electrodes; however this risk is greater for the researchers, who apply and remove the electrodes, than the subjects. The equipment is designed to shut itself off if there is a power surge or other electrical anomaly, and has already been used by many researchers at Vassar without problems.

    3. Will the subjects be 18 years of age or older? 
      Subjects will be 18+.

    4. Will you be obtaining genuine informed consent (see 11C)?
      YES

    5. Are participants' responses anonymous?
      YES

  6. Research proposal summary (100 words or less)
    Memesis is a prototype virtual reality environment (VE) with a transparent interface which reads subconscious input from the user as well as user choices. The goal is to develop a sense of presence in the VR based on a greater sense of immersion brought about by the VE's ability to collect data from the user and respond accordingly for entertainment and learning. This study will examine the efficiency of two measures (skin conductance response, electrocardiogram) for determining the arousal reactions within each individual confronted with video clips that will approximate the eventual 3D graphic VR content that Memesis will contain.

  7. Theoretical justification for the research:

    This project is inspired in the first place by projects that apply VR in the treatment of phobias (Hodges 1995, MŸhlberger 2001, North 1996, etc). Many studies have measured normal and pathological reactions to emotional stimuli such as anxiety inducing situations (Litt 1999, Pury 1997, Tillfors et al 2001), provocative visual stimuli such as photographs (Paradiso et al 1999, Sheline et al. 2001, Thomas et al, 2001), computer games (MacDowell and Mandler 1989), and memories of previous emotionally-laden experiences (Dougherty et al 1999, Rosenberg et al. 2001). Most of these studies aimed to show a correlation between heightened emotional arousal and physiological effect generally, as reflected in MRIs or SCRs, and the methods used to evoke an arousal response were of like kind. Some studies have indicated a consistent concordance between response systems (Calvo, Miguel-Toabal, 1998, Alvarado 1997). The purpose of the current study is to ascertain if SCR or EKG measurements can be used effectively to determine, not whether certain stimuli evoke an arousal response at all, but which of various stimuli evokes the highest response in any given (normal) individual. Eventually the form of measurement that works best will be used as part of a biofeedback interface in a VR environment so that the physiological responses of the user can serve as navigational commands in the virtual environment.

    Lombard's work on presence (the artificial sense that a user has in a virtual environment that the environment is unmediated) lists six dimensions of presence as defined in a diverse set of literatures. His summary indicated that an increased sense of presence can result from a combination of all or some of the following factors: social interaction, realism in the environment (graphics, sound, etc), from the effect of teleportation or telepresence, from the degree of immersiveness generated by the interface, from the user's ability to accomplish significant actions within the environment, and from the social impact of what occurs in the environment (Lombard 2000). I have clarified and slightly revised these six dimensions of presence for their use in VR and computer game design (McMahan, 2003). Clearly, some of these elements work against others; for example, the learning curve required to act effectively can conflict with the sense of immersiveness (Ryan 1999). The biofeedback interface in Memesis is designed to minimize this lack of complementarity by replacing the need for the user to learn a complex interface and command system with an interface that responds to the user's physiological state. This study is the first step in the process of the interface design.

  8. Detailed Research Proposal.

    1. Who will be the participants and how will they be recruited? How many participants do you expect to use?

      This would require approximately 20 adult (age 18+) participants with no gender specificity. Participants would be recruited from Vassar College through advertisement and personal contact. A financial incentive may be invoked if an insufficient number volunteer.

    2. Describe the psychological and/or physiological stimuli, manipulations, or interventions and the means used to administer them. Indicate the steps that will be taken to ensure the proper operation of the equipment used to administer stimuli and interventions. Give particular attention to prevention of accidental harm or injury to the subjects.

      All stimuli will be presented in the form of video clips shown on a television monitor. Before the stimulus material is presented, each participant will fill out a questionnaire on their aversions and phobias. Participants can read over the questionnaire before they begin and opt out of the study before filling out the questionnaire if they choose to do so. Participants are given the option to abstain from any item they do not wish to answer. Participants will be shown a series of clips, mostly from recent Hollywood films made with a similar level of production value. Films with an NC-17 rating will be excluded. Clips will contain realistic depictions of sequences that might trigger a fear reaction (sequences with a character teetering on the edge of a cliff) or anxiety reaction (sequence depicting a plane crash, such as the crash sequence in Castaway.) As a control participants will be shown two "calm" sequences depicting a low key narrative event such as a conversation or a tranquil activity. After each clip participants will have a short pause before the next clip is shown to answer questions about their reaction to the clip. At the end of the study participants will be shown a slightly longer clip of from a calm and cheerful sequence, such as a comedy routine or a musical number, to help the participant return to pre-stimulus emotional levels. Should participants become visibly distressed at any time the PI will encourage them to discontinue participation in the study. Total length of time for each subject involved in experiment: 75 to 90 minutes.

    3. Describe the level of risk to which the participants will be exposed byparticipating in this study. Why are the risks necessary? Why is the research important enough to justify the risks?

      The goal of this study is to provide basic data to enable an interface design that will promote a higher degree of presence in virtual reality environments. A more transparent interface is the goal of all virtual reality designers. Virtual reality environments are used for entertainment and most importantly for training, research, and treatment. Any improvement in design would help in the accomplishment of all of those goals.

      Some of the stimulus material, by design, will tend to provoke affective reactions. For example, participants will view events such as plane crashes that could trigger feelings of anxiety. However, these risks are similar to those evoked when watching a mainstream Hollywood film, as the clips will be taken from Hollywood films. Nevertheless, participants are given the option to skip stimulus material that may make them uncomfortable, or stop their participation with no penalty. The hypoallergenic gel used for attaining a good electrical connection between the electrodes and the skin may cause a rash. There is a remote possibility of slight electrical shock from a power surge. However the equipment is designed to switch itself off should such a surge occur. This equipment has been used by researchers in the Vassar Psychology department for many experiments without any problems.Subjects are advised to consider this before choosing to participate. Subjects will also be warned that some of the clips they will view could elicit a phobic reaction. They will be advised not to participate if they have strong phobias. In case a subject does have a strong reaction, we will have a separate quiet area set up with comfortable seating and some snack food where the PI can spend time with any subject who is overwhelmed by the experience of watching the clips.

    4. Is there any deception of the participants who will be involved?

      There is no deception involved in any part of this study.

    5. Describe the expected behavior of the participants and the behavior of the investigator during the research. This must include a written statement of what is to be read or said to the participant concerning the research.

      During the experiment, as participants view the stimulating clips and the non-stimulating control clips, their skin conductance is recorded from an electrode placed on the palms or fingertips, heart rate is recorded from an electrode on the wrist. Electrodes are connected to a BioPac physiological data amplifier, analog-to-digital converter, and ultimately to a computer running AcqKnowledge software that will record the signal. After viewing each clip, subjects will be asked several questions. They will rate their anxiety or fear reaction to each clip on a scale of 1 to 5. They will also be asked if they had already seen the film. After all the stimulus material has been presented, participants may be asked if they felt certain clips aroused a stronger response than others. They will also be encouraged to discuss their overall experience with the PI as a way of helping them return to normal emotional state before their participation is concluded.

      Participants will be read the following statement before informed consent is obtained. Prior to its reading, they will have seen the room where they will be tested.

      "Thanks for coming to the lab to hear about this study. This is what will happen if you decide to participate.
      "I am interested in measuring the different fear and anxiety reactions caused by visual/audio media within individuals.

      The purpose of the study is to provide data to aid in the design of a biofeedback interface for a virtual reality environment. "If you choose to participate, I will have you first answer some questions about what sorts of things you are afraid of. These questions may require you to provide us with sensitive information about yourself; if you prefer not to answer any question, you may skip any question for any reason or withdraw your participation at any time. As part of the study, you will be asked to watch a series of clips, excerpts from Hollywood films. Each clip is only a few minutes long; there is a total of forty five minutes worth of clips, with breaks in between each clip.

      "Before showing you the clips I will hook up small electrodes to your palm and to your wrist on each hand, and one on your ankle The electrode on your palm measures your galvanic skin response, that is, minute changes in sweat. Unlike other sweat glands in your body, in certain places sweat is determined by autonomic arousal and not temperature. This sort of equipment has been used with other measurements for polygraph tests to help determine whether someone is telling the truth, although that is not its function here. The electrode on your wrist measures your heart rate, and the one on your ankle is a ground. The electrodes are applied with gel. It is possible that a person might develop a mild rash from the gel, but it is designed to be hypoallergenic. If you have extremely sensitive skin, you might want to consider your participation carefully, but it is unlikely that you will have a reaction to the gel. The other risk that participants are sometimes concerned about is being connected to electrical equipment. This same equipment is regularly used in research and hospitals. We use a device that immediately switches off the power if there is any current leakage from the equipment. This protects you while you are connected to the electrodes. This equipment has been used here at Vassar for many experiments without any problems.

      After watching each clip, you will be asked if you found it frightening, anxiety inducing, etc. on a scale of 1 to 5, in which 5 means you found it very scary and 1 means not at all scary.

      "You may have as much time as you need to answer the questions. You may take a break at any time. The entire procedure should take 75-90 minutes. All of the data collected here will be identified with a number, so your name will never be associated with your responses and physiological recordings. This enhances confidentiality, as only myself and my project coworkers will have have access to these data.
      "Just as in all studies with human participants, anyone has the right to stop at any point. If you decide you'd like to stop, just let me know. If you have any questions along the way, you can feel free to ask me. Do you have any questions about what will happen if you decide to be a participant?"  (Answer questions). 

      Once all questions are answered to the subject's satisfaction, and the subject is willing to go ahead, the investigator will obtain informed consent and say:

      Here are two copies of the consent form. One is for you to keep. Go ahead and read it, and ask me any questions you might have. If you choose to participate, please sign the form. You are under no obligation to participate or to sign the form.

    6. Describe how the participants are to be debriefed and the mechanism for alleviation of stress or psychological harm that may derive from participation in this study. Provide a written statement of what will be said to, read to, or ready by the subjects during the debriefing.

      At the end of the study participants will be shown a calm and cheerful movie clip. They will also be encouraged to discuss their emotional experience with the PI. This should help them return to a calm state. If subjects are interested, the motivation of the study may be explained in a larger context.

    7. State what the information/data from this research are to be used for. Who will have access to the data? What will be done with the data?

      The data are being collected for the purposes of furthering the design of a virtual reality project by Alison McMahan, Ph.D., a project funded by a Mellon Postdoctoral Fellowship grant. The following individuals will have access to these data: Rebecca Tortell (student), Dr. Ken Livingston (consultant), and the team of consultants and students that will be designing and programming the final VR environment.

    8. Who is conducting the study.

      The study will be performed by Alison McMahan, although Advisors Professor Ken Livingston and Professor Randy Cornelius have provided guidance for the purpose of learning the necessary techniques in efficient physiological data collection. She will be assisted by student Rebecca Tortell.

  9. Describe how the privacy and anonymity of participants are to be protected.

    Participant privacy and confidentiality are protected through the assignment of numbers. When data are collected, they will be associated with assigned participant numbers only. Additionally, only a small number of people will have access to these data.

  10. Questions and Questionnaires

    1. This questionnaire will be administered prior to the viewing of clips. Questions are still not exactly in their final form, as I plan to consult with an expert in statistical design before I put them into their final form. The following gives an indication of what we need to know for the purposes of the study: 

      Code # Sex M F Date of birth (you must be 18 to participate)

      Please rank the following media according to preference:

      Films, TV, Computer/video games

      How many hours a week do you spend on the following:

      Watching movies

      Watching TV

      Playing computer/video games

      Would you describe yourself as a horror film fan?

      Would you describe yourself as a myster/thriller film fan?

      To your knowledge do you suffer from any phobias? (Be advised that if you have been clinically diagnosed with a phobia it might be risky for you to participate in this study).

    2. Participants will be asked to answer the following questions after each clip: 

      Have you seen this movie before?

      On a scale of 1 to 5, with 5 being the most intense, and 1 not being intense at all, how would you rate the degree of your emotional reaction to this clip?

      Describe the emotions this clip elicited from you in words.

References

Alvarado, N. (1997). Arousal and Valence in the Direct Scaling of Emotional Response to Film Clips. Motivation and Emotions, Vol. 21, No. 4, 323-348.

Barfield, W., & Weghorst, S. (1993). The sense of presence within virtual environments: A conceptual framework. Proceedings of the fifth International Conference of Human-Computer Interaction, 699-704.

Barfield, W., Zeltzer, D., Sheridan, T., & Slater, M. (1995). Presence and performance within virtual environments. In W. Barfield and T. A. Furness, III (Eds.), Virtual environments and advanced interface design (pp. 473-541). New York: Oxford University Press.

Bechara, A., Damasio, H., Damasio, A.R. (2000). Emotion, decision making and the orbitofrontal cortex. Cerebral Cortex, 10(3): 295-307.

Bechara, A., Damasio, H., Tranel, D., Anderson, S.W. (1998). Dissociation of working meory form decision making within the human prefrontal cortex. Journal of Neuroscience, 18(1): 428-437.

Bechara, A., Tranel, D., Damasio, H. (2000). Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain, 123: 2189-2202.

Calvo, M.G., Miguel-Tobal, J.J, (1998). The Anxiety Response: Concordance Among Components. Motivation and Emotion, Vol 22, No.3. 211-230.

Carlin, A.S., Hoffman, H. and Weghorst, S. (1997). Virtual Reality and Tactile Augmentation in the Treatment of Spider Phobia: A Case Study. Behavior Research and Therapy, 35(2), 153-158.

Clader, J.J., Lawrence, A.D. & Young, A.W. (2001). Neuropsychology of fear and loathing. Nature Reviews Neuroscience 2(5) May 352-363.

Damasio, A. (1994).Descartes' Error: Emotions, Reason, and the Human Brain. New York: Avon Books, Inc.

Damasio A.R., Grabowksi, T.J., Bechara A., Damasio H. Ponto L.L.B., Parvizi, J. Hichwa, R.D. (2000). Subcortical and cortical brain activity during the feeling of self-generated emotions. Nature Neuroscience 3 (10) October 1049-1056.

Dougherty, D.D., Shin, L.M., Alpert, N.M., Pitman R.K., Orr, S.P., Lasko, M., Macklin, M.L, Fischman, A,J., & Rauch, S.L. (1999). Anger in healthy men: A PET study using script-driven imagery. Biological Psychiatry, 46(4) August 466-472.

Ekman, P. (1993). Facial Expression and Emotiona. Amrican Psychologist, 48(4), 384-392.

Emmelkamp, P.M.G, Krijn, M. Hulsbosch, , L. de Vries, , S. , Schuemie , M.J. & van der Mast, C.A.P.G. (2002). Virtual Reality Treatment in Acrophobia: A Comparison with Exposure in Vivo. Behaviour Research & Therapy, May, Vol 40(5), 25-32

Etgen, M.P.&Rosen, E.F. (1993). Cognitive Dissonance: Physiological arousal in the performance expectancy paradigm. Bulletin of Psychonomic society, 31(3), 229-231.

Garcia-Palacios, A., Hoffman, H.G., Kwong See, S., Tsai, A. and Botella-Arbona, C. (2001). Redefining therapeutic success with VR exposure therapy. CyberPsychology and Behavior, 4(3), 341-348.

Hatada, T., Sakata, H., & Kusaka, H. (1980). Psychophysical analysis of the 'sensation of reality' induced by a visual wide-field display. SMPTE Journal, 89, 560-569.

Heeter, C. (1992). Being There: The subjective experience of presence. Presence, 1(2), 262-271.

Heeter, C. (1995). Communication research on consumer VR. In Frank Biocca & Mark R. Levy (eds.), Communication in the age of virtual reality (pp. 191-218). Hillsdale, NJ: Lawrence Erlbaum Associates.

Held, R. M., & Durlach, N. I. (1992). Telepresence. Presence, 1(1), 109-112.

Hodges, L., Rothbaum, B., Kooper, R, Opdyke, D., Meyer, T., North, M., de Graff, J. and Williford, J. Virtual environments for treating fear of heights. IEEE Computer 28, 7, (Jul. 1995),. 27-34.

Kesler, M.L., Anderson, A.H., Smith, C.D., Avison, M.J., Davis, C.E., Kryscio, R.J., & Blonder, L.X. (2001). Neural substrates of facial emotiona processing using fMRI. Congitive Brain Research 11(2) April 213-226.

Litt, M.D., Kalinowski, L., & Shafer, D. (1999) A Dental Fears Typology of Oral Surgery Patients: Matching Patients to Anxiety Interventions, Health Psychology, vol. 18(6), November, 614-624.

Lombard, M. (2000). Measuring presence: a literature-based approach to the development of a standardized paper-and-pencil instrument. Project Abstract Submitted for Presentation at Presence 2000: The Third International Workshop on Presence. http:www.presence-research.org/presence2000.html.

Lombard, M. (1995). Direct responses to people on the screen: Television and personal space. Communication Research, 22(3), 288-324.

Lombard, M., & Ditton, T. (1997). At the heart of it all: The concept of presence.

Lombard, M., Reich, R. D., Grabe, M. E., Campanella, C. M., & Ditton, T. B. (1995, May). Big TVs, little TVs: The role of screen size in viewer responses to point-of-view movement. Paper presented to the Mass Communication division at the annual conference of the International Communication Association, Albuquerque, NM.

Macdowell, K.A., Mandler, G. (1989). Constructions of Emotiond: Discrepancy, Arousal, and Mood. Motivation and Emotion, Vol. 13, No.2, 105-124.

McMahan, Alison, (2003). Immersion, Engagement, and Presence: A Method for Analyzing 3-D Video Games. Routledge, pp. 67-86.

Minsky, M. (1980, June). Telepresence. Omni, pp. 45-51.

MŸhlberger, A., Herrmann, M.J., Wiedemann, G., Ellgring, H., & Pauli, P. (2001). Repeated exposure of flight phobics to flights in virtual reality. Behaviour Research and Therapy 39 1033-1050.

Nijula, R. (1991). Psychological correlates of nonspecific skin conductance reponses. Pscyhophysiology, 28(1), 86-90.

North, M., North, S. and Coble, J. Effectiveness of virtual environment desensitization in the treatment of agoraphobia. Presence: Teleoperators and Virtual Environments 5, 3, (March 1996), 346-352

North, M.., North, S., and Coble J. Virtual Reality Therapy, An Innovative Paradigm. IPI Press, 1996.

Paradiso, s., Johnson, D., Andreasen, N.C., O'Leary, D.S. Watkins, G.L., Ponto, L.L.B., & Hichwa, R.D. (1999), Cerebral blood flow changes associated with attribution of emotional valence to pleasant, unpleasant, and neutral visual stimuli in a PET study of normal subjects. American Journal of Psychiatry 156 (10) October 1618-1629.

Perse, E., Buton, P. L., Kovner, E. S., Lears, M. E., and Sen, R. J. (1992). Predicting computer-mediated communication in a college class. Communication Research Reports, 9(2), 161-170.

Prothero, J. D., Parker, D. E., Furness III, T. A., & Wells, M. J. (1995a). Towards a robust, quantitative measure for presence. In Proceedings of the Conference on Experimental Analysis and Measurement of Situation Awareness, 359-366. Available: http://www.hitl.washington.edu

Prothero, J. D., Parker, D. E., Furness III, T. A., & Wells, M. J. (1995b). Foreground/background manipulations affect presence. Paper presented at HFES '95. Available: http://www.hitl.washington.edu

Pury, C. L.S. & Mineka, S. (1997). Covariation bias for blood-injury stimuli and aversive outcomes. Behaviour Research and Therapy, Vol 35, Issue 1 January, 35-47.

Quarrick, G. (1989). Our sweetest hours: Recreation and the mental state of absorption. Jefferson, NC: McFarland.

Reeves, B. (1991). "Being there:" Television as symbolic versus natural experience. Unpublished manuscript, StanfordUniversity, Institute for Communication Research, Stanford, CA.

Rothbaum, B., Hodges, L., Watson, B. Kassler, G., and Opdyke, D. Virtual reality exposure therapy in the treatment of fear of flying: A case report. Beh. Res. Ther. 34, 5-6 (May/Jun. 1996), 477-481.

Ryan, M., (1999). Cyberspace, Virtuality and the Text.Cyberspace Textuality, Computer Technology and Literary Theory, edited by Marie-Laure Ryan, Bloomington & Indianapolis: Indiana University Press 78-107.

M.J. Schuemie, C.A.P.G. van der Mast, M. Krijn, P.M.G. Emmelkamp (2002). Exploratory Design and Evaluation of a User Interface for Virtual Reality Exposure Therapy

in: J.D. Westwood, H.M. Hoffman, R.A. Robb, D. Stredney (Eds.), Medicine Meets Virtual Reality 02/10, IOS Press, pp.468-474

M.J.Schuemie, C.A.P.G.van der Mast (2000). Design of Virtual Reality Exposure Therapy Systems - Task Analysis.Proceedings of the Revalidatie Anno 2000 Conference, Nederlands Instituut voor Psychologen, 17 en 18 november.

Slater, M., & Usoh, M. (1993). Representations systems, perceptual position, and presence in immersive virtual environments. Presence, 2(3), 221-233.

Strickland, D., Hodges, L. North, M. & Weghorst, S. (1997). Overcoming phobias by virtual exposure. Communications of the ACM 40, 8, August, 34-39.

Tabert M.H., borod, J.C., Tang, C.Y., Lange, G., Weit, T.C., Johnson, R. Nusbaum, A.O., & Buchsbaum, M.S. (2001) Differential amygdala activation during emotional decisions and recognition memory tasks using unpleasant words: an fMRI study. Neuropsychologia, 39 (6): 556-573.

Thomas, K.M., Drevets, W.C., Whalen, P.J., Eccard, C.H., Dahl, R.E., ryan, N.D., & Casey, B.J. (2001) Amygdala response to facial expressions in children and adults. Biological Psychiatry 49(4) February 309-316.

Waters, R. C., & Barrus, J. W. (1997). The rise of shared virtual environments. IEEE Spectrum, 34(3), 21-25.

Williams, L.M., Phillips, M.L., Brammer, M.J., Skerrett, D., Lagopoulos, J. , Rennie, C., Bahramali, H., Olivieri, G., David, A.S., Peduto, A., & Gordon, E. (2001). Arousal dissociated Amygdala and Hippocampal fear responses: Evidence from simultaneous fMRI and skin conductance recording. Neuroimage 14, 1070-1079.

Wilson, W. & Chambers, W. (1989). Effectiveness of praise of self versus praise of others. Journal of Social Psychology, 129, 555-556.