Marina A. Piscolish, Ph.D., Principal Partner of MAPping Change, LLC and affiliate faculty at the University of Hawai`i is an experienced Management Assistance Provider. Dr. Piscolish specializes in facilitation, evaluation, training and strategic advising in both the public, private and not-for-profit sectors with an emphasis in education, environment and social justice issues in cross-cultural settings. Her unique expertise combines knowledge of organizational planning and development, dispute resolution and leadership to create capacity and climate for collaboration and strategic change. She earned her doctorate in Educational Administration and Policy from the University of Pittsburgh in 1997 and focused her studies on organizational theory and conflict studies.  She co-authored Reaching for Higher Ground: Tools for Powerful Groups and Communities (Jossey Bass Publishing, 2000). Marina’s earned a reputation as an innovator of practice and a leader in the field.  A Sampling of Clients Served Hawaii Department of Education Hawaii Department of Health Hawaii Department of Land and Natural Resources Kamehameha Schools & Bishop Estate University of Hawaii American Samoa Government Commonwealth of the Northern Marianas Islands Farmers’ Insurance Hawaii Hawaii Community Foundation Hawaii Community Stewardship Network Hawaii Agricultural Alliance Moili’ili Community Center The Native Hawaiian Education Council Native Hawaiian Legal Corporation NOAA, Pacific Services Center, Hawaii Olelo Community Media Pacific Resources for Education and Learning The Republic of Palau Ulupono Fund West Hawaii Fisheries Council

B. InQuiry: Q Methodology as a Participatory Evaluation Process

by Matthew Militello and Christopher Janson

1:30 pm - 4:30 pm, Thursday, September 12, 2013 (lunch provided, 12:00 pm, Honey's at Ko'olau restaurant)

Q methodology uses distinct psychometric principles and operational procedures in order to provide researchers with the means to systematically and rigorously identify, describe, and examine human subjectivity (see www.qmethod.org). In doing so, Q methodology uses correlation and factor analysis to reveal the subjective structures of attitudes, opinions, or perspectives that are shared by people around virtually any topic. Participants at this workshop will not only learn about the theoretical elements of Q methodology as a research tool, but will learn about how the presenters have applied Q methodology as an process for community-engaged evaluation which they have called “inQuiry.” Importantly, attendees will also participate in a real-time inQuiry process. Participants will receive guides and tools in order to conceptualize and frame their own Q studies or evaluative process.

Learning Outcomes

1. Understanding of the theoretical and research aims and research process of Q methodology.
   
2. Understanding of the use of Q methodology as an evaluation approach and the rationale to do so.
   
3. Experience the application of Q methodology as the generative, participatory evaluation approach that we have named inQuiry.
   

Agenda

What is Q methodology (development, psychometric properties, uses)

• Q overview video developed by presenters
  
• Q methodology as a means for detecting and magnifying silenced voices. Participant web reading activity: Brown, S. (2006). A match made in heaven: A marginalized methodology for studying the marginalized. Quality & Quantity, 40, 361–382.
  
• From Q methodological research to inQuiry evaluation of community and educational initiatives
  

Card Sorting (Q sort) Activity—Participants will sort a set of statements around a topic. This is the main element of Q methodology. Here participants will first experience ths innovative data collection process. Later in the session participants will see how the data are analyzed and used in an interpretive activity.

Elements of the Q Process

• Concourse Theory and Q Sample Development Activity
  
• Protocol Development (Distribution Matrix and Post Sort Questionnaire)
  
• Sorting Process (Recall Your Own Sort Earlier—On-line v. hand sorts)
  
• Data Analysis (demonstrate use of computer-based analytic tools)
  
• Data Interpretation
  

Participatory, Collective Analyses of Participant Card Sort

• Grouped By Statistically Distinct Factors
  
• Each Affinity Group will
  
• Describe Family (Factor) Members
• Develop Family Name as a means for interpretation
• Present a Visual Representation of their Family
• Use excerpts from the following book to see examples of data reporting: Watts, S., & Stenner, P. (2012). Doing Q methodological research: Theory, method and interpretation. Thousand Oaks, CA: Sage.

Closing