Resources for Evaluating School Group Experiences

As a follow-up to the recent webinar I developed for ASTC and VSA (“Back to School: Techniques and Tips for Evaluating School Group Experiences”)  I’ve compiled the following list of digital resources and references.

General Articles about Museum-Based Education: 

• Building the Future of Education: Museums and the Learning Ecosystem  (Note: this publication includes a chapter called “Setting the Stage” by Elizabeth Merritt from the Center for the Future of Museums, which includes the same statistics that I referenced in my presentation (as shown below).

museum_school_stats

Evaluation Resources: General

• Better Evaluation (WEBSITE): http://betterevaluation.org/

• Evaluation Toolbox (WEBSITE): http://evaluationtoolbox.net.au/

• Pell Institute’s Evaluation Toolkit (WEBSITE): http://toolkit.pellinstitute.org/evaluation-guide/

• User-Friendly Handbook for Program Evaluation (2002) NSF (PDF): http://www.nsf.gov/pubs/2002/nsf02057/nsf02057.pdf

• Hartford Foundation: Evaluation Toolkit (for summer program evaluation): http://www.hfpg.org/HowWeHelp/TargetedGrantmaking/SummerFunding/SummerProgramEvaluation.aspx

• There are also lots of great resources, including links to reports that sometimes include instruments, at informalscience.org

• Studying Your Visitors, Where to Begin? by Randi Korn (1994): http://www.randikorn.com/docs/studying_your_visitors_where_to_begin.pdf

Evaluation Resources: Surveys

• Social Research Methods Knowledgebase (Survey Design)  (WEBSITE) http://www.socialresearchmethods.net/kb/survey.php

• Survey Fundamentals: A Guide to Designing and Implementing Surveys (HANDBOOK) http://oqi.wisc.edu/resourcelibrary/uploads/resources/Survey_Guide.pdf

Evaluation Resources: Interviews

• Conducting Interviews for Museum Program Evaluations – Kirsten Ellenbogen and Amy Grack Nelson: http://www.nisenet.org/sites/default/files/ProgEval_Guide_May10.doc

• Wilder Research – “Conducting Interviews (PDF): http://www.wilder.org/Wilder-Research/Publications/Studies/Program%20Evaluation%20and%20Research%20Tips/Conducting%20Interviews%20-%20Tips%20for%20Conducting%20Program%20Evaluation%20Issue%2011,%20Fact%20Sheet.pdf

• Conducting In-Depth Interviews (PDF): http://www2.pathfinder.org/site/DocServer/m_e_tool_series_indepth_interviews.pdf

Evaluation Resources: Analyzing Qualitative Data

• Renner, Marcus. “Analyzing Qualitative Data.” http://learningstore.uwex.edu/assets/pdfs/g3658-12.pdf

• Tips for Analyzing Qualitative Data: http://peoplelearn.homestead.com/MEdHOME/QUALITATIVE/Tips.AnalzQualData..pdf

Evaluation Resources: Presenting Data and Findings

• AEA’s “Potent Presentations” Initiative: http://p2i.eval.org/

• Stephanie Evergreen’s Intentional Reporting & Data Visualization Blog: http://stephanieevergreen.com/

Evaluation Resources: Utilization-Focused Evaluation

• Utilization Focused Evaluation, A Primer for Evaluators:  http://evaluationinpractice.files.wordpress.com/2013/04/ufeenglishprimer.pdf

• Utilization Focused Evaluation Checklist, M.Q. Patton (2002): http://www.wmich.edu/evalctr/archive_checklists/ufe.pdf

ASTC Resources:

Gone the Way of the Dodo: The Decrease in Enriching Field Trips (WEBINAR)  http://vimeo.com/85959775

With the rise of standardized testing in schools and the emphasis placed on improved test scores, the time and money for enrichment activities, such as field trips to museums, plummet. Are educational field trips being replaced with “reward” field trips? Both student and teachers report that field trips should be educational and fun, but what are they really getting out of these visits? In this webinar, three researchers shared their findings on the value of field trips for student success and inter-personal growth, and teachers’ needs to ensure a successful visit to the museum. Presenters: Brian Kisida, researcher at the University of Arkansas and co-author of “The Educational Value of Field Trips,”  Mary Ann Wojton, COSI, Columbus Lifelong Learning Group, and Al Onkka, Science Museum of Minnesota, Researcher and Evaluator

The Field Trip Challenge: Finding Common Ground (ARTICLE) http://www.astc.org/pubs/dimensions/2004/sept-oct/index.htm

By Dennis Schatz – These are the types of comments I hear from teachers, parents, and science center professionals whenever we talk about why, in this world of “No Child Left Behind,” it can be so difficult to get school groups to visit science centers. At Pacific Science Center (PSC), as at many other U.S. institutions, school group attendance has plateaued since the beginning of the new millennium.

As a science center professional with 30+ years working in the education arena, I have tried to delve deeper into the underlying causes for these comments. As I considered the sometimes conflicting, sometimes complementary needs, goals, and constraints of schools and science centers, I found myself visualizing a system (see diagram below) in which these factors might overlap to suggest a new approach to the classic “field trip.”

Why Do Visitor Studies? (ARTICLE WITH ADDITIONAL READINGS)

http://www.astc.org/resource/visitors/index.htm

Front-end, formative, and summative studies in museums are tools for improving design of exhibits and programs. Front-end studies, which focus on visitors’ interests and understandings, can be seen as the beginning of a continuing conversation among museum staff and advisors, visitors, and the subject matter. During design and prototyping, formative evaluation helps us to work toward clarity, comprehension, accessibility, and ease of use. When the exhibit or program is complete, summative evaluation can document its value to supporters and the community, and contribute to future planning.

ASTC Publications: Available athttp://www.astc.org/pubs/order_now.htm

Questioning Assumptions: An Introduction to Front-End Studies in Museums
Lynn D. Dierking and Wendy Pollock
ASTC, 1998
A must-read for museum professionals engaged in exhibition development, program planning, marketing campaigns, and the development of new facilities. “Front-end studies”—or research done at the onset of the planning process—can help museums to build bridges between themselves and visitors. This volume, based upon dozens of studies in the field, guides the reader through the planning process. 131 pp.
#120
ASTC members: $22
Nonmembers: $25

Try It! Improving Exhibits Through Formative Evaluation
Samuel Taylor, editor
New York Hall of Science, 1992
This book demystifies the formative evaluation process. Step-by-step procedures are provided, along with case studies from around the United States. The book contains contributions from Minda Borun, Margaret Chambers, Lisa Detloff, Alan Friedman, Patricia McNamara, Chandler Screven, Beverly Serrell, Cary Sneider, David Taylor, and Samuel Taylor. 118 pp.
#58
ASTC members: $25
Nonmembers: $30

Visitor Voices In Museum Exhibitions
Kathleen McLean and Wendy Pollock, editors
ASTC 2007
This book is a timely survey of ways museums are incorporating user-contributed content in exhibitions and other media. Overview articles by the editors plus 29 other articles describe a variety of experiments dating from the 1970s to the present—from comment books to sticky notes, video kiosks to blogs. For professional and student alike, Visitor Voices offers inspiration, food for thought, and practical advice. 164 pp, illustrated.
#152
ASTC members: $20
Nonmembers: $23

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s