Evaluation Resources

Last updated June 16, 2021.

Evaluation and assessment are an integral part of the grant life cycle process, from writing to reporting. Faculty, Students, researchers, and the evaluation team need to collaborate and develop a common language, acquire a set of abilities, skills, and experiences that will be required to complete the evaluation competently.

I have compiled the following list of resources, intending to facilitate the understanding of Evaluation. I have grouped this resource by:

  • Principles and Standards: Guiding principles and National Standards
  • Evaluation Planning Books and Resources: Federal publications, Frameworks, and Handbooks
  • Professional Associations: List of US associations
  • NSF Evaluation Associations and Hubs: National Science Foundation US associations
  • Evaluation-Related Journals: Peer-reviewed journals
  • STEM Evaluation Tools & Instruments: Resources for STEM evaluation
  • Understanding Evaluation for PIs: A brief collection to assist new faculty
  • Other organizations and consulting groups providing external evaluation services

I hope you will find these resources useful.

Principles and Standards

Evaluation Planning Books and Resources

Professional Associations

NSF Evaluation Associations and Hubs

Evaluation-Related Journals

 STEM Evaluation Tools & Instruments

Understanding Evaluation for PIs

Other organizations and consulting groups providing external evaluation services

Sources

AEA. (2011). Public Statement on Cultural Competence In Evaluation. American Evaluation Association. https://www.eval.org/About/Competencies-Standards/Cutural-Competence-Statement

AEA. (2021). AEA365 [Blog]. https://aea365.org/blog/about/

AEA. (2021). Guiding Principles. American Evaluation Association. https://www.eval.org/About/Guiding-Principles

AEA Connect. (2021a). Cluster, Multi-Site, and Multi-Level Evaluation (CMME) TIG [Home Page]. http://comm.eval.org/cluster/home

AEA Connect. (2021b). Data Visualization & Reporting TIG [Home Page]. http://comm.eval.org/datavisualizationandreporting/home

AEA Connect. (2021c). STEM Education and Training TIG [Home Page]. http://comm.eval.org/stemeducationandtraining/home

AERA. (2021). American Educational Research Association [Home]. https://www.aera.net/

AJE. (2021). American Journal of Evaluation. SAGE Journals. https://journals.sagepub.com/home/aje

Bogue, B., & Marra, R. (2005). Assessing Women and Men in Engineering. http://aweonline.org/ngcpwebslides.pdf

Bonney, R., Hellenga, R., Luke, J., Marcussen, M., Palmquist, S., Phillips, T., Russell, L., Trail, S., & Yalowitz, S. (2011). Principal Investigator’s Guide: Managing Evaluation in Informal STEM Education Projects. Center for Advancement of Informal Science Education. https://www.informalscience.org/sites/default/files/caisevsapi_guide.pdf

CAISE. (2021). What is Evaluation? Informal Science. https://www.informalscience.org/evaluation

Centers for Disease Control and Prevention. (2021, abril 12). Framework for Program Evaluation. https://www.cdc.gov/eval/framework/index.htm

EPP & ELSEVIER. (2021). Evaluation and Program Planning [Journal]. Home. https://www.journals.elsevier.com/evaluation-and-program-planning

EvaluATE. (2021). EvaluATE – ATE Evaluation Resource Hub. https://evalu-ate.org/

Fitzgerald Bramwell, Patricia B. Campbell, Beatriz Chu Clewell, Darnella Davis, Norman Fortenberry, Antonio García, Donna Nelson, Veronica G. Thomas, & Adam Stol. (2009). Framework for Evaluating Impacts of Broadening Participation Projects (1st ed.). National Science Foundation. https://www.nsf.gov/od/broadeningparticipation/framework-evaluating-impacts-broadening-participation-projects_1101.pdf

Frechtling, J., & Westat, L. S. (1997). User-Friendly Handbook for Mixed Method Evaluations (1st ed.). National Science Foundation Directorate for Education and Human Resources. https://www.nsf.gov/pubs/1997/nsf97153/start.htm

HFRP. (2021). The Evaluation Exchange. Harvard Family Research Project. https://archive.globalfrp.org/evaluation/the-evaluation-exchange

Horizon Research, Inc. (2021). Instruments Teacher Questionnaires. Projects: Publications/Products. http://www.horizon-research.com/hri-instruments

ITEST & EDC. (2013). A Program Director’s Guide to Evaluating STEM Education Programs: Lessons Learned from Local, State and National Initiatives. Massachusetts Department of Higher Education. http://stelar.edc.org/sites/stelar.edc.org/files/A_Program_Directors_Guide_to_Evaluating_STEM_Eduation_Programs_links_updated.pdf

James Lipuma. (2017, marzo 13). Creating Strong Broader Impacts for NSF Proposals: Role of Evaluation & Broader Participation. https://www.youtube.com/watch?v=7rUa9WiBIlA&feature=youtu.be

JCSEE. (2021). Joint Committee on Standards for Educational Evaluation. JCSEE. https://evaluationstandards.org/

JMDE. (2021). Journal of MultiDisciplinary Evaluation [Home Page]. https://journals.sfu.ca/jmde/index.php/jmde_1

Lopatto, D. (2004). Survey of Undergraduate Research Experiences (SURE): First Findings. Cell Biology Education, 3(4), 270-277. https://doi.org/10.1187/cbe.04-07-0045

Lopatto, D. (2007). Undergraduate Research Experiences Support Science Career Decisions and Active Learning. CBE—Life Sciences Education, 6(4), 297-306. https://doi.org/10.1187/cbe.07-06-0039

Marcussen, M. (2017, septiembre 11). Principal Investigator’s Guide, Chapter 3: Choosing an Evaluator: Matching Project Needs with Evaluator Skills and Competencies [InformalScience.org]. InformalScience.Org. http://www.informalscience.org/evaluation/pi-guide/chapter-3

MSP. (2010). Database of Measures of Teachers’ Mathematics/Science Content Knowledge [Survey]. Math and Science Partnership MSP – Knowledge Management and Dissemination. http://www.mspkmd.net/instruments/index.php

NCME. (2021). National Council on Measurement in Education [Home]. https://www.ncme.org/home

NSF. (2015). Perspectives on Broader Impacts (1st ed.). https://www.nsf.gov/od/oia/publications/Broader_Impacts.pdf

NSF INCLUDES. (2021). Evaluation Affinity Group—INCLUDES National Network. https://www.includesnetwork.org/groups/group-home?CommunityKey=b5cb8f1a-7101-4377-8610-34ab13b95d87

OERL. (2021a). OERL: Glossary of Report Components. Online Evaluation Resource Library. https://oerl.sri.com/reports/reportsgloss.html

OERL. (2021b). OERL: Instruments. Online Evaluation Resource Library. https://oerl.sri.com/instruments/instruments.html

Office of Sponsored Projects. (2017). Writing an Evaluation Plan [Research at Brown University]. https://www.brown.edu/research/conducting-research-brown/preparing-proposal/proposal-development-services/writing-evaluation-plan

ORAU. (2021). STEM Program Assessment & Evaluation. Oak Ridge Associated Universities. https://www.orau.org/research-reviews-evaluations/assessment-evaluation.html

PARE & UMA. (2021). Practical Assesssment, Research, and Evaluation. University of Massachusetts Amherst. https://scholarworks.umass.edu/pare/

PEAR. (2021). Partnerships in Education and Resilience (PEAR) [Home Page]. PEAR. https://www.pearinc.org

Quinn Patton, M. (2017). Evaluation Flash Cards: Embedding Evaluative Thinking in Organizational Culture. Otto Bremer Trust. https://ottobremer.org/wp-content/uploads/2017/12/OBT_flashcards_201712.pdf

SAGE. (2021). Evaluation—The International Journal of Theory, Research and Practice. SAGE Journals. https://journals.sagepub.com/loi/evi

Sagefox Group. (2021). SageFox Consulting Group. Sagefox Group. https://www.sagefoxgroup.com

SEA. (2021). Southeast Evaluation Association [Home]. http://southeastevaluation.org/

SERC. (2021, junio 13). Field-tested Learning Assessment Guide for Science, Math, Engineering and Technology Instructors. https://serc.carleton.edu/resources/23359.html

STELAR. (2021a). Resources, Survey and Instruments. http://stelar.edc.org/resources

STELAR. (2021b). STELAR – STEM Learning and Research Center [About NSF and ITEST]. http://stelar.edc.org/about-nsf-and-itest

University of California. (2021). Activation Lab Tools: Measures and Data Collection Instruments [Home]. ActApp: The Toolkit. http://activationlab.org/tools/

University of Colorado Boulder. (2018, marzo 27). Evaluation Tools: Undergraduate Research Student Self-Assessment (URSSA). Ethnography & Evaluation Research. https://www.colorado.edu/eer/research-areas/undergraduate-research/evaluation-tools-undergraduate-research-student-self

Westat, J. F., Frierson, H., Hood, S., & Hughes, G. (2002). The 2002 User-Friendly Handbook for Project Evaluation (1st ed.). National Science Foundation Directorate for Education and Human Resources. https://www.nsf.gov/pubs/2002/nsf02057/nsf02057.pdf

Wiley Online. (2021). New Directions for Evaluation. Wiley Online Library. https://doi.org/10.1002/(ISSN)1534-875X

W.K. Kellogg Foundation. (2017, noviembre). The Step-by-Step Guide to Evaluation: How to Become Savvy Evaluation Consumers. W.K. Kellogg Foundation. https://www.wkkf.org:443/resource-directory/resources/2017/11/the-step-by-step-guide-to-evaluation–how-to-become-savvy-evaluation-consumers

WMU. (2014a). Effective Communication Strategies for Interviews and Focus Groups. Western Michigan University. https://wmich.edu/sites/default/files/attachments/u350/2020/hunter-hillman-communication.pdf

WMU. (2014b, octubre 29). Evaluation Checklists. Western Michigan University. https://wmich.edu/evaluation/checklists