The Program Evaluation Community hosted an overview of the Map of Science tool developed by the Emerging Technology Observatory at Georgetown University's Center for Security and Emerging Technology (CSET). This free online tool collects and organizes the world’s research literature, revealing key trends, hotspots, and concepts in global science and technology. Zachary Arnold and Christian Schoeberl from CSET walked members through how to utilize this tool for measuring the impact of research funding and answered questions on how best to optimize it for evaluation purposes. Program Evaluation Co-Chairs Brent Dolezalek, James S. McDonnell Foundation Orna Ehrlich, Crohn’s & Colitis Foundation
New Search
If you are not happy with the results below please do another searchAs discussed in our September 2022 Program Evaluation Community webinar, the use of effective data visualization as a component of program evaluation can be a powerful asset in an evaluation toolkit for both internal and external stakeholders. In this webinar, we continued building on this skillset through an interactive and engaging presentation by two data visualization experts from the Centers for Disease Control and Prevention–Jina Joan Dcruz, MSW, PhD and Florence Lee, MPH–who chair the CDC Data Visualization Science Advisory Group. The webinar enhanced attendees understanding of how to: Select appropriate communication channels that promote productive discussions on evaluation findings. Identify different approaches... read more →
The Program Evaluation Learning Community has compiled a list of tools available for various purposes, including measuring outcomes, visualizing data, and bibliographic management. Check out the Google Sheet on the Members Only Documents page under the Program Evaluation Learning Community section (must be logged into the HRA website to view).
Monday October 16, 2:45pm-4:00pm CT The Program Evaluation Learning Community hosted a hands-on walk through of HRA Analyzer at the Fall 2023 HRA Members Meeting. In this session, attendees learned how they can leverage this members-only resource and improve their research portfolio evaluation efforts. Diane Saunders kicked off the session by providing a brief walkthrough of HRA Analyzer, including a few use case examples. During the remainder of the session, Diane provided real-time support for participants to navigate the tool and begin browsing data of interest to fit their organization’s needs. Learning Community Co-Chairs Heather Calderone, American Brain Tumor Association... read more →
How can organizations measure and understand the impact of their research programs? What can online tools offer to automate or streamline evaluation processes to provide insights into research investments? In this session, we hope to fill HRA Members’ toolboxes with options (including free and subscription-based tools) for nimble research impact analysis. From perspectives on how the NIH measures impact and develops publicly available tools, to using ORCID to track grantee outputs, to other ways in which HRA member organizations measure and assess impact, we will learn about evaluation and tools that can help members to automate or streamline their processes.... read more →
The Program Evaluation community learned more about Utilizing Visualization for Program Evaluation: Techniques and Strategies at its September meeting. Speaker: Dr. Katy Börner, Indiana University in Bloomington, Professor of Engineering and Information Science Summary: Program evaluation is an important aspect of the program life cycle for funders. While many program evaluations consider publications, follow-on funding, citation and co-citation networks, and Altmetrics to explore the impact and influence of their research portfolio, the use of effective data visualization as a component of program evaluation can be a powerful asset in an evaluation toolkit for both internal and external stakeholders. For this webinar,... read more →
The first meeting of 2022 was an Open Mic session on the challenges members are facing in evaluating their programs as well as some solutions to these challenges. The Program Evaluation Community has moved from exploring tools to collect and analyze outcome data, to learning more about how to measure not only outcomes of your funding but impact as well. From the impact of the research you fund, to the impact of the programs you have launched, and even measuring organizational impact. Many HRA members shared challenges and ideas for measuring impact. The discussion of evaluating impact will continue with... read more →
Dear HRA members, We recently completed an evaluation of a program supporting innovations in a specific disease area, sickle cell disease. However, we are having trouble finding comparisons against which to benchmark our portfolio’s outcomes such as follow on funding, number of publications, and return on our dollars. Have you done an evaluation of a grant program including follow-on funding and bibliometric indicators? And if it has been published? Thank you! Sindy
To access the detailed survey report click the link above. If you have edits to your organization's info, or if you did not submit any documents and would like to now, please email Annette and we will make edits to this document. This document is for use by HRA members only.