Section outline

  • Learning Objectives  

    By the end of this training, participants will be able to:

      • Understand how the evaluation approaches such as intervention logics and the Key Impact Pathway concept can be applied to model and assess the impact of Open Science. 

    Training Topic  

    This training focuses on the methodology behind the Key Impact Pathways (KIPs) for Open Science Impact, developed under the PathOS project. The KIPs methodology is used for understanding and evaluating the impacts of Open Science practices. It employs a systematic, stepwise approach to map the effects of Open Science activities from inputs to long-term impacts. This involves identifying causal chains through a mix of data collection, coding, and visual mapping to create intervention logic models. These models help stakeholders to trace the academic, societal, and economic impacts of Open Science practices, ensuring a comprehensive understanding of their benefits and limitations. 

    Recordings from training

    To be add...

    Training Materials

    • Open Science Intervention Logic URL

      This report provide the methodological framework for the impact pathways. It starts from the Theory of Change and uses the RI-PATHS approach as a baseline model.

    • Key Impact Pathways for the Open Science Framework URL

      This report explores the impacts of Open Science (OS) practices with the scope of a proof-of concept study using the impact pathway concept described in PathOS Open Science Interventions Logic  (Dekker et al., 2023). Based on previous data collected by PathOS, particularly from the scoping review by Klebel et al. (2024) and empirical case studies conducted by Cole et al. (2023), this report customizes, tests, and validates the Key Impact Pathway approach in the context of Open Science. The approach utilises evaluation methods and concepts, particularly identifying impact chains (from activities to the creation of outputs, outcomes, and impacts) and collects and codes information from a set of 40+ sources. The resulting information is used to generate high-level impact chains, displayed as intervention logics, of Open Science practices. Three such preliminary pathways indicating the impacts of different Open Science activities are identified in the report: 1) Citizen Science, 3) Open Access pathway, 3) Impacts on climate and environment.  

    • Introduction to causality in science studies URL

      The paper provides an introduction to structural causal models, which are essential for making sound causal inferences in science studies. The authors explain the importance of distinguishing between correlation and causation and illustrate how structural causal models can be used to make causal assumptions explicit. By using graphical representations of causal models, researchers can better communicate their assumptions and findings, thereby fostering clearer discussions and more robust causal inferences. 

    • The societal impact of Open Science–a scoping review URL

      This paper addresses the challenge of measuring the societal impact of Open Science. The findings of the paper was part of the evidence base for the validation of the Key Impact Pathway approach to Open Science impact. This scoping review systematically analyzes 196 studies to provide an overview of the existing evidence on the societal impact of Open Science. 

    • The academic impact of Open Science: a scoping review URL

      This paper provides a systematic review of the academic impacts of Open Science practices, which aim to make research processes and outputs more accessible, transparent, and inclusive. Using the PRISMA scoping review methodology, the authors analyze 487 studies to understand how OS practices such as Open Access, Open/FAIR Data, Open Code/Software, Open Evaluation, and Citizen Science influence academic outcomes. The findings of the paper was part of the evidence base for the validation of the Key Impact Pathway approach to Open Science impact.