Group(s) submitting the application: Evaluation of Research IG
Meeting objectives
The Evaluation of Research IG was submitted to RDA in May 2023. The meeting will hopefully be its first meeting during an RDA Plenary as an Interest Group, after two successful BoF meetings at P19 and P20. The meeting objectives are:
- to discuss the activities foreseen for the IG with the RDA community and get participants’ feedback;
- to identify people interested to get involved in specific activities;
- to present the first results of the landscape analysis aimed at identifying RDA activities relevant to the subject, the first topic that will be addressed by the IG, and gather comments from the participants.
The meeting will enable us to achieve this together through sharing perspectives on the importance of diverse approaches to research and its evaluation, respecting cultural, national, and disciplinary needs and requirements via discussion and contributions to current and planned activities of this group.
Meeting agenda:
Collaborative meeting notes: https://bit.ly/EoRp21
Part 1 (10 min): Welcome
- Short review of Group’s aims and activities: Transition from BoF to IG
Part 2 (60 min): Discussion of the Group current and foreseen activities
- First steps toward a preliminary landscape analysis and discussion (30 min)
- Discussion and determination of next activities (30 min)
Part 3 (15 min): Next steps
- Confirm commitments to next steps
- Identify and align around goals for P22
The collaborative note document will be available and organised so as to gather written comments and contributions in addition to the discussion.
Target Audience:
The evolution of research evaluation is potentially of interest for the whole RDA community, as shown by the attendance at the P20 BoF and the number of RDA Groups that agreed to designate one of their co-chairs to ensure liaison with this IG. It is also of high interest for the Funders represented in the RDA and the member organisations.
In May 2023, the following RDA Groups designated a liaison with the IG:
- Sharing Rewards and Credit (SHARC) IG
- Data Policy Standardisation and Implementation IG
- Data Repository Attributes WG (DRAWG)
- Early Career and Engagement IG (ECEIG)
- Engaging Researchers with Data IG
- Research Funders and Stakeholders on Open Research and Data Management Policies and Practices IG
- Software Source Code IG
External initiatives with which the IG has established liaison (they are represented in the IG Stakeholder Forum):
Attendees can prepare by:
- Reflecting on their experiences with research and its evaluation
- Reviewing EoR-IG web page and case statement
- Reviewing notes and presentations from past meetings: P19 BoF, P20 BoF
- Identifying relevant liaisons which would be useful to establish and documents useful to share
Group chair serving as contact person: Francoise Genova
Type of Meeting: Working meeting
Brief introduction describing the activities and scope of the group:
The evolution of the evaluation of research from being mostly bibliographic index-based is now recognized to be indispensable to enable Open Science. In the same way that Open Science promotes the open sharing of FAIR data and other research outputs, evaluators must also value and consider these outputs as part of the wider research evaluation framework. The RDA is an appropriate forum for addressing the evolving requirements of research evaluation as they relate to Open Science practices. RDA’s reach across the international community, including research organisations and funders, can help to facilitate and align a global discussion of research evaluation, drawing on data experts from a range of domains.
The Interest Group “Evaluation of Research” organises the discussion on the subject in the RDA, in particular as it relates to data, and also in relation to RDA activities on research software. The initial topics for discussion identified for the IG are the following:
- Mapping of the RDA activities relevant to research evaluation/assessment;
- Gathering of links to relevant information, identifying relevant initiatives and determining how to engage with the initiatives and organisations that are most important to the group’s objectives and outcomes, in particular CoARA;
- Liaison with the developments linked to CoARA and other initiatives identified as relevant and important;
- Liaison with the relevant RDA Bodies, Interest Groups (IG) and Working Groups (WG);
- Identifying additional topics and other initiatives with which to establish connection;
- Act as an incubator for relevant RDA activities to be developed, in particular new WGs.
Short Group Status: The Interest Group was submitted in May 2023, and hope to be approved at the time of the Plenary.
Additional links to informative material:
- IG web page and case statement
- P19 BoF notes/presentations
- P20 BoF notes/presentations
- Additional links will be added before the meeting taking into account IG activities until then.
Avoid conflict with the following group (1): RDA for the Sustainable Development Goals IG
Avoid conflict with the following group (2): Global Open Research Commons IG
Meeting presenters: The meeting presenters are: IG co-chairs: Emma Crott, Francoise Genova, Devika Madalli and Amy Nurnberger, and leaders of current efforts