Researcher Assessment
FMI's Recommendations on Integrating Openness in Science and Research into Recruitment and Career Development Assessment
The Finnish Meteorological Institute (FMI) highly values and encourages the promotion of openness in science, research, and educational outreach. To foster a culture of collaboration, transparency, and innovation within our organization, and to contribute to the global advancement of sciences, we recommend considering openness in assessments related to recruitment and career development. In this context, FMI follows the national, European and international (1, 2 3) guidelines, recommendations and declarations.
Principles of Openness
FMI acknowledges the following principles of openness in science, research, and educational outreach:
Open Access FMI recognizes that the accessibility of scientific knowledge is crucial for the advancement of research and societal progress. Researchers and educators are encouraged to publish their findings in open access journals or platforms, ensuring that their work is freely available to the global community. By making research outcomes accessible, FMI aims to increase the visibility of its contributions and facilitate the exchange of ideas across disciplinary boundaries. (see the Open Access policy at FMI)
Open/FAIR Data The institute understands that research data forms the foundation of scientific inquiry and innovation. FMI promotes the open sharing of research data whenever possible, allowing for greater scrutiny, verification, and collaboration among peers. This approach not only enhances the reliability of research findings but also enables other researchers to build upon existing work, accelerating scientific discovery. (see the Open Research Data policy at FMI)
Open-source software FMI supports the development and use of open-source software in research, fostering collaboration, transparency, and innovation within the scientific community.
Open Collaboration FMI values the significance of collaborative efforts in driving scientific breakthroughs. The institute actively encourages its researchers to engage in collaborative projects that emphasize openness and transparency. By participating in cross-institutional and international collaborations, FMI aims to leverage the collective expertise of researchers worldwide and tackle complex challenges that transcend geographical boundaries.
Open Educational FMI recognizes its role in nurturing the next generation of scientists and promoting public understanding of science. When developing open educational resources, the institute promotes their accessibility to students, teachers, and the general public.
Integration in Assessment
Recruitment When evaluating candidates for recruitment, FMI recommends considering their alignment with the principles of openness. Candidates who demonstrate a history of contributing to open-access publications, sharing research data openly, collaborating on open projects, and engaging in educational outreach activities can be given favorable consideration. This ensures that new hires share the institute's commitment to transparency and collaboration.
Researcher assessment Recognition and rewards can be given to researchers who actively embrace open-access publishing, participate in data sharing initiatives, contribute to collaborative projects, and engage in educational outreach. We acknowledge that career trajectories are flexible, and evaluations should accommodate changes in focus when well-justified.
Evaluation Criteria
Evaluation criteria may include:
Open Access Publications: percentage of a researcher’s publications that are published in open access journals or platforms. The quality and impact of open-access publications will be assessed, taking into account the significance of making research findings freely accessible to the scientific community and the public. Candidates and employees who prioritize open-access publishing can be acknowledged for their contribution to the dissemination of knowledge.
Preprint deposit: the number of preprints uploaded to preprint servers. Preprints indicate a researcher's willingness to share preliminary findings openly before formal peer review.
Citations in Open Publications: Evaluate the number of citations received by a researcher's work in open-access publications. This demonstrates the impact of their research within the open science community.
Open Data Sharing: the number of datasets shared openly. FMI can evaluate the extent to which candidates and employees share research data openly and adhere to data-sharing standards. This evaluation reflects the institute's commitment to data transparency, reproducibility, and the advancement of scientific inquiry.
Data Citation Index: Track the instances where a researcher's datasets have been cited by others, indicating the usability and impact of the shared data.
Participation in Open Peer Review: Evaluate participation in open peer review processes where reviews and responses are shared publicly. This showcases engagement in transparent and collaborative peer review practices.
Contribution to Open Source Software: Measure the involvement in open source software development related to the research field. This highlights contributions to open science beyond traditional research outputs.
Reproducibility Score: Assess the extent to which a researcher's work is reproducible based on the availability of code, scripts, and documentation to replicate the results.
Collaborative Projects: The institute can consider the level of engagement in collaborative projects that emphasize open practices and cross-disciplinary cooperation. Active participation in such initiatives demonstrates a dedication to leveraging collective expertise for the betterment of science.
Public Engagement, Science Communication, and Educational Outreach: the number of talks, workshops, or articles (etc.)written for a general audience, which contribute to open science by disseminating research to a wider audience. FMI can recognize individuals who contribute to the creation of open educational resources, engage in science communication activities, and participate in educational outreach efforts. This recognition reflects the institute's commitment to educating the public and nurturing a scientifically informed society.
Exceptions to the policy
FMI acknowledges that exceptions to the policy exist. These exceptions have been identified to accommodate specific situations where adherence to full open practices may be challenging or impractical. The following are examples of situations in which exceptions to the policy may apply:
Sensitive Data: In cases where research involves sensitive or confidential data that cannot be openly shared due to legal, ethical, or security reasons, individuals may be exempted from the requirement to openly share such data.
Field-Specific Practices: Certain disciplines or fields of study might have established practices that do not align perfectly with the principles of openness. In such cases, a balanced approach considering the norms of the field and the feasibility of open practices may be considered. (to be applied for cross-domain projects)
Early-Career Researchers: Recognizing that early-career researchers might face unique challenges in adopting open practices, allowances could be made for individuals who are gradually transitioning into more open approaches as they gain experience and resources.
Collaborative Agreements: When collaborative projects involve partners who have restrictions on open practices due to their own policies or regulations, a case-by-case assessment may be conducted to determine the extent to which openness can be accommodated.
Educational Constraints: In educational outreach, some teaching materials might be restricted by other institutions or agreements. Such constraints might require the adaptation of open practices without compromising educational integrity.
Resource Limitations: Instances where resource limitations hinder the ability to fully adhere to open practices could warrant exceptions, especially if individuals are making reasonable efforts to overcome these limitations.
Individual Circumstances: Certain individual circumstances, such as health issues or personal challenges, might warrant temporary exceptions to open practices while still upholding the spirit of the policy.
Reporting and Continuous Improvement
FMI is committed to regularly assessing the impact of these recommendations. The institute will gather feedback from staff members, track the adoption of open practices, and evaluate the overall progress toward promoting openness in science, research, and educational outreach.