goals.md 13.9 KB
Newer Older
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
1
---
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
2
layout: default
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
3
4
5
title: Goals of the program
parent: Open WIN Ambassadors
has_children: false
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
6
nav_order: 1
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
7
8
9
10
11
12
13
14
15
16
---

# What are the goals of the Ambassador program?
{: .fs-9 }

Find out about why we are running the Ambassador program and what we hoe to achieve.
{: .fs-6 .fw-300 }

---

Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
* [Aims and objectives of the Ambassador programme](#aims-and-objectives-of-the-ambassador-programme)
  - [1. Growing our user base](#1-growing-our-user-base)
  - [2. Building capacity in open and collaborative leadership](#2-building-capacity-in-open-and-collaborative-leadership)
  - [3. Improving the transparency, reproducibility and integrity of our research](#3-improving-the-transparency,-reproducibility-and-integrity-of-our-research)
  - [4. Setting the agenda](#4-setting-the-agenda)
  - [5. Shaping culture](#5-shaping-culture)
* [Evaluation of the programme and your experience](#evaluation-of-the-programme-and-your-experience)
  - [Success against our objectives](#success-against-our-objectives)
  - [Delivery of the programme](#delivery-of-the-programme)
  - [Impact going forwards](#impact-going-forwards)

The Open WIN Ambassadors programme is an essential component in achieving the vision of the Open WIN Community:

> The Open WIN Community will empower WIN researchers to share all forms of research output, through the provision of training, skills development, and contribution to open science policy.

> We are working open as this is an effective way to develop a user focused and inclusive project which all members of our community can contribute to and benefit from.  

## Aims and objectives of the Ambassador programme

### 1. Growing our user base

Our overarching goal is to increase the number of users of our [sharing infrastructure](../../tools), so more people can share all stages of their research output, and receive appropriate credit for doing so. This will help is achieve the Open Neuroimaging Project goal of increasing the openness of our research, to facilitate discovery and accelerate the translation of methods and results to the clinic. b

One of the most effective ways of growing our user base is to capitalise on the skills, reach and influence of a select group of "power users", who can advocate for local change and represent the interests of their colleagues. These power users (our Ambassadors) will have the best understanding of what others needs to see, feel, and experience in their journey in order to successfully adopt an effective open science practice.

**As part of the programme we would like you to contribute to the documentation which will guide your colleagues though using the Open WIN infrastructure. These resources will become the go-to for new users, and some cases their stepping off point in their open science journey. We'd also like you to give a talk about open science or the Open WIN infrastructure to your lab, and think about what practices could be incorporated into your routine workflow.**

### 2. Building capacity in open and collaborative leadership

The Ambassador programme will create opportunities for our community to gain experience in open and inclusive leadership, project management, collaboration and community building. These skills an essential contributor to positive research culture, and opportunities to practice and reflect on these skills can have a significant impact on career trajectories.  

**Alongside individual career development, capacity building in open leadership will have a knock-on effect in the broader open science landscape within and outside of WIN. We expect our Ambassadors will go on to lead their own open projects, and become key contributors to open science communities and projects in our discipline.**

### 3. Improving the transparency, reproducibility and integrity of our research

As reported by the [Software Sustainability Institute](https://www.software.ac.uk/news/major-funding-boost-uks-open-research-agenda?mc_cid=0d68e9a951&mc_eid=8c2ea6a0db), "*The benefits of open research practices for improving the quality and integrity of research have been widely documented, and are recognised by the [UK Government R&D Roadmap](https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/896799/UK_Research_and_Development_Roadmap.pdf) as contributing to improving the culture of research*"

The Ambassadors will have access to a curated list seminars and workshops which will teach core skills in transparent and reproducible research for neuroimaging. This will arm them with the knowledge and expertise to include transparent and reproducible workflows in their own research

**By the end of the program we expect our Ambassadors to be experts in using the Open WIN tools, have used GitLab to publish training material, for which they will receive recognition for in perpetuity, and where possible have openly shared one of their own research outputs.**

### 4. Setting the agenda

One of the most difficult and unresolved problems in open science is how we appropriately incentivise good open science practice, and what policy (local or otherwise) we should have in place to support and reward open science. For example, should we include open science in professional development reviews? Should we explore open science "badges" on our work or profiles? How should we track engagement and growth in open science outputs? These topics all deserve careful consideration, not least because inappropriate use of metrics and "gaming the system" is a large contributor to many of the problems which open science seeks to address.

**As people who will be directly impacted by any policy introduced to incentivise or monitor open science activities at WIN, we would like the Open WIN Ambassadors to help devise, consult on and explore how we move forward to promote behaviour change.**


### 5. Shaping culture

In all our activities, we will aim to model a positive research culture. Following extensive survey of researchers across all career stages, The Wellcome Trust identified common themes in what researchers describe as [essential characteristics for a positive research culture](https://wellcome.org/sites/default/files/what-researchers-think-about-the-culture-they-work-in.pdf):

- diversity is encouraged and celebrated
- collaboration is encouraged and celebrated
- individual contributions feel valuable and valued
- individuals feel supported
- individuals feel safe and secure
- leadership is transparent and open
- time to think is valued.

We believe that in order to feel safe, secure and valued, we should cultivate an environment where the "whole person" is welcomed and respected. This recognises that we are more than just a "researcher", or "student", and it is the collection of our parts which makes us unique in our contributions and thinking. We have hopes, fears, passions, disagreements, strengths, weaknesses, relationships, responsibilities, pain, joys, sadness, laughter and complexities, and we cannot be expected to (always) separate these things from how we work. Recognising our individual diversity also enables us to be cognisant of our own biases and blind spots, and work to minimise the impact of them. Sharing ourselves as whole people, when we feel safe to do so, provides space for us all to support, accommodate and celebrate together.

**You will be expected to participate with the intention to embody a positive research culture, where we are respectful and supportive of each other as whole people. You will be expected to interact with honesty, humility and compassion towards yourself and others at all  times.**


## Evaluation of the programme and your experience

As this is a pilot programme, we intend to closely follow your experience and see how well we are meeting our aims and objectives above. We also interested to know how effective the programme has been in meeting your needs and expectations, how it could be improved and the impact you think it will have going forwards.

### Success against our objectives

We will take a baseline measure of your open science activities at the start, and revisit this as the programme draws to a close. Success against our objectives will be operationalised as an increase from baseline in the proportion of "yes" answers to the below questions from our Ambassadors:

1. Have you created and published some documentation on an Open WIN tool?
2. Have you started a new open/community project or contributed to an existing one (internal to WIN or an external project)?
3. Have you used our infrastructure for one of your research outputs?
4. Have you done another open science thing, e.g. preprint/pre-reg?
5. Have you given a talk about OS to your lab?
6. Has your lab incorporated any open science practice into your "routine work flow"?
7. Has someone come to you with a question about open science? Were you able to answer it or did you know where to get support?
8. Have you contributed to WIN  Open Science policy?

### Delivery of the programme

At the end of each training session and the end of the programme, we would like your feedback on what has worked well and what could be improved:

1. What worked well?
2. What surprised you?
3. What would you change?
4. What would you like to know more about?

### Impact going forwards

At the close of the programme, we will collect feedback on your predicted long-term impact of the course, including our attempts to embody a positive research culture.

1. What (if any) part of the programme has had the greatest impact on your research practice?
2. What (if any) part of the programme has impacted your career development?
3. What (if any) opportunities would you like to be available to continue your engagement with the Open WIN Community?

#### Culture

1. Do you feel as though diversity was encouraged and celebrated?
2. Do you feel as though collaboration was encouraged and celebrated?
3. Did individual contributions feel valuable and valued?
4. Did you feel supported?
5. Did you feel safe and secure?
6. Was leadership transparent and open?
7. Was time to think is valued?
8. Did you feel welcomed and respected as a whole person?



<!--

Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184





We have specific goals for engagement which are driven by the project metrics which communicated to the [External Advisory Board (EAB)](https://sharepoint.nexus.ox.ac.uk/sites/NDCN/FMRIB/Shared%20Documents/EAB_TOR.pdf#search=external%20review%20board) who are tasked with providing "an external and independent view on plans and progress" of WIN. <mark> Can the 2018 EAB report be shared on intranet too? - yes. </mark>.

We also have a goal to show a year-on-year growth in understanding and engagement with open research practices, as measured by the [WIN 2019 Open Science Survey](https://sharepoint.nexus.ox.ac.uk/sites/NDCN/FMRIB/SitePages/WIN%20Survey%20Results%202019.aspx) and the

Based on these combined drivers, our initial goals are to:

## Demonstrate infrastructure engagement

Open Data
- Number of WIN researchers with database accounts
- Percentage of WIN researchers actively using the database
- Number of scans in the database
- Number of studies in the database
- Number of studies shared across WIN
- Number of studies shared externally
- Number of external requests to access studies


Open Paradigms
- Number of paradigms published on the website, potentially number of visits to the site
- Uplift in supporting documentation standards <mark>Added by CGVP. Much of the paradigms repo is pretty near unusable as so little documentation.</mark>

Open Protocols
- Number of protocols openly published in database
- Number of visits to the database and number of downloads
- Number of citations/acknowledgements of protocols used from the database

Open Tools
- Number of FSL tools that have singularity outputs
- Number of downloads of tools with singularity outputs
- Number of publications using singularity outputs
- Number of BIDS meetings attended

Open Community
<mark>TBC and consider more</mark>
- Number of Ambassadors
- Number of users on mailing lists and number of messages <mark>Can we look back at this historically?</mark>
- Number of users (active and inactive) on slack
- Number of contributors to this repository
- Number of enquires (and responses) made to Ambassadors
- Number of attendees at hack-day
- Feedback from hack-day

## Improve awareness and experience with open research practices
- Increase in the number of open access papers immediately available
- Improve awareness of open research practices, particularly registered reports and open educational materials.
- Encourage the community to share pre-prints of their papers.


Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
185
![OS-Survey 2019 slide 3](../../img/open-science-survey-results/Slide3.png)
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
186
187
188

- Appreciate the value of open science practices in career development

Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
189
![OS-Survey 2019 slide 4](../../img/open-science-survey-results/Slide4.png)
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
190
191

- Appreciate the value of open sharing of code.
192
- Encourage the community to realise the value of sharing data within the current limits of our [open data policy](OpenData.md), and equip them with the tools and knowledge to do so.
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
193

Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
194
![OS-Survey 2019 slide 5](../../img/open-science-survey-results/Slide5.png)
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
195
196
197
198
199

## Reduce barriers to engaging in open research practices

- Devise and promote positive incentives for open research within WIN.
- Clarify and communicate legal and ethical obligations fo data sharing.
200
- Promote and train the community to use the newly developed WIN Open Infrastructure for sharing [data](OpenData.md), [experimental paradigms](OpenParadigms.md), [acquisition protocols](OpenProtocols.md) and [analysis tools](OpenTools.md)
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
201

Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
202
![OS-Survey 2019 slide 6](../../img/open-science-survey-results/Slide6.png)
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
203

Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
204
![OS-Survey 2019 slide 7](../../img/open-science-survey-results/Slide7.png)
Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
205
206
207
208
209

## Create and share documentation
- Empower the community to learn together as we explore these topics, and share their knowledge on this repository <mark>update when moved</mark> in the form of written documentation.
- Hold in-person and online training workshops and "hacks" where we can learn together and create documentation.

Cassandra Gould van Praag's avatar
Cassandra Gould van Praag committed
210
![OS-Survey 2019 slide 8](../../img/open-science-survey-results/Slide8.png) -->