This approach uses the strong advantages a Delhi study has, identifies the disadvantages of traditional Delphi techniques and aims to introduce and evaluate a modified approach called 360-Degree Delphi. Key aspects of 360-Degree Delphi are tested by applying the approach to the needs and requirements analysis of a system for managing patients’ advance directives and living wills. 360-Degree Delphi, as a modified Delphi process, is specified as a structured workflow with the optional use of stakeholder groups. Consensus is created within individual stakeholder groups, but is also communicated between groups, while the iterative structure of the Delphi process remains unchanged. We hypothesize that (1) 360-Degree Delphi yields complementary statements from different stakeholders, which would be lost in classical Delphi; while (2) the variation of statements within individual stakeholder groups is lower than within the total collective. A user study is performed that addresses five stakeholder groups (patients, relatives, medical doctors, nurses and software developers) on the topic of living will communication in an emergency context. About 25% of the invited experts (stakeholders) agreed to take part in the Delphi round 0 (three patients, two relatives, three medical doctors, two qualified nurses and three developers), forming a structured panel of the five stakeholder groups. Two raters created a bottom-up coding, and 238 thematic codes were identified by the qualitative text analysis. Based on a consented coding list, a quantitative online-questionnaire was developed and send to different stakeholder groups. With respect to the hypotheses, Delphi round 0 had the following results: (1) doctors had a completely different focus from all the other stakeholder groups on possible channels of communications with the patient; (2) the dispersion of codes within individual stakeholder groups and within the total collective was approximately 28% higher in the total collective than in the sub-collectives, but without a marked effect size. With respect to the hypotheses, Delphi round 1 had the following results: different stakeholder groups had highly diverging opinions with respect to central questions on IT-development. In comparison, the total group would not be representative of either of these individual stakeholder needs (mean 4.344, stdev +/- 1.870)

Figure 1

Figure 2

Figure 3

Figure 4
This is a list of supplementary files associated with this preprint. Click to download.
Loading...
Posted 16 Mar, 2020
On 11 Mar, 2020
On 10 Mar, 2020
On 04 Mar, 2020
Received 29 Feb, 2020
Received 25 Feb, 2020
On 16 Feb, 2020
Invitations sent on 10 Feb, 2020
On 10 Feb, 2020
On 24 Jan, 2020
On 23 Jan, 2020
On 23 Jan, 2020
On 20 Nov, 2019
Received 22 Oct, 2019
On 07 Oct, 2019
On 06 Oct, 2019
Received 06 Oct, 2019
Invitations sent on 31 Jul, 2019
On 23 Jul, 2019
On 18 Jul, 2019
On 18 Jul, 2019
On 17 Jul, 2019
Posted 16 Mar, 2020
On 11 Mar, 2020
On 10 Mar, 2020
On 04 Mar, 2020
Received 29 Feb, 2020
Received 25 Feb, 2020
On 16 Feb, 2020
Invitations sent on 10 Feb, 2020
On 10 Feb, 2020
On 24 Jan, 2020
On 23 Jan, 2020
On 23 Jan, 2020
On 20 Nov, 2019
Received 22 Oct, 2019
On 07 Oct, 2019
On 06 Oct, 2019
Received 06 Oct, 2019
Invitations sent on 31 Jul, 2019
On 23 Jul, 2019
On 18 Jul, 2019
On 18 Jul, 2019
On 17 Jul, 2019
This approach uses the strong advantages a Delhi study has, identifies the disadvantages of traditional Delphi techniques and aims to introduce and evaluate a modified approach called 360-Degree Delphi. Key aspects of 360-Degree Delphi are tested by applying the approach to the needs and requirements analysis of a system for managing patients’ advance directives and living wills. 360-Degree Delphi, as a modified Delphi process, is specified as a structured workflow with the optional use of stakeholder groups. Consensus is created within individual stakeholder groups, but is also communicated between groups, while the iterative structure of the Delphi process remains unchanged. We hypothesize that (1) 360-Degree Delphi yields complementary statements from different stakeholders, which would be lost in classical Delphi; while (2) the variation of statements within individual stakeholder groups is lower than within the total collective. A user study is performed that addresses five stakeholder groups (patients, relatives, medical doctors, nurses and software developers) on the topic of living will communication in an emergency context. About 25% of the invited experts (stakeholders) agreed to take part in the Delphi round 0 (three patients, two relatives, three medical doctors, two qualified nurses and three developers), forming a structured panel of the five stakeholder groups. Two raters created a bottom-up coding, and 238 thematic codes were identified by the qualitative text analysis. Based on a consented coding list, a quantitative online-questionnaire was developed and send to different stakeholder groups. With respect to the hypotheses, Delphi round 0 had the following results: (1) doctors had a completely different focus from all the other stakeholder groups on possible channels of communications with the patient; (2) the dispersion of codes within individual stakeholder groups and within the total collective was approximately 28% higher in the total collective than in the sub-collectives, but without a marked effect size. With respect to the hypotheses, Delphi round 1 had the following results: different stakeholder groups had highly diverging opinions with respect to central questions on IT-development. In comparison, the total group would not be representative of either of these individual stakeholder needs (mean 4.344, stdev +/- 1.870)

Figure 1

Figure 2

Figure 3

Figure 4
This is a list of supplementary files associated with this preprint. Click to download.
Loading...