WP6 Year 3: implementation & evaluation

Semi-annual update: March – August 2018

The MinD evaluation workplan was refined in the hosted secondments in the UK (V22, May) and Luxembourg (V23, June).

A model for supporting evaluation in three areas was previously devised. The AIR model considers the impact of design on 3 areas: Activities, Internal World and Relationships of the person living with dementia.

In the UK secondment the process proceeded by discussion of evaluation approaches, leading on from the earlier Soft Evaluation workshop. Evaluation is linked to the user populations of the member sites and to the Patient and Public Involvement activity.

Formative evaluation of the Social Engagement Map

In the UK secondment an opportunity for people with lived experience to try out and feedback option on a table-top mockup of the Social Engagement Map (SEM) on an LCD screen, including function and layout. This was facilitated during the main PPI session. Participants were asked to provide a photo of themselves in advance of the PPI session to be used in the mock up. The session enabled participants to comment on ease of use, aesthetics and suggestions for improvement. Users were delighted when they were able to identify their own faces and interests floating across the screen and imagine how this would enable future potential connections and shared activities. The ‘tangibles’ (hand‐held objects) were of particular interest with variation in preference for weight, size and shape. Many useful comments and suggestions were recorded through a brief questionnaire, the results of which were presented in the second week of the UK secondment and developed into a specification and guidelines for the next design iteration.

Mock-up of social engagement map Mock-up of social engagement map

Evaluation Framework

A framework for the ongoing and summative evaluation of the designs was developed in Luxembourg. We will focus on using the AIR model for use in ongoing formative and summative evaluation of the design prototypes to assess their potential for change from the perspectives of (depending on location and setting) a) people with dementia, b) carers or c) clinical staff in different roles, through small focus groups. A template for the evaluation question will be developed at the next secondment in the Netherlands. The intention is to present prototypes to users in the four countries and user populations from which needs were originally determined: Germany, Netherlands, UK and Spain.

In addition to the evaluation of designs, an evaluation of the design process is also being conducted. At the Luxembourg secondment a paper was presented reflecting on the use of design probes. We also intend to evaluate the PPI process of MinD since the involvement experience has been captured in detail in the UK workshops.