Research Article - (2015) Volume 1, Issue 1
Background: Participation in cognitive and physical activities may help to maintain health and wellbeing in older people. The Agewell study explored the feasibility of increasing cognitive and physical activity in older people through a goal-setting approach. This paper describes the findings of the cost-effectiveness analysis.
Method: Individuals over the age of 50 and attending an Agewell centre in North Wales were randomised to one of three conditions: control (IC), goal-setting (GS), or goal-setting with mentoring (GM). We undertook a cost-effectiveness analysis comparing GS vs. IC, GM vs. IC and GM vs. GS. The primary outcome measure for this analysis was the QALY, calculated using the EQ-5D. Participants’ health and social care contacts were recorded and costed using national unit costs.
Results: Seventy participants were followed-up at 12 months. Intervention set up and delivery costs were £252 per participant in the GS arm and £269 per participant in the GM arm. Mean health and social care costs over 12 months were £1,240 (s.d. £3,496) per participant in the IC arm, £1,259 (s.d. £3,826) per participant in the GS arm and £1,164 (s.d. £2,312) per participant in the GM arm. At a willingness to pay threshold of £20,000 per QALY there was a 65% probability that GS was cost-effective compared to IC (ICER of £1,070). However, there was only a 41% probability that GM was cost-effective compared to IC (ICER of £2,830) at a threshold of £20,000 per QALY.
Conclusion: Setting up and running the community based intervention was feasible. Due to the small sample size it is not possible to draw a firm conclusion about cost-effectiveness; however, our preliminary results suggest that goalsetting is likely to be cost-effective compared to the control condition of no goal-setting, the addition of mentoring was effective but not cost-effective.
Keywords: Cost; Ageing; Goal-setting; Active
Life expectancy in the United Kingdom has increased over time and more people are living longer [1]. Older people are at risk of social isolation, which is associated with higher rates of depression and unmet health care needs [2,3]. Zaninotto et al. determined that quality of life was higher in older people who had an absence of depression, absence of limiting illnesses, were in the richest quintile of wealth, were in employment, were cohabiting and were in the 80th percentile for a positive social network [4]. A review of health promotion strategies to prevent social isolation in older people found key determinants to consider when addressing social isolation were income and social status, personal health practices and coping skills and social support networks [5]. As well as affecting quality of life negatively, social isolation in older people is also believed to influence cognitive decline [6]. Alongside social engagement, participating in cognitive and physical activities may contribute to dementia prevention and risk reduction, thus there is a need to identify ways to promote and increase cognitive and physical activity in older people within a context of social participation [7]. A recent review of interventions aiming to increase physical activity in older people concluded that individually tailored interventions with defined personal goals may be more effective, however the review did not establish the evidence base for the costeffectiveness of physical activity interventions [8]. This paper describes the cost of setting up and delivering the Agewell community-based goal-setting intervention to increase activity in older people, along with cost-effectiveness findings. Effectiveness findings are published in Clare et al. [9].
Study design
Full details of the Agewell study protocol are published as Clare et al. [10]. Agewell was a pilot randomised trial aiming to assess the effect of three different types of interview on subsequent behaviour change. The three arms of the pilot trial were a control condition (IC), a goalsetting condition (GS) and a goal-setting with mentoring condition (GM). Assessments were carried out by blinded researchers at baseline and twelve months. Randomisation was conducted by the North Wales Organisation for Randomised Trials in Health (NWORTH) using a dynamic adaptive computer algorithm. Randomisation was stratified by gender and married couples were randomised together to the same study arm to avoid cross-contamination. The AgeWell study was approved by the School of Psychology Research Ethics Committee at Bangor University.
Study population
Individuals aged 50 years and over living in Nefyn, Gwynedd (North Wales) and attending the Nefyn Agewell Centre were invited to participate. No exclusion criteria were placed on individuals. Individuals attending the centre who did not wish to participate in the study were able to attend the centre as usual.
Setting
The intervention was conducted in partnership with Age Cymru Gwynedd a Môn (ACGM). ACGM runs the Agewell Centre in Nefyn, Gwynedd, which was set up as part of the research project. The Agewell Centre is based in the village community centre and led by an AGCM co-ordinator, supported by a volunteer management group of centre attendees. The centre is open three days a week to provide social contact and a range of meaningful and enjoyable activities for over 50s. The program included a range of classes: exercise, computer, history and cookery. A range of other activities were also available inducing arts and crafts, bowling, Nordic walking, theatre trips, and photography.
Intervention
Participants randomised to the IC arm received an interview consisting of a general discussion about the centre facilities. Participants randomised to the GS arm received a structured goal-setting interview. Participants randomised to the GM arm received a structured goalsetting interview supplemented by five mentoring telephone calls over the course of the one-year follow-up period.
Outcome measures for cost-effectiveness analysis
A comprehensive list of outcome measures used in the Agewell study is available in the published protocol [10]. The primary outcome measure for the cost-effectiveness analysis was the quality-adjusted life year (QALY), calculated using the EQ-5D. The EQ-5D is a generic, preference based instrument for measuring health-related quality of life [11]. A scoring algorithm was used to convert responses into an index value of between -0.59 and 1, with 1 representing best possible health- related quality of life [12].
Measurement of intervention costs
The intervention was conducted at the Agewell centre, with centre set-up costs annuitized over 3 years. Staff time developing the intervention was classed as a set-up cost, and annuitized over 3 years. Staff time delivering the initial interviews in all three conditions, and conducting on-going mentoring phone calls in the goal-setting with mentoring condition, was costed. It was not necessary to discount intervention costs as the follow-up period was one year.
Measurement of health and social care costs
An adapted Client Service Receipt Inventory (CSRI) [13] was used to record participants’ contacts with primary and secondary health and social care services. National unit costs for the price year 2011-2012 were assigned to services accessed, to calculate a mean total cost per participant [14,15]. Service use costs were not discounted as the followup period was one year.
Economic evaluation
We undertook a cost-effectiveness analysis comparing GS vs IC, GM vs IC and GM vs GS. A public sector, multi-agency perspective was adopted for the economic evaluation. Cost-effectiveness analysis was conducted in line with MRC guidelines for the evaluation of complex interventions [16], and with our standard operating p rocedure for economic evaluations alongside randomised controlled trials [17]. The base case analysis was an intention-to-treat cost-utility analysis using the QALY. Non-parametric bootstrapping with 1000 replications [18] was used to address the uncertainty associated with point estimates of cost effectiveness ratios. To explore whether the results were robust to our assumptions, a sensitivity analysis was conducted to test the potential effect of the goal-setting interviews and mentoring being delivered by an ACGM staff member on an annual salary of £12,150.
Seventy-five participants were randomised into the three conditions. At the 12 month follow-up, 70 participants completed measures for both the clinical-effectiveness and cost-effectiveness analysis (IC n=27, GS n=21, GM n=22), a retention rate of 93%.
Baseline data
Normality tests on baseline data indicated that the EQ-5D and cost data were not normally distributed, so the non-parametric Kruskal-Wallis test was used to test for significant differences between conditions. No significant differences existed at baseline (p=0.193 for costs, p=0.905 for EQ-5D;), so follow-up data used in the economic analysis were not adjusted for baseline values (Table 1).
IC (n=27) Mean (s.d.) | GS (n=24) Mean (s.d.) | GM (n=24) Mean (s.d.) | |
---|---|---|---|
Gender: Female (n, %) | 23 (85.2%) | 23 (95.8%) | 19 (79.2%) |
Age | 70.22 (7.77) | 67.50 (7.66) | 66.67 (8.19) |
Years of education | 12.70 (2.91) | 13.79 (3.18) | 13.58 (2.68) |
Living situation: living with others | 15 (55.6%) | 16 (66.7%) | 18 (75.0%) |
Social capital: good | 8 (29.6%) | 9 (37.5%) | 8 (33.3%) |
Social capital: poor | 19 (70.4%) | 15 (62.5%) | 16 (66.7%) |
Material deprivation: none | 10 (37.0%) | 7 (29.2%) | 2 (8.3%) |
Material deprivation: moderate | 12 (44.4%) | 13 (54.2%) | 15 (62.5%) |
Material deprivation: high | 5 (18.5%) | 4 (16.7%) | 7 (29.2%) |
EQ-5D index value | 0.899 (0.141) | 0.891 (0.133) | 0.862 (0.227) |
Subjective health: poor/very poor | 0 | 0 | 2 (8.3%) |
Subjective health: not too good | 4 (14.8%) | 3 (12.5%) | 0 |
Subjective health: good/very good | 23 (85.2%) | 21 (87.5%) | 22 (91.7%) |
Health and social care contact cost for the 3 months before baseline | £255.84 (£374.78) | £169.96 (£250.47) | £370.96 (£1,406.69) |
Note: IC: Control, GS: Goal-Setting, GM: Goal-Setting With Mentoring.
Table 1: Baseline characteristics for the full sample.
Mean EQ-5D index scores at baseline were between 0.862 and 0.899. The UK population norm for this age group is 0.78 (s.d. 0.26) [19], indicating that Agewell participants had comparable health to the general population.
Health and social care use over the study period
Table 2 shows health and social care contacts occurring between baseline and 12 month follow-up for the 70 participants who were assessed at both time-points. The mean cost per participant for health and social care contacts was £1,240.23 (s.d. £3,495.88) in the control condition, £1,258.66 (s.d. £3,825.71) in the goal-setting condition and £1,163.89 (s.d. £2,312.49) in the goal-setting with mentoring condition. The difference in costs between conditions was not significant (p=0.806) (Table 2).
Control (n=27) | Goal-setting (n=21) | Goal-setting with mentoring (n=22) | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
N (%) | Total contacts | Total cost | Mean cost per participant (SD) | N (%) | Total contacts | Total cost | Mean cost per participant (SD) | N (%) | Total contacts | Total cost | Mean cost per participant (SD) | |
General practitioner | 24 (88.9%) | 108 | £7,388 | £273.63 (£355.30) | 17 (81.0%) | 63 | £4,073 | £193.95 (£132.61) | 19 (86.4%) | 48 | £3,024 | £137.45 (£107.61) |
Practice nurse | 25 (92.6%) | 58 | £812 | £30.07 (£28.72) | 19 (90.5%) | 77 | £1,078 | £51.33 (£75.57) | 15 (68.2%) | 43 | £602 | £27.36 (£40.64) |
District nurse | 2 (7.4%) | 4 | £244 | £9.04 (£35.61) | 1 (4.8%) | 4 | £280 | £13.33 (£61.10) | 3 (13.6%) | 9 | £618 | £28.09 (£104.88) |
Counsellor | 0 | 0 | 0 | 0 | 1 (4.8%) | 1 | £60 | £2.86 (£13.09) | 0 | 0 | 0 | 0 |
Physiotherapist | 6 (22.2%) | 47 | £1,551 | £57.44 (£150.28) | 4 (19.0%) | 24 | £792 | £37.71 (£84.32) | 5 (22.7%) | 60 | £1,980 | £90.00 (£243.18) |
Occupational health therapist | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 (4.5%) | 1 | £33 | £1.50 (£7.04) |
Chiropodist | 7 (25.9%) | 21 | £630 | £23.33 (£43.50) | 4 (19.0%) | 19 | £570 | £27.14 (£81.56) | 2 (9.1%) | 12 | £360 | £16.36 (£59.80) |
Dietician | 2 (7.4%) | 8 | £272 | £10.07 (£46.02) | 1 (4.8%) | 8 | £272 | £12.95 (£59.36) | 0 | 0 | 0 | 0 |
Dentist | 1 (3.7%) | 2 | £50 | £1.85 (£9.62) | 3 (14.3%) | 5 | £125 | £5.95 (£15.62) | 1 (4.5%) | 1 | £25 | £1.14 (£5.33) |
Optician | 1 (3.7%) | 1 | £21 | £0.78 (£4.04) | 0 | 0 | 0 | 0 | 3 (13.6%) | 3 | £63 | £2.86 (£7.38) |
Alternative therapist | 2 (7.4%) | 3 | £51 | £1.89 (£7.20) | 0 | 0 | 0 | 0 | 1 (4.5%) | 8 | £136 | £6.18 (£29.00) |
Gynaecology nurse | 0 | 0 | 0 | 0 | 1 (4.8%) | 3 | £243 | £11.57 (£53.03) | 0 | 0 | 0 | 0 |
Total community service use | - | 252 | £11,019 | £408.11 (£417.60) | - | 204 | £7,493 | £356.81 (£357.75) | - | 185 | £6,841 | £310.95 (£372.37) |
Outpatient service | 14 (51.9%) | 48 | £5,088 | £188.44 (£279.42) | 10 (47.6%) | 20 | £2,120 | £100.95 (£131.87) | 12 (54.5%) | 17 | £1,802 | £81.91 (£103.09) |
Inpatient nights | 3 (11.1%) | 28 | £17,379 | £643.67 (£3,032.70) | 1 (4.8%) | 21 | £16,728 | £796.56 (£3,650.30) | 4 (18.2%) | 14 | £16,872 | £766.89 (£2,024.62) |
Accident and Emergency | 0 | 0 | 0 | 0 | 1 (4.8%) | 1 | £91 | £4.33 (£19.86) | 1 (4.5%) | 1 | £91 | £4.14 (£19.40) |
Total hospital use | - | - | £22,467 | £832.12 (£3,159.32) | - | - | £18,939 | £901.85 (£3,725.00) | - | - | £18,765 | £852.94 (£2,093.18) |
TOTAL | - | - | £33,486 | £1,240.23 (£3,495.88) | - | - | £26,432 | £1,258.66 (£3,825.71) | - | - | £25,606 | £1,163.89 (£2,312.49) |
Table 2: Health and social care contacts in the 12 months following baseline.
Other activities
Data on activities undertaken by participants outside of the Agewell centre during the study period were collected. This service use was low; 2 participants were enrolled on the local authority funded patient referral physical activity scheme and 1 participant was undertaking an unspecified local authority funded activity. These activities were not included in the cost analysis.
Intervention costs
Table 3 summarises the cost of setting up and running the Agewell centre and setting up and delivering the intervention. The costs of setting up the Agewell centre were annuitized over 3 years and included an ACGM development officer employed at 50% FTE, equipment costs, volunteer training, administration, promotion and recruitment costs. Based on attendance figures from the study period we estimated that up to 600 people would attend the centre during a 3 year time frame; thus we divided the total cost by 600 to estimate the cost per person. Centre running costs included staff costs, rent and administration costs e.g. utility bills.
Total cost, annuitized over 3 years | Cost per person | |
---|---|---|
One-off centre set-up cost | £11,600.14 | £19.331 |
Annual cost of running the centre | £38,122.44 | £190.612 |
Intervention development and set-up cost | £862.62 | £11.503 |
60 minute control interview cost per person- IC arm | - | £20.32 |
90 minute goal-setting interview cost per person- GS arm | - | £30.48 |
90 minute goal-setting interview and mentoring cost per person- GM arm | - | £47.41 |
Total cost per participant, including centre and intervention costs | ||
IC arm | £241.77 | |
GS arm | £251.93 | |
GM arm | £268.86 |
IC: Control, GS: Goal-Setting, GM: Goal-Setting With Mentoring
1Based on up to 600 people attending over 3 years
2Based on up to 200 people attending per year
3Based on the 75 participants randomised in the study
Table 3: Costs of setting up and running the centre and intervention.
Developing the intervention took 65 h. Training staff to deliver the interviews (both control and goal-setting) took 10 h. In the intervention delivery, the baseline interview was conducted by a trained researcher. The average length of interviews for participants in the control condition was 60 min. The average length of interviews for participants in the intervention conditions (GS, GM) was 90 min. Participants in the GM condition received an average of 5 mentoring phone calls, lasting approximately 10 min per call (Table 3).
Cost to participants
Centre attendees were asked for a financial contribution to cover the cost of hiring external facilitators, regardless of whether they were trial participants or not. Each attendee paid £2.50 per session for activities such as tai chi, line dancing, ballroom dancing, calligraphy, choir, pottery, exercise class and Nordic walking. The cost of healthy eating and arts classes was slightly lower at £2.00 per person. During the study period, trial participants paid a mean of £59.55 per person for session fees (s.d. £77.32, range £0-£272.50).
Cost-effectiveness analysis
The mean costs (including intervention costs) and QALYs accrued between baseline and 12 months for each trial arm are shown in Table 4. In this pilot study a small incremental QALY gain was seen between GS and IC, and the incremental cost-effectiveness ratio (ICER) between conditions was £1,070 (Table 4).
IC (n=27) | GS (n=21) | GM (n=22) | |
---|---|---|---|
Mean (s.d.) cost | £1,482.00 (£3,495.88) | £1,510.59 (£3,825.71) | £1,432.75 (£2,312.49) |
Mean (s.d.) QALY | 0.8464 (0.1849) | 0.8731 (0.1670) | 0.8290 (0.2442) |
GS v IC (95% CI) | GM v IC (95% CI) | GM v GS (95% CI) | |
Incremental cost | £28.58 (-£2,045.86 to £1,957.86) | -£49.25 (-£1,728.65 to £1,528.18) | -£77.83 (-£2,150.62 to £1,540.99 ) |
Incremental QALY | 0.0267 (-0.078 to 0.127) | -0.0174 (-0.156 to 0.092) | -0.0441 (-0.163 to 0.077) |
ICER | £1,070 | £2,830 | £1,765 |
Probability of cost-effectiveness at £20,000 per QALY | 65% | 41% | 36% |
Probability of cost-effectiveness at £30,000 per QALY | 68% | 44% | 33% |
Note: GS: Goal-Setting, GM: Goal-Setting with Mentoring, IC: Control
Table 4: Incremental costs and QALYs between conditions at 12 months.
Figure 1 shows the cost-effectiveness planes for the GS and GM conditions compared to the control condition. The majority of plots in the GS cost-effectiveness plane fall in the East of the figure, suggesting that GS is more effective than the control condition. More plots fall in the West of the cost-effectiveness plane for GM compared to control (Figure 1).
Cost-effectiveness acceptability curves indicate the probability that an intervention is cost-effective at a range of willingness to pay thresholds. The cost-effectiveness acceptability curve in Figure 2 indicates a 65% probability that GS was cost-effective compared to the control condition at the NICE threshold of £20,000 per QALY [20]. However, the cost-effectiveness acceptability curve for GM compared to control indicated only a 41% probability of being cost-effective compared to the control condition at a threshold of £20,000 per QALY. Comparing GM to GS, there was a 36% probability that GM was costeffective at a threshold of £20,000 per QALY (Figure 2).
Sensitivity analysis
In the base case analysis, the goal-setting interviews and mentoring calls were conducted by a researcher on an annual salary of approximately £33,000. We conducted a sensitivity analysis to explore the effect of the goal-setting interviews and mentoring being delivered by an ACGM staff member on an annual salary of approximately £12,000. In this scenario the cost per participant (including centre costs and intervention costs) was £228.94 in the control condition, £233.18 in the goal-setting condition and £240.25 in the goal-setting with mentoring condition (Table 5).
GS v IC (95% CI) | GM v IC (95% CI) | GM v GS (95% CI) | |
---|---|---|---|
Incremental cost | £22.66 (-£2,072.96 to £2,365.28) | -£65.03 (-£1,792.80 to £1,404.68) | -£87.69 (-£2,275.11 to £1,492.09 ) |
Incremental QALY | 0.0267 (-0.078 to 0.127) | -0.0174 (-0.156 to 0.092) | -0.0441 (-0.163 to 0.077) |
ICER | £849 | £3,737 | £1,988 |
Probability of cost-effectiveness at £20,000 per QALY | 65% | 44% | 32% |
Probability of cost-effectiveness at £20,000 per QALY | 67% | 43% | 28% |
Note: GS: Goal-Setting, GM: Goal-Setting with Mentoring, IC: Control
Table 5: Sensitivity analysis.
The Agewell pilot study explored the feasibility of setting up and delivering a community based goal-setting intervention with the aim of promoting physical and cognitive activity in older people. The Agewell centre was set up and the target study size of 75 participants to be randomised was achieved, indicating that the study was feasible. Attendance at the centre was good, with participants attending a mean of 34 activity sessions over the year. Furthermore, at 12 month followup 70 participants were assessed, which is a retention rate of 93%. The sample size for cost-effectiveness analysis is often smaller than the full clinical effectiveness sample due to fewer participants providing complete information on health and social care resource use. In this study, all 70 participants in the clinical effectiveness sample completed the resource use questionnaire and were used in the cost-effectiveness analysis. Health and social care costs did not differ significantly between the control and goal-setting conditions over 12 months, and the incremental cost between conditions was low meaning that the intervention is unlikely to have affected participants’ patterns of health and social care use in the short-term.
The partnership with Age Cymru Gwynedd a Môn (ACGM) and the involvement of the volunteer management group of centre attendees was key to the success of the study. The program of activities offered at the Agewell Centre was developed following consultation with centre attendees, encouraging engagement between participants and the centre. A co-ordinator was employed by the centre, and trained volunteers provided additional support. Attendance records for the centre indicate that up to 200 people could attend the centre annually. The annual cost of running the centre was estimated to be £38,122 in total or £191 per attendee (including non-trial attendees). In comparison to centre set-up and running costs, the delivery of the intervention was low cost as it only required the additional staff time involved in conducting the initial goal-setting interviews and subsequent mentoring calls.
The findings from the clinical effectiveness analysis in Clare et al. [9] showed that participants in all three arms of the pilot study benefitted across a range of outcome measures; however a specific focus on identifying individual behaviour change goals in a goal-setting interview was required to achieve increased activity engagement and greater benefits in cognition, health, diet and fitness. This paper explored the cost-effectiveness of the intervention and found that goalsetting is likely to be cost-effective compared to the control condition; however, while the addition of mentoring is likely to be effective, it is unlikely to be cost-effective. The goal-setting interviews were carried out by a researcher; however a sensitivity analysis was undertaken exploring the effect of the interviews being carried out by an ACGM staff member on a lower salary. The sensitivity analysis supported the base case analysis, in that goal-setting was likely to be cost-effective compared to the control condition.
The preliminary cost-effectiveness results indicate a high probability that the goal-setting intervention is cost-effective compared to the control condition at a threshold of £20,000-£30,000 per QALY gained. However, due to the small sample size and the QALY differences between groups not being statistically significant, it is not possible to conclusively state that the intervention was cost-effective compared to control, and a larger scale study is required. Communitybased interventions aimed at increasing physical, cognitive and social activity in older people may have a beneficial effect on health, so lowcost interventions such as the Agewell pilot study have an important role to play in keeping people active in the community.
This study was funded by the Lifelong Health and Well-being Programme through the Medical Research Council (G1001888/1). We acknowledge the support of Age Cymru Gwynedd a Môn and would like to thank the volunteers at the Nefyn Agewell Centre, and all the members of the Nefyn Agewell Centre, especially those who took part in the research project.