English | Nederlands
Voor de behandeling van alcoholisme en andere verslavingen

Home > Informatie voor Professionals > Onderzoek > Outcomes for Dutch patients at Castle ...
The 2003 evaluation for all Dutch patients admitted between 30.10.1998 to 21.7.2003
Independent analysis of outcome data Christo Research Systems
16th September 2003
Castle Craig Hospital provides an abstinence oriented residential treatment for alcohol or drug dependent individuals. It uses an established treatment model developed in the US around 1950 and first imported to the UK in 1974 (Cook, 1988a). Outcomes generated by this approach are very good (Cook, 1988b) and have recently been shown to be at least equal to and in some cases better than other commonly used treatments for substance misuse (Project MATCH, 1997; Ouimette et al, 1997; Longabaugh et al, 1998).
It is an intensive psychologically oriented approach consisting of regular group work, one to one counselling, lectures and written assignments. Many similar therapeutic communities are well established throughout the UK and their programme facilitates engagement with the independent free after care resource provided by Alcoholics Anonymous and Narcotics Anonymous (AA & NA) groups. Regular attendance of AA and NA has been shown to be associated with reduced drug or alcohol use (Emrick, 1987; McLatchie & Lomp, 1988; Alford et al, 1991; Christo & Franey, 1995; Gossop et al, 2003), improved psychological health (Christo & Sutton, 1994; DeSoto et al, 1989; DeSoto et al, 1985; McCown, 1989; McCown, 1990), and with improved physical health (Mann et al, 1991).
Services offered
Castle Craig Hospital offers detoxification from alcohol, tranquillisers, or opiates. Patients are encouraged to engage with all aspects of the programme during detoxification because it serves as a useful distraction from withdrawal symptoms and assists in their orientation. Patients are also assessed to identify specific medical (e.g. liver dysfunction), psychological (e.g. cognitive deficits, anxiety, abuse or traumatic events), or psychiatric (e.g. dual diagnosis, suicide risk, epilepsy) problems that may need to be addressed in their individual care plans.
The primary stage of treatment is quite intensive and is of about six weeks’ duration. Counselling staff employ a full range of psychotherapeutic approaches depending upon their training and interests (e.g. Rational Emotive Behavioural Therapy, Cognitive Behavioural Therapy, Reality Therapy, and many others).
Individuals with poor support networks or social functioning may then go on to a less intensive secondary stage of rehabilitation usually at Castle Craig's Extended Care Unit. As well as using the same elements found in primary treatment, extended care also assists patients to re-integrate with society by focusing on practical issues of occupation, housing, financial, legal and family problems.
Castle Craig Hospital can offer aftercare group therapy held in four locations in Scotland and two in the Netherlands at Amsterdam and Den Haag. All clients are encouraged to attend one or more of these aftercare sessions weekly for a period of up to two years after completing their residential treatment.
Outcome was measured by the Christo Inventory for Substance-misuse Services (CISS) which is a standardised, validated tool (Christo, Spurrell & Alcorn, 2000, Christo, 2000a) now commonly used in Scotland (Effective Interventions Unit, 2001), England & Wales (Audit Commission, 2002; Christo, 1999a,b,c; Christo, 2000b,c,d,e,f, Christo, 2001), and abroad (Christo & Da Silva, 2002). The CISS is a single page outcome evaluation tool completed by drug / alcohol service workers either from direct client interviews or from personal experience of their client supplemented by existing assessment notes. Its purpose is to elicit workers’ impressions of their clients in a quick, quantitative, standardised and reliable way. The 0 to 20 scale consists of 10 items reflecting clients’ problems with:
These outcome areas are scored on a three point scale of problem severity (0 = none, 1 = moderate, 2 = severe), each point is illustrated with relevant examples for guidance. Thus, a CISS score of 0 would indicate no problems and a score of 20 would indicate severe problems in all outcome areas.
CISS is incorporated as a regular part of Castle Craig Hospital’s intake and follow-up procedures. Baseline CISS forms were completed by staff from information gathered at the first assessment. They were then completed again during follow-up interviews on average about 39 weeks later. A table of entry and exit dates for all Dutch patients was extracted from the hospital database and delivered to Christo Research Systems for analysis along with relevant CISS forms.
The sample comprised of all patients from the Netherlands who entered treatment between 30th October 1998 to 21st July 2003 and stayed in treatment for more than 3 days. Sixty-seven patients met these criteria, attempts were made to follow up all of them and 46 patents were successfully contacted in order to obtain the detailed information presented below. This evaluation thus concentrates on outcomes for the 46 patients (40 males, 6 females) who were followed-up.
All 67 patients entered treatment via the primary care programme. Thirty two patients with poor support networks or social functioning then went on to a less intensive secondary stage of rehabilitation at Castle Craig's Extended Care Unit.
Table 1: The course of patients through treatment
| No. entered treatment | % dropout from primary | % entering extended care | No. entered extended care | % dropout from extended care | |
|---|---|---|---|---|---|
| Males | 51 | 17.6% | 50.1% | 26 | 19.2% |
| Females | 16 | 50% | 37.5% | 6 | 16.6% |
| Drug dependent | 34 | 17.6% | 70.6% | 24 | 25.0% |
| Alcohol dependent | 33 | 33.3% | 24.2% | 8 | 0% |
| All patients | 67 | 25.4% | 47.8% | 32 | 18.8% |
Table 1 indicates that of the 67 patients entering treatment, 25.4% failed to complete primary treatment and 47.8% completed primary and went on to extended care. The remaining 26.8% completed primary and no further treatment was necessary. Of the 32 patients entering extended care, only 18.8% failed to complete extended care, however a further 34.4% were still in extended care at the time of follow-up so their eventual discharge status remains unknown at this point. The highlighted sections of table 1 indicate that females were significantly less likely to complete primary care ( c 2 [1] = 6.7, p = .009), and drug dependent patients were significantly more likely to go into extended care ( c 2 [1] = 14.4, p < .001). No other statistically significant differences were found in the above table and the majority of non-completing females were not among the more recent patients.
The average length of stay in primary treatment was 5 weeks. 48% of patients then went on to extended care were their average length of stay was 10 weeks.
| Average total treatment duration (days) |
No. of patients | Average primary treatment duration (days) | No. patients entering extended care | Average extended care treatment duration (days) | |
|---|---|---|---|---|---|
| Completers | 81.9 | 39 | 41.7 | 15 | 85.3 |
| Still in extended | 103.1 | 11 | 44.2 | 11 | 58.9 |
| Premature leavers | 15.0 | 17 | 15.0 | 6 | 48.3 |
| All patients | 68.4 | 67 | 35.3 | 32 | 69.3 |
Table 2 indicates the average number of days in treatment for patients who completed treatment, for those still in extended care at the time of follow-up, and for those who left treatment prematurely. None of the 17 patients who decided to leave primary treatment prematurely went on to extended care, and they left on average about a third of the way through their primary treatment.
Attempts were made between 14.7.03 and 6.9.03 to contact all 67 Dutch patients. Those who could be contacted were interviewed using the CISS outcome measure. Follow-ups were successfully completed on 46 of the 67 patients (68.7%).
Table 3 Factors associated with successful follow-up contacts
| All Patients | Males | Females | Drug dependent | Alcohol dependent | Completed primary treatment | Entered extended care | Average total treatment duration (days) | |
|---|---|---|---|---|---|---|---|---|
| % Followed up | 68.7 | 78.4 | 37.5 | 73.5 | 63.6 | 75. | 73.2 | |
| % lost | 31.3 | 21.6 | 62.5 | 26.5 | 36.4 | 25. | 58. | |
| Total Number | 67 | 51 | 16 | 34 | 33 | 32 |
Table 3 lists details of available baseline information in order to explore if clients lost to follow-up were in any way different from those that were successfully followed-up. The highlighted sections of table 3 indicate that females were significantly less likely to be followed-up than males ( c 2 [1] = 9.5, p = .002). No other statistically significant differences were found in the above table.
The following details were not available for the 21 patients (11 males and 10 females) lost to follow-up, so this section reports only on the sample of 46 patients (40 males and 6 females) that were successfully followed-up.
Figure 1 Age
Chart 1 Age
The patients’ average age was 42.1 years (n = 46, sd = 12.2, range = 18 - 75), there was no difference in the average age of males and females.
However the drug dependent patients’ mean age of 35.1 (n = 25, sd = 8.6) was significantly lower than the alcohol dependent patients’ mean age of 50.5 (n = 21, sd = 10.4), ( t [44] = 5.5, p < .001). This difference is illustrated in the bimodal distribution evident in figure 1 above and this is as would be expected from a mixed sample of drug and alcohol dependent patients.
The average intake CISS total score of the 46 patients was 11.5 (sd = 3.4, range 3 - 17) and there was no significant difference between males’ and females’ total scores. This figure is indicative of a high level of dysfunction and suggests that these patients are generally more dysfunctional than drinkers and drug users attending outpatient alcohol services (based on the CISS comparison scores for these groups, see Appendix).
For 25 drug dependent patients:
For 21 alcohol dependent patients:
The drug dependent patients’ mean CISS score of 12.4 (n = 25, sd = 3.0) was significantly higher than the alcohol dependent patients’ mean score of 10.3 (n = 21, sd = 3.7), ( t [44] = 2.2, p = .03). This difference is explored in figure 2 below and is as would be expected from a mixed sample of drug and alcohol dependent patients.
Figure 2 Baseline CISS item scores by drug type
Chart 2: Baseline CISS
Figure 2 compares the average CISS item scores (0 to 2 scale) as assessed at intake between the 25 drug and the 21 alcohol dependent patients. The taller the bars in the figure, the greater the average degree of problem within the relevant CISS domain. Alcohol dependent patients tended to have…..
Figure 3 indicates the number of patients falling within each follow-up period. The majority of patients were followed-up after less than 105 weeks and the distribution is skewed to the shorter follow-up periods on the left.
Chart 4: Reductions of Patient Dysfunction
Figure 4 illustrates the reductions in CISS total scores achieved by the 46 patients who were followed-up. The inter-rater reliability of the CISS (Christo et al., 2000) would indicate that a score fluctuation of plus or minus one point is attributable to variations of CISS interpretation between raters. As such, only changes of 2 or more points are recognised as ‘genuine’ and on that basis:
Twenty-three patients achieved reductions of 10 CISS points or more. Changes of this magnitude are not uncommon among those who achieve total abstinence but would likely be perceived by the patients and their significant others as nothing short of miraculous.
Figure 5 displays how CISS total scores are distributed among the 46 patients. Dark bars indicate the score distributions at intake and the light bars indicate score distributions at follow-up.
The average intake CISS total score of the 46 patients was 11.5 (sd = 3.5, range 3 - 17)
The average follow-up CISS total score of the 46 patients was 2.7 (sd = 2.9, range 0 - 12)
A paired sample t-test indicates this reduction to be highly significant (t [45] = 14.1, p < .001)
The correlation between intake and follow-up scores is not significant (r [45] = .13, p = .4). This indicates that all patients can potentially achieve abstinence after this treatment intervention, regardless of their initial levels of dysfunction.
Chart 6: Changes in individual CISS item scores
Figure 6 compares the average CISS item scores (0 to 2 scale) as assessed at intake and then again at follow-up. The taller the bars in the figure, the greater the average degree of problem within the relevant CISS domain. As can also be seen in figure 2, the greatest problems at intake were with lack of support, drug or alcohol use, psychological problems and lack of occupation.
Ten Wilcoxon Signed Ranks statistical tests indicated that the reductions in all of the 10 CISS outcome domains were highly significant. Thus indicating that reductions in drug / alcohol use were generally accompanied by improvements in all other aspects of the patients’ lives.
The CISS form is a rough indicator of professional impression of recent drug / alcohol related problems in the past month. Specific situations / behaviours are listed only as guiding examples and may not reflect the exact situations / behaviours of the patient. The CISS wording has been left intact in the following tables (tables 4 to 14) to give an idea of the actual type of dysfunction an item score of 0, 1, or 2 might indicate within each domain. The tables below illustrate the percentage of patients rated as having none, moderate or severe problems within each CISS domain at intake and then again at follow-up.





‘Success’ rates among all 67 Dutch patients
The following rates are conservatively based on the assumption that the 11 patients not followed-up all showed no improvement or otherwise had poor outcomes.
Castle Craig Hospital appears to be providing a service for very dysfunctional drug or alcohol dependent people with complications from lack of support, psychological problems and lack of occupation. However, good outcomes are achieved despite these high levels of dysfunction at intake. Their patients are generally more dysfunctional than those attending outpatient drug or alcohol services and it is unlikely that many of them would have been able to engage with an outpatient treatment intervention. Although the goal of Castle Craig’s treatment is abstinence, it should be noted that those who fail to achieve that goal still report reduced levels of dysfunction at follow-up. Thus, even the treatment ‘failures’ appeared to have benefited from their experience in treatment, possibly by gaining a period of respite during which to recover from the consequences of their excessive drinking or drug use.
Castle Craig Hospital has demonstrated how easy it is to produce high quality research within the limitations of a busy service setting. The notion of evidence led practice is frequently discussed, but it could be argued that experienced practitioners already make best use of their resources. Thus, the purpose of such research could only be to illustrate that the experts know what they are doing (e.g., practice led evidence). This view may well be partially justified, as many of the findings in this study are obvious to those who are familiar with the field. However, some findings here are obvious only with the benefit of hindsight and others may yet inform better practice and commissioning.
Alford, G.S., Koehler, R.A. and Leonard, J. (1991). Alcoholics Anonymous - Narcotics Anonymous model inpatient treatment of chemically dependent adolescents: a 2-year outcome study. Journal of Studies on Alcohol, 52(2), 118-126.
The Audit Commission for Local Authorities and the National Health Service in England and Wales (2002). National report, changing habits: the commissioning and management of community drug treatment services for adults. Audit Commission Publications, Wetherby, UK, p71.
Christo, G. (1999a). Outcome monitoring: service evaluation made simple. GLAAS mailing, Issue 95 January 1999, Greater London Association of Alcohol Services.
Christo, G. (1999b). Keep it simple. Drug & Alcohol Findings, June 1999, Issue 1, p27.
Christo, G. (1999c). CISS: keeping it sweet and simple. Addiction Today, Vol 11, No 61, pp14-15.
Christo, G. (2000a). The Christo Inventory for Substance-misuse Services. In J. Maltby, C.A. Lewis, and A.P. Hill (Eds). Commissioned reviews on 300 psychological tests. Lampeter, Wales, UK: Edwin Mellen Press. p33-37.
Christo, G. (2000b). Clear classification: simple service evaluation. Druglink (ISDD journal), 15(1), 19-21.
Christo, G. (2000c). CISS: keeping it sweet and simple (part 2). Addiction Today, Vol 11, No 62, pp14-15.
Christo, G. (2000d). Outcome monitoring must be made easy (letter to the editor). Drug & Alcohol Findings, issue 3, p 26. (Royal Free)
Christo, G. (2000e). Outcomes of residential and day care placements for people with drug and alcohol problems: the 2000 evaluation for Hammersmith & Fulham Social Services. Hammersmith & Fulham Social Services. (Christo Research Systems)
Christo, G. (2000f). What did they get for their money? When Hammersmith & Fulham Social Services commissioned research on addiction treatments purchased by its managers, what did it discover? Dr George Christo summarises the findings and makes recommendations to help other purchasers. Addiction Today, Vol. 11, No. 65, 14-15. (Christo Research Systems)
Christo, G (2001) Running numbers: dealing with the data deluge. Druglink Vol.1, issue 3, May/June.
Christo, G. and DaSilva, V. A. (2002). A Portuguese version of the Christo Inventory for Substance-misuse Services: a simple outcome evaluation tool. Brazilian Journal of Medical and Biological Research, 35, 1111-1118.
Christo, G. & Franey, C. (1995). Drug Users' Spiritual Beliefs, Locus of Control and the Disease Concept in Relation to Narcotics Anonymous Attendance and Six-Month Outcomes. Drug and Alcohol Dependence, 38, 51-56.
Christo, G., Spurrell, S. and Alcorn, R. (2000). Validation of the Christo Inventory for Substance-misuse Services (CISS): a simple outcome evaluation tool. Drug and Alcohol Dependence.
Christo, G. and Sutton, S. (1994). Anxiety and self-esteem as a function of abstinence time among recovering addicts attending Narcotics Anonymous. British Journal of Clinical Psychology, 33, 198-200.
Cook, C.H. (1988a). The Minnesota Model in the management of drug and alcohol dependency: miracle, method or myth? Part I. the philosophy and the programme. British Journal of Addiction, 83, 625-634.
Cook, C.H. (1988b). The Minnesota Model in the management of drug and alcohol dependency: miracle, method or myth? Part II. evidence and conclusions. British Journal of Addiction, 83, 735-748.
DeSoto, C.B., O'donnell, W.E. and DeSoto, J.L. (1989). Long-term recovery in alcoholics. Alcoholism: Clinical and Experimental Research, 13(5), 693-697.
DeSoto, C.B., O'donnell, W.E., Allred, L.J. and Lopes, C.E. (1985). Symptomatology in alcoholics at various stages of abstinence. Alcoholism: Clinical and Experimental Research, 9(6), 505-512.
Effective Interventions Unit (2001). Evaluation Guide 7, Using assessment data for evaluation. Effective Interventions Unit, Substance Misuse Division, Scottish Executive, St. Andrew’s House, Edinburgh EH1 3DG.
Emrick, C.D. (1987). Alcoholics Anonymous: affiliation processes and effectiveness as treatment. Alcoholism: Clinical and Experimental Research, 11(5), 416-423.
Gossop M, Harris J, Best D, Man LH, Manning V, Marshall J and Strang J. (2003). Is attendance at alcoholics anonymous meetings after inpatient treatment related to improved outcomes? A 6-month follow-up study. Alcohol Alcohol, 38(5), 421-426.
Longabaugh R, Wirtz PW, Zweben A, Stout RL (1998) Network support for drinking, Alcoholics Anonymous and long-term matching effects. Addiction 93, 1313-1333.
Mann, R.E., Smart, R.G., Anglin, L. and Adlaf, E.M. (1991). Reductions in cirrhosis deaths in the United States: associations with per capita consumption and AA membership. Journal of Studies on Alcohol, 52(4), 361-365.
McCown, W. (1989). The relationship between impulsivity, empathy and involvement in twelve step self-help substance abuse treatment groups. British Journal of Addiction, 84, 391-393.
McCown, W. (1990). The effect of impulsivity and empathy on abstinence of poly- substance abusers: a prospective study. British Journal of Addiction, 85, 635-637.
McLatchie, B.H. and Lomp, KGE, (1988). Alcoholics Anonymous affiliation and treatment outcome among a clinical sample of problem drinkers. American Journal of Drug and Alcohol Abuse, 14(3), 309-324.
Ouimette PC, Finney JW, Moos RH (1997). Twelve-step and cognitive--behavioral treatment for substance abuse: a comparison of treatment effectiveness. Journal of Consulting and Clinical Psychology, 65, 230-240.
Project MATCH (1997). Matching Alcoholism Treatments to Client Heterogeneity: Project MATCH posttreatment drinking outcomes. Journal of Studies on Alcohol, 58, 7-29.
Abstinence based treatment outcomes: Six-month outcomes for 90 treated drug users from abstinence based treatment centres
In the month before follow-up:
Good outcome: 48 were abstinent and average CISS score was 2.9 (sd = 1.9)
Poor outcome: 42 had used drugs and average CISS score was 10.6 (sd = 4.3)
Over entire six month period: Good outcome:
33 remained abstinent* and average CISS score was 2.9 (sd = 2.0)
Good outcome: 22 had a lapse* and average CISS score was 4.5 (sd = 2.9)
Poor outcome: 35 had a relapse* and average CISS score was 11.2 (sd = 4.5)
* Lapse status was assessed using an eight-level scaling of lapse / relapse outcomes (as defined by Walton et al., 1994). Drug use over the entire six-month follow-up period was assessed using the principle of Timeline Follow Back (Sobell et al., 1988), as adapted for drug use by Walton et al. (1994).
N.B. a CISS cut-off score of 6 or less can be used to indicate "good outcome" for abstinence based treatment. This correctly identified 88% of outcomes where drug use was assessed only in month before follow-up, and 84% of outcomes where drug use was assessed over the entire six-month follow-up period.
Average CISS score among 243 clients at a London community drug service = 9.1 (sd = 3.4)
16%obtained CISS scores in range 0 to 5 = low problem severity
67%obtained CISS scores in range 6 to 12 = average problem severity
17%obtained CISS scores in range 13 to 20 = high problem severity
Average CISS score among 102 clients at a London community alcohol service = 8.1 (sd = 3.4)
15%obtained CISS scores in range 0 to 4 = low problem severity
70%obtained CISS scores in range 5 to 11 = average problem severity
15%obtained CISS scores in range 12 to 20 = high problem severity
Alcohol users generally score one CISS point less than drug users. Alcohol users are less likely to score on problems of social functioning, HIV risk behaviour and criminal involvement, but they are more likely to score on psychological problems.
CISS Website http://users.breathemail.net/drgeorgechristo/
ã 2000 George Christo PhD, PsychD.