Background:
For systematic reviews to be rigorous, deliverable and useful they need a well-defined review question. Scoping for a review also requires the specification of clear inclusion criteria and planned synthesis methods. Guidance is lacking on how to develop these, especially within the context of undertaking rapid and responsive systematic reviews to inform health services and health policy.

Objective:
This report describes and discusses the experiences of review scoping of three commissioned research centres that conducted evidence syntheses to inform health and social care organisation, delivery and policy in the UK, between 2017 and 2020.

Data sources:
Researcher recollection, project meeting minutes, e-mail correspondence with stakeholders, and scoping searches; from allocation of a review topic through to review protocol agreement.

Methods:
We produced eight descriptive case studies of selected reviews from the three teams. From these we identified key issues that shape the processes of scoping and question formulation for evidence synthesis. The issues were then discussed and lessons drawn.

Findings:
Across the eight diverse case studies we identified 14 recurrent issues that were important in shaping the scoping processes and formulating a review’s questions. These were ‘consultative issues’, relating to securing input from review commissioners, policy customers, experts, patients and other stakeholders: managing and deciding priorities; reconciling different priorities/perspectives; achieving buy-in and engagement; educating the end-user about synthesis processes and products, and; managing stakeholder expectations. There were ‘interface issues’ relating to the interaction between review team and potential review users: identifying the niche/gap and optimising value; assuring and balancing rigour/reliability/relevance, and; assuring transferability/applicability of study evidence to specific policy/service user contexts. There were also ‘technical issues’ associated with the methods and conduct of the review: choosing the method(s) of synthesis; balancing fixed versus fluid review questions/components/definitions; taking stock of what research already exists; Mapping vs Scoping vs Reviewing; scoping/relevance as a continuous process not just at initial stage, and; calibrating general versus specific and broad versus deep coverage of topics.

Limitations:
As a retrospective joint reflection by review teams on their experiences of scoping processes, this report is not based on prospectively collected research data. Also, our evaluations were not externally validated by, for example, policy and service evidence users or patients and the public.

Conclusions:
We have summarised our reflections on scoping from this programme of reviews as 14 common issues and 28 practical ‘lessons learned’. Effective scoping of rapid, responsive reviews extends beyond information exchange and technical procedures for specifying a ‘gap’ in the evidence. These considerations work alongside social processes, in particular the building of relationships and shared understanding between reviewers, research commissioners and potential review users that may be reflective of consultancy, negotiation, and co-production models of research and information use.

Funding:
Commissioned by the National Institute of Health Research Heath Services and Delivery Research programme as NIHR132708 (including work from Award IDs:. 16/47/11, 16/47/17, 16/47/22).

OBJECTIVE: the academic and scientific community has reacted at pace to gather evidence to help and inform about COVID-19. Concerns have been raised about the quality of this evidence. The aim of this review was to map the nature, scope and quality of evidence syntheses on COVID-19 and to explore the relationship between review quality and the extent of researcher, policy and media interest. DESIGN AND SETTING: a meta-research: systematic review of reviews. INFORMATION SOURCES: PubMed, Epistemonikos COVID-19 evidence, the Cochrane Library of Systematic Reviews, the Cochrane COVID-19 Study Register, EMBASE, CINAHL, Web of Science Core Collection and the WHO COVID-19 database, searched between 10 June 2020 and 15 June 2020. ELIGIBILITY CRITERIA: Any peer-reviewed article reported as a systematic review, rapid review, overview, meta-analysis or qualitative evidence synthesis in the title or abstract addressing a research question relating to COVID-19. Articles described as meta-analyses but not undertaken as part of a systematic or rapid review were excluded. STUDY SELECTION AND DATA EXTRACTION: Abstract and full text screening were undertaken by two independent reviewers. Descriptive information on review type, purpose, population, size, citation and attention metrics were extracted along with whether the review met the definition of a systematic review according to six key methodological criteria. For those meeting all criteria, additional data on methods and publication metrics were extracted. RISK OF BIAS: for articles meeting all six criteria required to meet the definition of a systematic review, AMSTAR-2 ((A MeaSurement Tool to Assess systematic Reviews, version 2.0) was used to assess the quality of the reported methods. RESULTS: 2334 articles were screened, resulting in 280 reviews being included: 232 systematic reviews, 46 rapid reviews and 2 overviews. Less than half reported undertaking critical appraisal and a third had no reproducible search strategy. There was considerable overlap in topics, with discordant findings. Eighty-eight of the 280 reviews met all six systematic review criteria. of these, just 3 were rated as of moderate or high quality on AMSTAR-2, with the majority having critical flaws: only a third reported registering a protocol, and less than one in five searched named COVID-19 databases. Review conduct and publication were rapid, with 52 of the 88 systematic reviews reported as being conducted within 3 weeks, and a half published within 3 weeks of submission. Researcher and media interest, as measured by altmetrics and citations, was high, and was not correlated with quality. DISCUSSION: This meta-research of early published COVID-19 evidence syntheses found low-quality reviews being published at pace, often with short publication turnarounds. Despite being of low quality and many lacking robust methods, the reviews received substantial attention across both academic and public platforms, and the attention was not related to the quality of review methods. INTERPRETATION: Flaws in systematic review methods limit the validity of a review and the generalisability of its findings. Yet, by being reported as 'systematic reviews', many readers may well regard them as high-quality evidence, irrespective of the actual methods undertaken. The challenge especially in times such as this pandemic is to provide indications of trustworthiness in evidence that is available in 'real time'. PROSPERO REGISTRATION NUMBER: CRD42020188822.

OBJECTIVES: to describe and reflect on the methods and influence of involvement of young people with lived experience within a complex evidence synthesis. STUDY DESIGN AND SETTING: Linked syntheses of quantitative and qualitative systematic reviews of evidence about interventions to improve the mental health of children and young people (CYP) with long-term physical conditions (LTCs). METHODS: Involvement was led by an experienced patient and public involvement in research lead. Young people with long-term physical conditions and mental health issues were invited to join a study-specific Children and Young People's Advisory Group (CYPAG). The CYPAG met face to face on four occasions during the project with individuals continuing to contribute to dissemination following report submission. RESULTS: Eight young people joined the CYPAG. Their views and experiences informed (a) a systematic review evaluating the effectiveness of interventions intended to improve the mental health of CYP with LTCs, (b) a systematic review exploring the experiences of interventions intended to improve the mental well-being of CYP with LTCs and (c) an overarching synthesis. The CYPAG greatly contributed to the team's understanding and appreciation of the wider context of the research. The young people found the experience of involvement empowering and felt they would use the knowledge they had gained about the research process in the future. CONCLUSION: Creating an environment that enabled meaningful engagement between the research team and the CYPAG had a beneficial influence on the young people themselves, as well as on the review process and the interpretation, presentation and dissemination of findings.

BACKGROUND: Cow's milk protein allergy (CMPA) is an immune-mediated allergic response to proteins in milk that is common in infants. Broad CMPA symptoms make diagnosis a challenge, particularly in primary care. Symptom scores may improve a clinician's awareness of symptoms, indicating a need for further testing. This systematic review examined the development and evaluation of such symptom scores for use in infants. METHODS: CENTRAL, MEDLINE, EMBASE and CINAHL databases were searched from inception to 3 December 2019 (Updated 14 November 2020) for diagnostic accuracy studies, randomised controlled trials, observational studies, economic evaluations, qualitative studies and studies reporting development of the tools. Data were not suitable for meta-analysis due to clinical and methodological heterogeneity, so were narratively synthesised. RESULTS: We found two symptom scores evaluated in one and fourteen studies, respectively. Estimated sensitivity and specificity ranged from 37% to 98% and 38% to 93%. The evaluations of each tool were at high risk of bias or failed to address issues such as clinical and cost-effectiveness. CONCLUSIONS: Estimates of accuracy of symptom scores for CMPA offered so far should be interpreted cautiously. Rigorous, conflict-free research based on well-defined roles for the tools is urgently required.

AbstractMulticomponent peri-operative interventions offer to accelerate patient recovery and improve cost-effectiveness. The recent National Institute of Health Research-commissioned evidence synthesis review by Nunns et al. considers the effectiveness and cost-effectiveness of all types of multicomponent interventions for older adults undergoing elective inpatient surgery. Enhanced recovery programmes (ERPs) were the most commonly evaluated intervention. An association between ERPs and decreased length of stay was observed, whilst complication rates and time to recovery were static or sometimes reduced. Important areas which lack research in the context of ERPs are patient-reported outcome measures, patients with complex needs and assessment of factors pertaining to successful ERP implementation. The next generation of ERP studies should seek to develop our understanding in these key areas.

Background
A ‘strengths-based approach’ focusses on peoples’ goals and resources rather than their problems. Social care professionals and organisations are striving to practise in a strengths-based way and since the Care Act of 2014 it is an even stronger requirement. However, there are challenges in implementing strengths-based approaches into practise, and uncertainty remains about their effectiveness.
Objective
To summarise research evidence on the effectiveness and the implementation of different strengths-based approaches within adult social work in the UK.
Data sources
We searched seven databases: MEDLINE ALL, PsycINFO, Social Policy and Practice, HMIC, CINAHL, ASSIA and the Campbell Library. Supplementary web searches were conducted. No date or language limits were used.
Review methods
Eligible studies were about adults (≥18 years) being supported or assessed by social workers; or about initiatives involving adult social care teams. For the effectiveness question, outcomes could be directly related to people’s individual outcomes or outcomes at the level of families or communities. The Cochrane Effective Practice and Organisation of Care group’s Risk of Bias Tool was chosen to appraise the quality of effectiveness studies, and qualitative implementation studies were assessed using the Wallace criteria. Findings were tabulated and analysed using framework synthesis, based on the Consolidated Framework of Implementation Research (CFIR). Studies that were not synthesised were summarised descriptively.
Findings
Of 5,030 studies screened, none met our inclusion criteria for the effectiveness question. Fifteen qualitative or mixed methods studies met the criteria for the implementation question, six of which were assessed as ‘good quality’. Seven examined Making Safeguarding Personal (MSP) and the remaining eight studies examined Local Area Coordination, Solution Focused Therapy, Family Group Conferencing, Asset-based Community Development, Strengths-based with Relationship-based Approach, Asset-based approaches, and Motivational Interviewing.
Seven studies on Making Safeguarding Personal (MSP), were synthesised into the following themes of implementation factors: 1) MSP as an intervention: seen as initially demanding but with long-term advantages; required significant practice change; needed tailoring to local settings. 2) Culture and Settings: required broad cultural changes; ‘outward facing’ and smaller/specialist councils tended to find this easier. 3) Individual characteristics: enhancing the knowledge, skills and confidence of stakeholders in MSP facilitated delivery; depended on practitioner skill in engaging people being supported; and people’s willingness to engage. 4) Embedding and sustaining MSP: depended on strong leadership and active engagement at all levels; required extensive planning and shaping of safeguarding practice that was user-focussed.
For the remaining eight studies of seven strengths-based approaches, we provide a summary of their findings.
Limitations
Our findings are mainly limited by the lack of available evidence in the UK. Higher quality studies may have revealed richer explanations of implementation.
Conclusions
There is a lack of good quality research evidence evaluating the effectiveness or implementation of strengths-based approaches. The synthesis revealed a wide range of factors that enabled or inhibited successful implementation of Making Safeguarding Personal. These factors may have wider relevance for the implementation of other strengths-based models of social work practice.
Future work
Higher quality evaluations of different strengths-based social work models are required.
Study registration: PROSPERO CRD42020166870
Funding
Commissioned by the NIHR HS&DR programme as a review project (NIHR130867) within NIHR HS&DR programme, reference number 16/47/22.

BACKGROUND: Children and young people with long-term physical health conditions are at increased risk of experiencing mental health and well-being difficulties. However, there is a lack of research that explores the experiences of and attitudes towards interventions aiming to improve their mental health and well-being. This systematic review seeks to address this gap in the literature by exploring what children and young people with long-term conditions, their caregivers, and health practitioners perceive to be important aspects of interventions aiming to improve their mental health and well-being. METHODS: an information specialist searched five academic databases using predefined criteria for qualitative evaluations of interventions aiming to improve the mental health or well-being of children with long-term physical conditions. Reviewers also performed supplementary citation and grey literature searches. Two reviewers independently screened titles, abstracts, and full texts that met the inclusion criteria and conducted data extraction and quality assessment. Meta-ethnography was used to synthesize the findings. RESULTS: Screening identified 60 relevant articles. We identified five overarching constructs through the synthesis: (a) Getting in and Staying In, (b) Therapeutic Foundation, (c) Social Support, (d) a Hopeful Alternative, and (e) Empowerment. The line of argument that links these constructs together indicates that when interventions can provide an environment that allows young people to share their experiences and build empathetic relationships, it can enable participants to access social support and increase feelings of hope and empowerment. CONCLUSION: These findings may provide a framework to inform the development of mental health interventions for this population and evaluate existing interventions that already include some of the components or processes identified by this research. Further research is needed to establish which of the constructs identified by the line of argument are most effective in improving the mental well-being of young people living with long-term conditions.

Background: Anxiety may be associated with poor attendance at school, which can lead to a range of adverse outcomes. We systematically reviewed the evidence for an association between anxiety and poor school attendance. Methods: Seven electronic databases were searched for quantitative studies that reported an estimate of association between anxiety and school attendance. Anxiety had to be assessed via standardised diagnostic measure or validated scale. Articles were screened independently by two reviewers. Meta-analyses were performed where possible, otherwise results were synthesised narratively. Results: a total of 4930 articles were screened. Eleven studies from six countries across North America, Europe and Asia, were included. School attendance was categorised into: (a) absenteeism (i.e. total absences), (b) excused/medical absences, (c) unexcused absences/truancy and (d) school refusal. Findings from eight studies suggested associations between truancy and any anxiety disorder, as well as social and generalised anxiety. Results also suggested cross-sectional associations between school refusal and separation, generalised and social anxiety disorders, as well as simple phobia. Few studies investigated associations with absenteeism or excused/medical absences. Conclusions: Findings suggest associations between anxiety and unexcused absences/truancy, and school refusal. Clinicians should consider the possibility of anxiety in children and adolescents with poor attendance. However, there is a lack of high quality evidence, little longitudinal research and limited evidence relating to overall absenteeism or excused/medical absences, despite the latter being the most common type of absence. These gaps should be a key priority for future research.

Background
Depression in young people may lead to reduced school attendance through social withdrawal, loss of motivation, sleep disturbance and low energy. We systematically reviewed the evidence for an association between depression and poor school attendance.

Methods
Seven electronic databases were searched for quantitative studies with school-aged children and/or adolescents, reporting a measure of association between depression and school attendance. Articles were independently screened by two reviewers. Synthesis incorporated random-effects meta-analysis and narrative synthesis.

Results
Searches identified 4930 articles. Nineteen studies from eight countries across North America, Europe, and Asia, were included. School attendance was grouped into: 1) absenteeism (i.e. total absences), 2) excused/medical absences, 3) unexcused absences/truancy, and 4) school refusal. Meta-analyses demonstrated small-to-moderate positive cross-sectional associations between depression and absenteeism (correlation coefficient r=0.11, 95% confidence interval 0.07 to 0.15, p=0.005, I2= 63%); and depression and unexcused absences/truancy (r=0.15, 95% confidence interval 0.13 to 0.17, p

BACKGROUND: Depression and debt are common in the UK. Debt Counselling for Depression in Primary Care: an adaptive randomised controlled pilot trial (DeCoDer) aimed to assess the clinical effectiveness and cost-effectiveness of the addition of a primary care debt counselling advice service to usual care for patients with depression and debt. However, the study was terminated early during the internal pilot trial phase because of recruitment delays. This report describes the rationale, methods and findings of the pilot study, and implications for future research. OBJECTIVES: the overarching aim of the internal pilot was to identify and resolve problems, thereby assessing the feasibility of the main trial. The specific objectives were to confirm methods for practice recruitment and the ability to recruit patients via the proposed approaches; to determine the acceptability of the study interventions and outcome measures; to assess contamination; to confirm the randomisation method for main trial and the level of participant attrition; and to check the robustness of data collection systems. DESIGN: an adaptive, parallel, two-group multicentre randomised controlled pilot trial with a nested mixed-methods process and economic evaluation. Both individual- and cluster (general practice)-level were was used in the pilot phase to assign participants to intervention or control groups. SETTING: General practices in England and Wales. PARTICIPANTS: Individuals were included who were aged ≥ 18 years, scored ≥ 14 on the Beck Depression Inventory II and self-identified as having debt worries. The main exclusion criteria were being actively suicidal or psychotic and/or severely depressed and unresponsive to treatment; having a severe addiction to alcohol/illicit drugs; being unable/unwilling to give written informed consent; currently participating in other research including follow-up phases; having received Citizens Advice Bureau (CAB) debt advice in the past year; and not wanting debt advice via a general practice. INTERVENTIONS: the participants in the intervention group were given debt advice provided by the CAB and shared biopsychosocial assessment, in addition to treatment as usual (TAU) and two debt advice leaflets. The participants in the control group were given advice leaflets provided by the general practitioner and TAU only. MAIN OUTCOME MEASURES: (1) Outcomes of the pilot trial - the proportion of eligible patients who consented, the number of participants recruited compared with target, assessment of contamination, and assessment of patient satisfaction with intervention and outcome measures. (2) Participant outcomes - primary - Beck Depression Inventory II; secondary - psychological well-being, health and social care utilisation, service satisfaction, substance misuse, record of priority/non-priority debts, life events and difficulties, and explanatory measures. Outcomes were assessed at baseline (pre-randomisation) and at 4 months post randomisation. Other data sources - qualitative interviews were conducted with participants, clinicians and CAB advisors. RESULTS: of the 238 expressions of interest screened, 61 participants (26%) were recruited and randomised (32 in the intervention group and 29 in the control group). All participants provided baseline outcomes and 52 provided the primary outcome at 4 months' follow-up (14.7% dropout). Seventeen participants allocated to the intervention saw a CAB advisor. Descriptive statistics are reported for participants with complete outcomes at baseline and 4 months' follow-up. Our qualitative findings suggest that the relationship between debt and depression is complex, and the impact of each on the other is compounded by other psychological, social and contextual influences. CONCLUSIONS: As a result of low recruitment, this trial was terminated at the internal pilot phase and was too small for inferential statistical analysis. We recommend ways to reduce this risk when conducting complex trials among vulnerable populations recruited in community settings. These cover trial design, the design and delivery of interventions, recruitment strategies and support for sites. TRIAL REGISTRATION: Current Controlled Trials ISRCTN79705874. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 35. See the NIHR Journals Library website for further project information. Mark Gabbay and Adele Ring are part-funded by NIHR Collaborations for Leadership in Applied Health Research and Care (CLAHRC) North West Coast and Richard Byng and Rod S Taylor, Vashti Berry and Elizabeth Shaw part-funded by NIHR CLAHRC South West Peninsula.