6 February 2019
2018/19 CCG Improvement and Assessment Framework – Additional Frequently Asked Questions (FAQs)
These questions should be read alongside the Guidance for CCGs document (full name: Patient and Community Engagement Indicator, 2018/19 CCG Improvement and Assessment Framework, Guidance for CCGs) and the instructions tab within the evidence submission template. They have been compiled based on questions asked during the four support webinars held during January and February 2019.
Evidence requirements and completing the template
1. Does evidence on 3rd party websites count, provided the CCG website references it/links to it?
Please see page 11 of the Guidance for CCGs document.
The link provided in the template should be to a page on the CCG’s own website that signposts to the relevant partnership website.
2. Is there a limit to the number of pieces of evidence for each criterion?
Please see pages 10-11 of the Guidance for CCGs document.
Yes. Up to three pieces of evidence can be provided for each criterion. It is for each CCG to identify evidence that adequately demonstrates that the criterion has been met.
3. Please clarify the timescales for evidence.
Please see page 10 of the Guidance for CCGs document.
The assessment relates to the 2018/19 financial year (i.e. the period from 1 April 2018 to 31 March 2019). Assessment of the relevant aspects of annual reports will be for 2017/18 reports, published during 2018/19. All other evidence should relate to activity that is ‘live’ in 2018/19 or that is delivering outcomes/impacts in 2018/19. It is recognised that some documents may not be refreshed on an annual basis. It is expected that all evidence is ‘live and current’.
For CCGs that were newly formed on 1 April 2018 – please refer to FAQ number two in Appendix C (page 22) of the Guidance for CCGs document.
4. What about long-running consultations with several engagement / consultation periods / phases. Can we refer to consultation phases from last year if the whole consultation process is still ongoing?
Evidence should relate to activity that is ‘live’ in 2018/19 or that is delivering outcomes/impacts in 2018/19. Any evidence published before 1 April 2018 should either (a) explicitly relate to activity that is ongoing during 2018/19, and/or (b) be the most recent version of a relevant and current policy or strategy.
5. Are there any examples or adequate descriptions of change?
Please see page 10-11 of the Guidance for CCGs document.
CCGs newly formed on 1 April 2018 do not have to complete the description of change column of the template.
6. If a CCG was rated outstanding last year does it need to complete the description of change section of the template?
Please see page 12 of the Guidance for CCGs document.
In addition to the evidence requirements, a description of change is required for criteria where a CCG indicates that the criteria is met in 2018/19 and was not met in 2017/18 (or vice versa).
7. Can we link to a section of a website where there are multiple pages?
Yes. The description of evidence should be clear about what evidence is being submitted for review.
8. Can you use the same piece of evidence more than once?
Yes. The most appropriate evidence should be selected for each criterion. In some circumstances this may be the same evidence for more than one criterion. CCGs are encouraged to use a range of evidence to best demonstrate the breadth of their work.
9. What is the impact on completion as a newly formed CCG on 1st April?
Please see page 20 (question two) of the Guidance for CCGs document.
10. Our CCG worked with other seven CCGs in the area on one big piece of work, can we submit the same evidence as we worked on the same piece of work?
Please see page 11 of the Guidance for CCGs.
Yes. It should be clear to assessors how the CCG being assessed was involved in the activity.
11. Do we need to have Patient and Public Involvement strategies in place or is it enough to have statements on the website which describe what we are / will do?
Relevant evidence should be provided for each relevant criterion. It is for each CCG to identify evidence that adequately demonstrates that the criterion has been met.
12. How can we write a description of change against some of the domains without knowing what was looked at and assessed as part of last year’s process?
Assessors undertook a thorough review of online information during the assessment period (July to October 2017). It is recommended that you review/consider what was available at this time.
13. We are currently redeveloping our website, with the new site due to go live at the end of March. What should we do?
Evidence should be available between 8 March and 30 May 2019. If you have circumstances that may make this difficult please contact us directly at firstname.lastname@example.org
14. Will separately published Patient and Public Involvement Annual Reports be picked up in the assessment process please (provided they are linked from the main Annual Report)?
Annual reports, including related but separate engagement or participation annual reports, will be considered by assessors provided these are submitted as evidence. Also see: A guide to annual reporting on the legal duty to involve patients and the public in commissioning.
15. How do we explain our partnership arrangements with other CCGs?
Please use cells B13-B18 to tell assessors about partnership arrangements with other CCGs and how this is reflected in your evidence submission.
16. If two CCGs have identical websites, would they be expected to gain the same marks for each domain, or do different CCGs get marked differently depending on things like population size or demographic profile?
Where CCGs have a shared website, or are working closely together, each CCG will still need to submit an individual template and will receive an individual score. Cells B13 to B18 should be used to tell assessors about any arrangements for joint working and how this is reflected in submissions. For example, if two CCGs share a website and intend to submit the same or similar evidence they may wish to submit ‘mirror submissions’ this should be described in B17 and B18. Where this information is provided, CCGs with identical websites, or working in partnership, will be allocated for assessment accordingly. The assessment process is the same regardless of population size or demographic profile.
17. How is the RAGG rating auto-generated? Could you clarify the process at this first stage?
Please see page 13 of the Guidance for CCGs document.
An initial score (and RAGG* rating) is generated within the template on completion and submission.
18. Why there is no appeal process this year?
Please see page 21 of the Guidance for CCGs document (question five).
19. Is there any provision for the assessment panel to ask clarification questions of the CCG if queries over the evidence?
It is not expected that assessors will seek clarification from CCGs during the assessment process. The template should be used to tell assessors about the evidence you are submitting.
20. What if our website goes down on the day we are assessed?
Assessments will take place over a period of time. Evidence provided should be available to assessors between 8 March and 30 May 2019. If you experience any difficulties with your website during this time please contact us at email@example.com
21. Are we able to update web links after 8 March?
Please see page 10 of the Guidance for CCGs document.
National assessment will be undertaken between 8 March and 30 May using the links provided. All evidence linked to should be available between these dates. There will be no opportunity to update links after submission on the 8 March.
22. Could you please clarify what the 10 key actions are above?
Please see page eight of the Guidance for CCGs document.
The Patient and Community Engagement Indicator evidences CCGs’ implementation of the revised statutory guidance on patient and public participation in commissioning health and care and therefore their compliance with the ‘14Z2’ statutory duty. The 10 key actions are outlined in this document and within column A of the assessment template.
23. Do we need accountable officer sign off?
Yes, please see page 10 of the Guidance for CCGs document.
24. Who is our main point of contact if we need to clarify anything?
If you have any queries please contact the NHS England Public Participation team using the details below:
Telephone: 0113 825 0861