Treasury Board of Canada Secretariat
Symbol of the Government of Canada

ARCHIVED - Performance Measurement for the Government On-Line Initiative


Warning This page has been archived.

Archived Content

Information identified as archived on the Web is for reference, research or recordkeeping purposes. It has not been altered or updated after the date of archiving. Web pages that are archived on the Web are not subject to the Government of Canada Web Standards. As per the Communications Policy of the Government of Canada, you can request alternate formats on the "Contact Us" page.


 

Client Satisfaction

Indicator(s)

Increased satisfaction levels through high quality services that provide clients time, effort, and cost savings relative to other delivery channels

Robust and accurate citizen/client feedback drives the improvement and evolution of services

Measurement Level and Technique

Measurement at the service and "whole of government" level primarily using citizen/client feedback

Primary tool(s)/data source(s)

1)   Departmental reporting on GOL plans and progress – the reporting includes three types of data related to client satisfaction: data from client satisfaction surveys; self-assessments of client benefits; and information on service standards

2)   Omnibus surveys – includes, e.g., Citizens First and Taking Care of Business studies, TBS GOL Internet Research Panel

Summary of results achieved in 2003

Mixed – While overall client satisfaction is relatively high, there are neither enough surveys of client satisfaction by departments and agencies nor sufficient use of satisfaction results to communicate with clients and develop service improvement strategies. Canadians' overall satisfaction with federal services has increased from 60% in 1998 to 64% in 2003. Half of the GOL departments and agencies have recently done a client satisfaction survey for at least one of their services; the average score is four or "satisfied" (on a one to five scale ranging from "very dissatisfied" to "very satisfied"). A smaller number have done surveys specifically for the Internet delivery channel. Only a few GOL services have sought their clients' perceptions of expected client benefits such as easier access and better information. Only one-third of departments and agencies have published the results of their satisfaction surveys, and a similar number have published service standards (two-thirds report having established service standards).

Raw data

 

 

  •  According to Citizens First 3, Canadians' satisfaction with 18 frequently used federal services is 64%, up from 60% in 1998 (Institute for Citizen-Centred Service, 2003)

–    Canada Post, CCRA tax services, HC information services, and HRDC employment services all contributed to this improvement, as did Canadians' satisfaction with on-line service generally

  • Further, there is evidence that Canadians' perceptions of service quality vary across delivery channels, and that on-line service delivery can raise overall satisfaction levels (Institute for Citizen-Centred Service, 2003)

–    Satisfaction with on-line government services is 68%, whereas satisfaction with services available by phone is only 56%

–    More than 80% who have used the on-line version of a government service would do so again

–    Over 50% of Canadians who want to receive government services through a different delivery channel would like to switch to the Internet or e-mail; this compares with only 21% who would like to switch to in-person service, 19% to the phone, and seven percent to mail

–    Greater satisfaction with on-line service delivery is noteworthy, as 51% of Canadians (66% of Internet users) have visited a federal Web site at least once in the past year, up noticeably since 2001 (EKOS, 2003); more detailed results can be found in the take-up section of this report

  • According to the Taking Care of Business survey, businesses' satisfaction with frequently used federal services is 62% (Institute for Citizen-Centred Service, 2004)
  • Businesses have a stronger allegiance to the telephone than do individuals (Institute for Citizen-Centred Service, 2004)

–    82% of businesses that have used the telephone to receive a government service would do so again (their strongest allegiance), while 73% of individuals would use it again

–    In contrast, 78% of businesses that have used the on-line version of a government service would do so again, while 81% of individuals would use it again (their strongest allegiance)

GOL services – satisfaction surveys

  • 45 of 130 GOL services (35%), covering 15 of 30 departments and agencies, have surveyed their clients at least once in the past two years; the average satisfaction score is about four or "satisfied" (where one is "very dissatisfied" and five is "very satisfied")

–    14 of these 45 services, covering 10 of 30 departments and agencies, report publishing survey results on their Web sites

  • Only a few GOL services provide evidence in filings of using results from client surveys to drive service improvement (although note that this finding may be the result of the methodology used – i.e., the way the specific question was worded; it requires follow-up)

–    Examples of services that do use survey results in this way include: HC's "Health Promotion", IC's "Federal Economic Development Initiative in Northern Ontario (FedNor)", NRCan.'s "Geographical Applications", Stats. Can.'s "Collection", "Communications and Dissemination", and "Stakeholder Relationships"

  • 20 of 130 GOL services (15%) have surveyed client satisfaction with their Internet channel; the average satisfaction score for on-line delivery is about the same as the average overall score, about four or "satisfied" (where one is "very dissatisfied" and five is "very satisfied")

–    These results are consistent with findings from a recent omnibus survey, which reports that average satisfaction score is about four or "satisfied" for federal Web site usage (where one is "very dissatisfied" and five is "very satisfied") (GOL Internet Research Panel, 2004)

–    13 of these services have compared their Internet channel with other channels; most (nine) indicate that satisfaction with on-line delivery is the same as with other channels

GOL services – service standards

  • 56 of 130 GOL services (43%), covering 19 of 30 departments and agencies, report having service standards

–    32 of these 56 services also report having done a client survey in the past two years

–    26 services, covering nine of 30 departments and agencies, have published their standards

GOL services – benefits

  • Departments and agencies report that their GOL services offer a wide range of – and in most cases, multiple – benefits for clients

–    115 of 130 services (88%) are providing easier access

–    62 services (47%) are providing time savings

–    62 services (47%) are providing simplified interactions with the federal government

–    60 services (46%) are providing better information leading to increased education, skills, and professional development opportunities, and/or better information leading to increased business opportunities

–    41 services (31%) are bundling related components in ways that are not possible through traditional delivery channels (e.g., in-person, phone, mail)

–    24 services (18%) are providing cost savings

  • However, only 23 of the 115 GOL services listing easier access as a benefit (20%) report seeking clients' perceptions of on-line access

–    Actual feedback is positive, with elements such as Web site clarity and ease of navigation typically rated as "good" to "very good"

  • Only 12 of the 60 GOL services listing better information as a benefit (20%) report seeking clients' perceptions of the completeness, accuracy, and trustworthiness of the information available on-line

–    Actual feedback is mixed; some clients are very satisfied with the information currently on-line; others think that it is incomplete or does not fully meet their needs

Plans for improvement

 

  • Establishment of baseline client satisfaction scores for all core Service Improvement departments and agencies, including feedback on expected client benefits such as easier access and better information (a letter was sent to Deputy Ministers in November 2003, requiring baseline scores to be set by March 31, 2004)

  • Implementation of follow-up client satisfaction surveys for those services that established baselines prior to 2003
  • Publication of client satisfaction results by service delivery channel
  • More comprehensive implementation of the Common Measurements Tool across federal departments and agencies for client-facing services, as the Service Improvement Initiative requires

  • Establishment and publication of service standards reflecting client expectations, as the Service Improvement Initiative requires
  • Identification of Service Improvement Leads in all departments and agencies
  • Creation of a culture of continuous service improvement through the incorporation of Service Improvement Initiative objectives into reporting against the Management Accountability Framework (a tool to guide TBS assessments of departmental performance)
  • Implementation of benchmarking with similar departments and agencies using the database established at the Institute for Citizen-Centred Service