<?xml version="1.0" encoding="UTF-8"?><doc title="Archived [2021-03-24]  - Directive on Automated Decision-Making" documentID="32592" versionID="1" language="en" space="preserve" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="G:\web\xml\pols\PolicyInstrumentSchema.HTML5.xsd"><chapters><chapter anchor="1" title="Purpose"><clauses><clause anchor="1.1"><p>This Directive takes effect on <time class="nowrap" datetime="2019-04-01">April 1, 2019</time>, with compliance required by no later than <time class="nowrap" datetime="2020-04-01">April 1, 2020</time>.</p></clause><clause anchor="1.2"><p>This Directive applies to any Automated Decision System developed or procured after <time class="nowrap" datetime="2020-04-01">April 1, 2020</time>.</p></clause><clause anchor="1.3"><p>This Directive will have an automatic review process planned every 6 months after the date it comes into effect.</p></clause></clauses></chapter><chapter anchor="2" title="Authorities"><clauses><clause anchor="2.1"><p>This Directive is issued under the authority of section 7 of the <em>Financial Administration Act</em>, and under section 6.4.9 of the <a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=12755"><em>Policy on Management of Information Technology</em></a>;</p></clause><clause anchor="2.2"><p>This Directive supports the <em>Policy on Information Management</em>, the <em>Policy on Service</em>, the <em>Policy on Privacy Protection</em>, and the <em>Policy on Government Security</em>.</p></clause></clauses></chapter><chapter anchor="3" title="Definitions"><clauses><clause anchor="3.1"><p>Definitions to be used in the interpretation of this Directive are listed in <a href="#appA">Appendix A</a>.</p></clause></clauses></chapter><chapter anchor="4" title="Objectives and Expected Results"><clauses><clause anchor="4.1"><p>The objective of this Directive is to ensure that Automated Decision Systems are deployed in a manner that reduces risks to Canadians and federal institutions, and leads to more efficient, accurate, consistent, and interpretable decisions made pursuant to Canadian law.</p></clause><clause anchor="4.2"><p>The expected results of this Directive are as follows:</p><clauses><clause anchor="4.2.1"><p>Decisions made by federal government departments are data-driven, responsible, and complies with procedural fairness and due process requirements. </p></clause><clause anchor="4.2.2"><p>Impacts of algorithms on administrative decisions are assessed and negative outcomes are reduced, when encountered.</p></clause><clause anchor="4.2.3"><p>Data and information on the use of Automated Decision Systems in federal institutions are made available to the public, where appropriate.</p></clause></clauses></clause></clauses></chapter><chapter anchor="5" title="Scope"><clauses><clause anchor="5.1"><p>This Directive applies only to systems that provide external services as defined in the <a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=27916#appA"><em>Policy on Service</em></a>.</p></clause><clause anchor="5.2"><p>This Directive applies to any system, tool, or statistical models used to recommend or make an administrative decision about a client.</p></clause><clause anchor="5.3"><p>This Directive applies only to systems in production, and excludes Automated Decision Systems operating in test environments.</p></clause><clause anchor="5.4"><p>As per the <a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=12755"><em>Policy on the Management of Information Technology</em></a>, this Directive does not apply to any National Security Systems.</p></clause></clauses></chapter><chapter anchor="6" title="Requirements"><p>The Assistant Deputy Minister responsible for the program using the Automated Decision System, or any other person named by the Deputy Head, is responsible for:</p><clauses><clause anchor="6.1"><h3>Algorithmic Impact Assessment</h3><clauses><clause anchor="6.1.1"><p>Completing an Algorithmic Impact Assessment prior to the production of any Automated Decision System.</p></clause><clause anchor="6.1.2"><p>Applying the relevant requirements prescribed in Appendix C as determined by the Algorithmic Impact Assessment. </p></clause><clause anchor="6.1.3"><p>Updating the Algorithmic Impact Assessment when system functionality or the scope of the Automated Decision System changes. </p></clause><clause anchor="6.1.4"><p>Releasing the final results of Algorithmic Impact Assessments in an accessible format via Government of Canada websites and any other services designated by the Treasury Board of Canada Secretariat pursuant to the <a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=28108">Directive on Open Government</a>.</p></clause></clauses></clause><clause anchor="6.2"><h3>Transparency</h3><section><h4>Providing Notice Before Decisions</h4><clauses><clause anchor="6.2.1"><p>Providing notice on relevant websites that the decision rendered will be undertaken in whole or in part by an Automated Decision System as prescribed in Appendix C.</p></clause><clause anchor="6.2.2"><p>Providing notices prominently and in plain language, pursuant to the <a href="https://www.canada.ca/en/treasury-board-secretariat/services/government-communications/canada-content-style-guide.html#toc5">Canada.ca Content Style Guide</a>.</p></clause></clauses></section><section><h4>Providing Explanations After Decisions</h4><clauses><clause anchor="6.2.3"><p>Providing a meaningful explanation to affected individuals of how and why the decision was made as prescribed in Appendix C.</p></clause></clauses></section><section><h4>Access to components</h4><clauses><clause anchor="6.2.4"><p>Determining the appropriate license for software components as per the requirements specified in section in C.2.3.8 of the <a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=15249"><em>Directive on Management of Information Technology</em></a>.</p></clause><clause anchor="6.2.5"><p>If using a proprietary license, ensuring that:</p><clauses><clause anchor="6.2.5.1"><p>All released versions of proprietary software components used for Automated Decision Systems are delivered to, and safeguarded by, the department.</p></clause><clause anchor="6.2.5.2"><p>The Government of Canada retains the right to access and test the Automated Decision System, including all released versions of proprietary software components, in case it is necessary for a specific audit, investigation, inspection, examination, enforcement action, or judicial proceeding, subject to safeguards against unauthorized disclosure.</p></clause><clause anchor="6.2.5.3"><p>As part of this access, the Government of Canada retains the right to authorize external parties to review and audit these components as necessary.</p></clause></clauses></clause></clauses></section><section><h4>Release of Source Code</h4><clauses><clause anchor="6.2.6"><p>Releasing custom source code owned by the Government of Canada as per the requirements specified in section C.2.3.8 of the <a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=15249"><em>Directive on Management of Information Technology</em></a>, unless:</p><clauses><clause anchor="6.2.6.1"><p>The source code is processing data classified SECRET, TOP SECRET or PROTECTED C;</p></clause><clause anchor="6.2.6.2"><p>Disclosure would otherwise be exempted or excluded under the <em>Access to Information Act</em>, or</p></clause><clause anchor="6.2.6.3"><p>An exemption is provided by the Chief Information Officer of Canada.</p></clause></clauses></clause><clause anchor="6.2.7"><p>Determining the appropriate access restrictions to the released source code.</p></clause></clauses></section></clause><clause anchor="6.3"><h3>Quality Assurance</h3><section><h4>Testing and Monitoring Outcomes</h4><clauses><clause anchor="6.3.1"><p>Before launching into production, developing processes so that the data and information used by the Automated Decision Systems are tested for unintended data biases and other factors that may unfairly impact the outcomes.</p></clause><clause anchor="6.3.2"><p>Developing processes to monitor the outcomes of Automated Decision Systems to safeguard against unintentional outcomes and to verify compliance with institutional and program legislation, as well as this Directive, on a scheduled basis. </p></clause></clauses></section><section><h4>Data Quality</h4><clauses><clause anchor="6.3.3"><p>Validating that the data collected for, and used by, the Automated Decision System is relevant, accurate, up-to-date, and in accordance with the <em>Policy on Information Management</em> and the <em>Privacy Act</em>.</p></clause></clauses></section><section><h4>Peer Review</h4><clauses><clause anchor="6.3.4"><p>Consulting the appropriate qualified expert to review the Automated Decision System, as prescribed in Appendix C.</p></clause></clauses></section><section><h4>Employee Training</h4><clauses><clause anchor="6.3.5"><p>Providing adequate employee training in the design, function, and implementation of the Automated Decision System to be able to review, explain and oversee its operations, as prescribed in Appendix C.</p></clause></clauses></section><section><h4>Contingency</h4><clauses><clause anchor="6.3.6"><p>Establishing contingency systems and/or processes as per Appendix C.</p></clause></clauses></section><section><h4>Security</h4><clauses><clause anchor="6.3.7"><p>Conducting risk assessments during the development cycle of the system and establish appropriate safeguards to be applied, as per the <a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=16578">Policy on Government Security</a>.</p></clause></clauses></section><section><h4>Legal</h4><clauses><clause anchor="6.3.8"><p>Consulting with the institution’s legal services, to ensure that the use of the Automated Decision System is compliant with applicable legal requirements. </p></clause></clauses></section><section><h4>Ensuring human intervention</h4><clauses><clause anchor="6.3.9"><p>Ensuring that an Automated Decision System allows for human intervention, when appropriate, as per Appendix C.</p></clause><clause anchor="6.3.10"><p>Obtaining the appropriate level of approvals prior to the production of an Automated Decision System as per Appendix C.</p></clause></clauses></section></clause><clause anchor="6.4"><h3>Recourse</h3><clauses><clause anchor="6.4.1"><p>Providing clients with any applicable recourse options that are available to them to challenge the administrative decision. </p></clause></clauses></clause><clause anchor="6.5"><h3>Reporting</h3><clauses><clause anchor="6.5.1"><p>Publishing information on the effectiveness and efficiency of the Automated Decision Systems in meeting program objectives on a website or service designated by the Treasury Board of Canada. </p></clause></clauses></clause></clauses></chapter><chapter anchor="7" title="Consequences"><clauses><clause anchor="7.1"><p>Consequences of non-compliance with this policy can include any measure allowed by the <em>Financial Administration Act</em> that the Treasury Board would determine as appropriate and acceptable in the circumstances.</p></clause><clause anchor="7.2"><p>For an outline of the consequences of non‑compliance, refer to the <a href="http://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=17151">Framework for the Management of Compliance</a>, Appendix C: Consequences for Institutions and Appendix D: Consequences for Individuals.</p></clause></clauses></chapter><chapter anchor="8" title="Roles and Responsibilities of Treasury Board of Canada Secretariat"><p>Subject to the necessary delegations, the Chief Information Officer of Canada is responsible for:</p><clauses><clause anchor="8.1"><p>Providing government-wide guidance on the use of Automated Decision Systems.</p></clause><clause anchor="8.2"><p>Granting exceptions under any of these provisions, in consultation with the Enterprise Architecture Review Board prior to making a decision. </p></clause><clause anchor="8.3"><p>Developing and maintaining the Algorithmic Impact Assessment and any supporting documentation.</p></clause><clause anchor="8.4"><p>Communicating and engaging government-wide and with partners in other jurisdictions and sectors to develop common strategies, approaches, and processes to support the responsible use of Automated Decision Systems.</p></clause></clauses></chapter><chapter anchor="9" title="Application"><clauses><clause anchor="9.1"><p>This Directive applies to all institutions referenced in the <em>Policy on the Management of Information Technology</em>, unless excluded by specific acts, regulations or Orders-in-Council;</p><clauses><clause anchor="9.1.1"><p>Agents of Parliament are excluded from this Directive, including the:</p><ul><li>Office of the Auditor General,</li><li>Office of the Chief Electoral Officer, </li><li>Office of the Commissioner of Lobbying of Canada, </li><li>Office of the Commissioner of Official Languages, </li><li>Office of the Information Commissioner of Canada,</li><li>Office of the Privacy Commissioner of Canada, and</li><li>Office of the Public Sector Integrity Commissioner of Canada.</li></ul></clause></clauses></clause><clause anchor="9.2"><p>Agencies, Crown Corporations, or Agents of Parliament may enter into Specific Agreements with the Treasury Board of Canada Secretariat to adopt the requirements of this Directive and apply them to their organization, as required.</p></clause></clauses></chapter><chapter anchor="10" title="References"><clauses><clause anchor="10.1"><ul><li><a href="http://laws-lois.justice.gc.ca/eng/acts/F-11/">Financial Administration Act</a></li><li><a href="http://laws-lois.justice.gc.ca/eng/acts/A-1/">Access to Information Act</a></li><li><a href="http://laws-lois.justice.gc.ca/eng/acts/h-6/">Canadian Human Rights Act</a></li><li><a href="http://laws-lois.justice.gc.ca/eng/acts/P-21/">Privacy Act</a></li><li><a href="http://laws-lois.justice.gc.ca/eng/acts/O-5/">Security of Information Act</a></li></ul></clause><clause anchor="10.2"><ul><li><a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=12453">Policy on Access to Information</a></li><li><a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=27916#appA">Policy on Service</a></li><li><a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=16578">Policy on Government Security</a></li><li><a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=12742">Policy on Information Management</a></li><li><a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=12755">Policy on Management of Information Technology</a></li><li><a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=12510">Policy on Privacy Protection</a></li><li><a href="https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=28108">Directive on Open Government</a></li></ul></clause></clauses></chapter><chapter anchor="11" title="Enquiries"><p>For information on this policy instrument, please contact the Treasury Board of Canada Secretariat <a href="mailto:publicenquiries-demandesderenseignement@tbs-sct.gc.ca">Public Enquiries</a>. </p></chapter></chapters><appendices><appendix anchor="A" title="Appendix A - Definitions"><section><dl><dt>Administrative Decision</dt><dd>Any decision that is made by an authorized official of an institution as identified in section 9 of this Directive pursuant to powers conferred by an Act of Parliament or an order made pursuant to a prerogative of the Crown that affects legal rights, privileges or interests.</dd><dt>Algorithmic Impact Assessment</dt><dd>A framework to help institutions better understand and reduce the risks associated with Automated Decision Systems and to provide the appropriate governance, oversight and reporting/audit requirements that best match the type of application being designed. </dd><dt>Artificial Intelligence</dt><dd>Information technology that performs tasks that would ordinarily require biological brainpower to accomplish, such as making sense of spoken language, learning behaviours, or solving problems. </dd><dt>Automated Decision System</dt><dd>Includes any technology that either assists or replaces the judgement of human decision-makers. These systems draw from fields like statistics, linguistics, and computer science, and use techniques such as rules-based systems, regression, predictive analytics, machine learning, deep learning, and neural nets.</dd><dt>Procedural Fairness</dt><dd>Procedural fairness is a guiding principle of governmental and quasi-judicial decision-making. The degree of procedural fairness that the law requires for any given decision-making process increases or decreases with the significance of that decision and its impact on rights and interests. </dd><dt>Source Code</dt><dd>Computer program in its original programming language, human readable, before translation into object code usually by a compiler or an interpreter. It consists of algorithms, computer instructions and may include developer's comments.</dd><dt>Test Environment</dt><dd>An environment containing hardware, instrumentation, simulators, software tools, and other support elements needed to conduct a test. </dd></dl></section></appendix><appendix anchor="B" title="Appendix B - Impact Assessment Levels"><table class="table table-bordered table-condensed"><thead><tr class="active"><th scope="col">Level</th><th scope="col">Description</th></tr></thead><tbody><tr><th scope="row"><abbr title="1">I</abbr></th><td><p>The decision will likely have little to no impact on:</p><ul><li>the rights of individuals or communities,</li><li>the health or well-being of individuals or communities,</li><li>the economic interests of individuals, entities, or communities,</li><li>the ongoing sustainability of an ecosystem.</li></ul><p>Level <abbr title="1">I</abbr> decisions will often lead to impacts that are reversible and brief.</p></td></tr><tr><th scope="row"><abbr title="2">II</abbr></th><td><p>The decision will likely have moderate impacts on:</p><ul><li>the rights of individuals or communities,</li><li>the health or well-being of individuals or communities,</li><li>the economic interests of individuals, entities, or communities,</li><li>the ongoing sustainability of an ecosystem.</li></ul><p>Level <abbr title="2">II</abbr> decisions will often lead to impacts that are likely reversible and short-term.</p></td></tr><tr><th scope="row"><abbr title="3">III</abbr></th><td><p>The decision will likely have high impacts on:</p><ul><li>the rights of individuals or communities,</li><li>the health or well-being of individuals or communities,</li><li>the economic interests of individuals, entities, or communities,</li><li>the ongoing sustainability of an ecosystem.</li></ul><p>Level <abbr title="3">III</abbr> decisions will often lead to impacts that can be difficult to reverse, and are ongoing.</p></td></tr><tr><th scope="row"><abbr title="4">IV</abbr></th><td><p>The decision will likely have very high impacts on:</p><ul><li>the rights of individuals or communities,</li><li>the health or well-being of individuals or communities,</li><li>the economic interests of individuals, entities, or communities,</li><li>the ongoing sustainability of an ecosystem.</li></ul><p>Level <abbr title="4">IV</abbr> decisions will often lead to impacts that are irreversible, and are perpetual.</p></td></tr></tbody></table></appendix><appendix anchor="C" title="Appendix C - Impact Level Requirements"><table class="table table-bordered table-condensed"><thead><tr class="active"><th id="tbl5">Requirement</th><th id="tbl6">Level <abbr title="1">I</abbr></th><th id="tbl7">Level <abbr title="2">II</abbr></th><th id="tbl8">Level <abbr title="3">III</abbr></th><th id="tbl9">Level <abbr title="4">IV</abbr></th></tr></thead><tbody><tr><th class="active" id="tbl13" headers="tbl5">Peer Review</th><td headers="tbl6 tbl13"><p>None</p></td><td colspan="2" headers="tbl7 tbl8 tbl13"><p><strong>At least one of:</strong></p><p>Qualified expert from a federal, provincial, territorial or municipal government institution</p><p>Qualified members of faculty of a post-secondary institution</p><p>Qualified researchers from a relevant non- governmental organization</p><p>Contracted third-party vendor with a related specialization</p><p>Publishing specifications of the Automated Decision System in a peer-reviewed journal</p><p>A data and automation advisory board specified by Treasury Board Secretariat</p></td><td headers="tbl9 tbl13"><p><strong>At least two of:</strong></p><p>Qualified experts from the National Research Council of Canada,  Statistics Canada, or the Communications Security Establishment</p><p>Qualified members of faculty of a post-secondary institution</p><p>Qualified researchers from a relevant non- governmental organization</p><p>Contracted third-party vendor with a related specialization</p><p>A data and automation advisory board specified by Treasury Board Secretariat</p><p><strong>OR:</strong></p><p>Publishing specifications of the Automated Decision System in a peer-reviewed journal</p></td></tr><tr><th class="active" id="tbl27" headers="tbl5">Notice</th><td headers="tbl6 tbl27"><p>None</p></td><td headers="tbl7 tbl27"><p>Plain language notice posted on the program or service website.</p></td><td colspan="2" headers="tbl8 tbl9 tbl27"><p>Publish documentation on relevant websites about the automated decision system, in plain language, describing:</p><ul><li>How the components work;</li><li>How it supports the administrative decision; and</li><li>Results of any reviews or audits; and</li><li>A description of the training data, or a link to the anonymized training data if this data is publicly available.</li></ul></td></tr><tr><th class="active" id="tbl34" headers="tbl5">Human-in-the-loop for decisions</th><td colspan="2" headers="tbl6 tbl7 tbl34"><p>Decisions may be rendered without direct human involvement.</p></td><td colspan="2" headers="tbl8 tbl9 tbl34"><p>Decisions cannot be made without having specific human intervention points during the decision-making process; and the final decision must be made by a human</p></td></tr><tr><th class="active" id="tbl40" headers="tbl5">Explanation Requirement</th><td headers="tbl6 tbl40"><p>In addition to any applicable legislative requirement, ensuring that a meaningful explanation is provided for common decision results. This can include providing the explanation via a Frequently Asked Questions section on a website.</p></td><td headers="tbl7 tbl40"><p>In addition to any applicable legislative requirement, ensuring that a meaningful explanation is provided upon request for any decision that resulted in the denial of a benefit, a service, or other regulatory action.</p></td><td colspan="2" headers="tbl8 tbl9 tbl40"><p>In addition to any applicable legislative requirement, ensuring that a meaningful explanation is provided with any decision that resulted in the denial of a benefit, a service, or other regulatory action.</p></td></tr><tr><th class="active" id="tbl47" headers="tbl5">Testing</th><td colspan="4" headers="tbl6 tbl7 tbl8 tbl9 tbl47"><p>Before going into production, develop the appropriate processes to ensure that training data is tested for unintended data biases and other factors that may unfairly impact the outcomes.</p><p>Ensure that data being used by the Automated Decision System is routinely tested to ensure that it is still relevant, accurate, and up-to-date.</p></td></tr><tr><th class="active" id="tbl52" headers="tbl5">Monitoring</th><td colspan="4" headers="tbl6 tbl7 tbl8 tbl9 tbl52"><p>Monitor the outcomes of Automated Decision Systems on an ongoing basis to safeguard against unintentional outcomes and to ensure compliance with institutional and program legislation, as well as this Directive</p></td></tr><tr><th class="active" id="tbl57" headers="tbl5">Training</th><td headers="tbl6 tbl57"><p>None</p></td><td headers="tbl7 tbl57"><p>Documentation on the design and functionality of the system</p></td><td headers="tbl8 tbl57"><p>Documentation on the design and functionality of the system.</p><p>Training courses must be completed.</p></td><td headers="tbl9 tbl57"><p>Documentation on the design and functionality of the system.</p><p>Re-occurring training courses.</p><p>A means to verify that training has been completed.</p></td></tr><tr><th class="active" id="tbl65" headers="tbl5">Contingency Planning</th><td colspan="2" headers="tbl6 tbl7 tbl65"><p>None</p></td><td colspan="2" headers="tbl8 tbl9 tbl65"><p>Ensure that contingency plans and/or backup systems are available should the Automated Decision System be unavailable.</p></td></tr><tr><th class="active" id="tbl71" headers="tbl5">Approval for the system to operate</th><td headers="tbl6 tbl71"><p>None</p></td><td headers="tbl7 tbl71"><p>None</p></td><td headers="tbl8 tbl71"><p>Deputy Head</p></td><td headers="tbl9 tbl71"><p>Treasury Board</p></td></tr></tbody></table></appendix></appendices></doc>