New Zealand claims world first in setting standards for government use of algorithms

The New Zealand charter, which the Guardian has viewed, was due to launch on Tuesday with 19 government agencies as initial signatories. In it, departments pledge to be publicly transparent about how decision-making is driven by algorithms, including giving “plain English” explanations; to make available information about the processes used and how data is stored unless forbidden by law (such as for reasons of national security); and to identify and manage biases informing algorithms.

Agencies must also consider te ao Māori, or Indigenous, worldviews on data collection – in New Zealand, Māori are disproportionately represented in the justice and prison system – and consult with groups affected by their equations.

“Part of this is driven by the fact that because people are now increasingly aware of how Facebook operates and the extent to which our lives are shaped by the use of and the manipulation of data,” Shaw said, referring to the way social media companies use algorithms to direct users towards content. “This is a really important part of building public trust in government institutions.”

But other bodies that have been the subject of high profile cases in which critics decried the use of algorithms – including the immigration agency, found in March to be profiling applicants by algorithm – and the police, who came under fire from privacy advocates in 2019 for introducing facial recognition technology without announcing it, were not among the signatories. Nor were the country’s spy agencies.

A spokesman for Shaw’s office said no agency had ruled out the charter and that others were expected to sign on later.

The standards do not include an enforcement mechanism. Shaw said he hoped that within months agencies that had signed the charter would provide information on their websites explaining how algorithms were used, even supplying source code – and that if they did not, the public could demand it.

Colin Gavaghan, a law professor at the University of Otago, was involved in the 2019 review that suggested an independent regulator to oversee the use of algorithms by agencies – a move the government has stopped short of in its charter. He said there was “plenty to like” in the new standards and he hoped they could serve as a blueprint for other governments.

“As ever, the devil’s in the detail and that means implementation,” he said. “We still feel like some kind of oversight and regulatory body that should have an all-of-government remit seems like a good idea.”

Gavaghan praised a point in the charter that required agencies to provide a channel to appeal against decisions informed by algorithms, but added that “people might not always know” they had been subject to such decisions, even under the new standards.

Shaw said he believed the document was a world first – no other government had produced standards that would cover all algorithms used by every signatory agency