Story image

Is there room for ethics in the ‘Wild West’ of AI?

13 Jun 2018

Wherever the future of artificial intelligence (AI) is discussed, ethics is never far behind.

With AI being the hottest topic at the 2018 SAS Users of NZ (SUNZ) conference, on yesterday at the Michael Fowler Centre in Wellington, the expert panel on ethics covered a range of fascinating and important questions.

SAS director of product management for cloud and platform technologies Mike Frost is one of the experts, taking his seat directly after delivering the opening keynote.

Matthew Spencer and Rohan Light complete the panel, the Ministry of Social Development (MSD) chief analytics officer, and responsible information use lead advisor, respectively.

Finally, Tenzing management consulting director Eugene Cash acts as moderator.

They decide on a working definition of ethics - ‘knowing the difference between what you have a right to do, and what is right to do,’ an apt one for the purposes of the discussion.

Spencer begins the conversation by talking about the MSD's attempts to guide ethical decision making with the Privacy, Human Rights and Ethics Framework (PHRaE).

The PHRaE is under development by the MSD to help organisations make “early decisions to not progress initiatives, or to accept risk if value outweighs risk, can be made if risks cannot be mitigated,” according to the PHRaE information sheet.

This line of discussion leads to the development of the controversial Google Duplex which is able to pose as a human on a phone call and was debuted to wild applause without thought to the myriad of ramifications this technology could have.

Cash asks the panellists, does this show that Silicon Valley is ‘ethically rudderless’?

“I think that this is pretty typical of some organisations,” Frost replies.

“They will try something and then, based on the reaction, they’ll withdraw and pull back and say ‘we had a right to do it, but maybe we weren’t right to do it.

“Do I think that Google cares about the ethics of that? No, they’re like us - they’re trying to sell software… I don’t think that’s the right way, I think we should be more proactive rather than reactive… but right now it’s a bit of a wild west, and that’s how this self-governance materialises.”

Spencer points to another controversial use-case of AI as an example of how things can go wrong - the US courts using the COMPAS (Correctional Offender Management Profiling for Alternative Sanctions) system to aid judges in deciding whether a defendant would be likely to re-offend and then sentencing them accordingly.

He notes that in a study on the efficacy of AI, humans had an AUR (a statistical measure of how accurate something is when choosing between two options) of .76, AI given the same task received a score of .82, but human and AI together managed .90.

Whether this is right or wrong is not the point here - what it shows, Spencer says, is that if we are going to use AI to aid important decisions, adding human intelligence to the mix is vitally important.

A bit of humanity is also the solution suggested for perhaps the biggest ethical concern for AI - bigotry.

If the data that we feed into an AI is inherently skewed toward or against a certain kind of person, the results will be just as skewed.

The key to avoiding AI echoing these biases is “human plus AI and constant calibration,” Light says.

“There should always be a human involved with the evolution of AI. If you don’t have that then the chance that it goes astray increases.”

Light also astutely notes the sadly common irony of four white men in suits discussing issues of bigotry and makes it clear that diversity is also an important ingredient in this recipe.

Frost suggests the possibility of a medicine-style panel of ethics for data scientists that would be in charge of reviewing uses for AI to ensure that they are staying within an ethical framework.

At the end of the half an hour panel, the discussion comes to an abrupt end with a dozen thoughts on ethics and AI half explored.

The main takeaway is that there is still a long way to go.

The panel comes together in agreement that as we move forward, an ethical perspective needs to be an integral part of the development and implementation of AI - but they also recognise that ethics are slippery and culturally specific.

As Frost says, at the end of the day, “Every community will have to set their own standards for what is an appropriate use of technology.”

Correction - in the original posting of this story it was erroneously stated that the AUR data came from a study on COMPAS - Spencer clarified, "I referenced the  COMPAS issue as an example of how things can go wrong. I also referenced, as a separate example, a study from MIT to illustrate how humans and machines may work together to offer a superior solution in some circumstances. The human factor in the loop allows for greater oversight."

Dynatrace takes pole position in APM Magic Quadrant
It placed highest on Ability to Execute and furthest on Completeness of Vision in the 2019 Quadrant for Application Performance Monitoring (APM).
HCL and Xerox expand strategic partnership
Under the terms of the agreement, HCL will manage portions of Xerox’s shared services, including global administrative and support functions.
Avaya expands integration with Google Cloud AI
This includes embedding Google’s machine learning within conversation services for the contact centre, enabling integration of AI capabilities.
Forrester names Crowdstrike leader in incident response
The report provides an in-depth evaluation of the top 15 IR service providers across 11 criteria.
Poly appoints new A/NZ managing director, Andy Hurt
“We’re excited to be bringing together two established pioneers in audio and video technology to be moving forward and one business – Poly."
Gartner: Local server revenue up by a quarter, shipments down
In Australia, server revenue increased 24.7% in 4Q18, while shipments declined 5.3%.
HPE launches 'right mix' hybrid cloud assessment tool
HPE has launched an ‘industry-first assessment software’ to help businesses work out the right mix of hybrid cloud for their needs.
IDC: Innovative wearable use cases drive double-digit growth
Wristbands are set to lose their dominance as hearables and industrial applications keep the wearables market moving forward.