Artificial Intelligence: A Mathematical Watcher Over AI

July 30, 2020 | Artificial Intelligence, News

Researchers come up with an “ethical eye” on artificial intelligence.

Researchers from the University of Warwick, Imperial College London, EPFL (Lausanne), and Sciteb Ltd have devised a mathematical method to watch over AI and the possibility that it could adopt unethical strategies. (Science Daily)

Unethical or biased behavior that could prove dangerous

Increasingly, AI is being deployed in commercial situations where it takes decisions or adopts strategies without the supervision of humans. It is highly possible that the algorithm could indulge in unethical or biased behavior. This could expose the organization to legal and financial penalties.

“If an AI aims to maximize risk-adjusted return, then under some conditions it is, to a major extent, likely to pick an unethical strategy unless the objective function allows sufficiently for this risk,” says the paper. Titled “An unethical optimization principle,” it published in Royal Society Open Science on Wednesday 1st July 2020.

The following researchers wrote the paper:

  • Nicholas Beale of Sciteb Ltd;
  • Heather Battey of the Department of Mathematics, Imperial College London;
  • Anthony C. Davison of the Institute of Mathematics,
  • Ecole Polytechnique Fédérale de Lausanne; and
  • Professor Robert MacKay of the Mathematics Institute of the University of Warwick.

How can regulators and businesses reduce the risk of such actions by AI?

“An unethical optimization principle”

Mathematicians and statisticians from the University of Warwick, Imperial, EPFL, and Sciteb Ltd have created a new “Unethical Optimization Principle” and provided a simple formula to estimate its impact.

Professor Robert MacKay of the Mathematics Institute of the University of Warwick said: “Our suggested ‘Unethical Optimization Principle’ can be used to help regulators, compliance staff, and others to find problematic strategies that might be hidden in a large strategy space. Optimization can be expected to choose disproportionately many unethical strategies, an inspection of which should show where problems are likely to arise and thus suggest how the AI search algorithm should be modified to avoid them in future.”

“The Principle also suggests that it may be necessary to re-think the way AI operates in very large strategy spaces so that unethical outcomes are explicitly rejected in the optimization/learning process.”

Related Story: Artificial Intelligence Bias: On Trust, Complexity, and Diversity

Free Industry News

Subscribe to our free newsletter for updates and news about alternatives investments.

  • This field is for validation purposes and should be left unchanged.


Latest Alternative Investment News
Digital Assets: Mike Novogratz Hits Out At Sam Bankman-Fried, Calls For His Prosecution
December 2, 2022     Digital Assets, News

Mike Novogratz, the billionaire CEO of Galaxy Digital (TSE: GLXY), was unequivocally critical about Sam Bankman-Fried’s virtual New York Times (NYT) Dealbook Summit interview. “I’m hoping that the authorities get…
FinTech: Monzo To Turn Profitable In 2023, Says CEO
December 2, 2022     FinTech, News

“We will be profitable in the next financial year,” TS Anil said at the summit on Thursday, though Monzo reported pre-tax losses of £119mn for the 12 months to the…
Artificial Intelligence: OpenAI Launches ChatGPT, A New Conversational AI System
December 2, 2022     Artificial Intelligence, News

OpenAI has unveiled ChatGPT, a new AI system that interacts in a conversational way. As part of a dialogue format, ChatGPT answers followup questions, admits its mistakes, challenges incorrect premises,…
Artificial Intelligence: Monarch’s Electric, Driver-Optional, Smart Tractor Now In Commercial Production

Monarch Tractor has rolled out the first production model of the MK-V tractor that combines electrification, automation, and data analysis to help farmers reduce their carbon footprint, improve field safety,…