Cognitive instabilities under contention, friction, and the fog-of-war challenge the AI revolution

The asymptotic limit theorems of information theory, and related formalism from punctuated equilibrium evolutionary theory, allow exploration of the dynamics of real-time, multi-component, hierarchical, cognitive enterprises - institutional, machine, or man/machine hybrid - under constraints of time...

Full description

Saved in:

Bibliographic Details
Published in:	Connection science 2020-07, Vol.32 (3), p.264-279
Main Author:	Wallace, Rodrick
Format:	Article
Language:	eng
Subjects:	Artificial intelligence Autonomous cars Blindness Clausewitz conflict Information theory punctuated equilibrium rate-distortion theorem Real time Situational awareness symmetry breaking
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	The asymptotic limit theorems of information theory, and related formalism from punctuated equilibrium evolutionary theory, allow exploration of the dynamics of real-time, multi-component, hierarchical, cognitive enterprises - institutional, machine, or man/machine hybrid - under constraints of time, material resources, internal communication, situational awareness, and adversarial intent. Surprisingly direct argument shows such enterprises can almost always be confounded by an opponent with comparatively limited resources, provided it has sufficient situational understanding, adaptive capacity, and resolve. Consequently, there can be no free lunch for AI combat systems, driverless cars on intelligent roads, or other such entities, tasked with the control of real-time critical processes. Intelligent adversaries, resource limitations, "design flaws", inattentional blindness, command stupidity, coevolutionary dynamics, and the like confront all real-time, multi-component cognitive processes. AI systems will not be spared simply by being labelled "high tech" in marketing campaigns.
ISSN:	0954-0091 1360-0494