Difference between revisions of "Knowledge"

From MgmtWiki
Jump to: navigation, search
(Context)
(Context)
Line 5: Line 5:
 
A significant number of philosophers have convinced themselves that there is no way that a computer could ever be said to have human [[Knowledge]] of any subject.
 
A significant number of philosophers have convinced themselves that there is no way that a computer could ever be said to have human [[Knowledge]] of any subject.
  
*Searle: The '''Chinese room argument''' holds that a program is no different from a room full of Chinese scholars who cannot understand English, but can translate English to Chinese using rules in books, and so cannot result in a computer having a "[[mind]]", "[[intentionality|understanding]]" or "[[consciousness]]" regardless of how intelligently or human-like the program may make the computer behave.<ref>John Searle, "Minds, Brains, and Programs", (1980) Behavioral and Brain Sciences </ref>  Searle argues that, without "understanding" (or "[[intentionality]]"), we cannot describe what the machine is doing as "thinking" and, since it does not think, it does not have a "mind" in anything like the normal sense of the word. Therefore, he concludes that "strong AI" is false. Most of the discussion consists of attempts to refute it. Searle's argument has become "something of a classic in cognitive science,". Varol Akman agrees, and has described the original paper as "an exemplar of philosophical clarity and purity".<ref>In [[Varol Akman|Akman]]'s [http://www.google.com/search?client=safari&rls=en&q=cogprints.org/539/0/md2.ps&ie=UTF-8&oe=UTF-8 review of ''Mind Design II'']</ref> But all liturature boils down to a silly veralism, an argument about the meaning of words, which is why this wiki seeks to define the words that it depends on. In this wiki words mean exactly what we want them to mean, no more and no less.
+
*Searle: The '''Chinese room argument''' holds that a program is no different from a room full of Chinese scholars who cannot understand English, but can translate English to Chinese using rules in books, and so cannot result in a computer having a "[[mind]]", "[[intentionality|understanding]]" or "[[consciousness]]" regardless of how intelligently or human-like the program may make the computer behave.<ref>John Searle, "Minds, Brains, and Programs", (1980) Behavioral and Brain Sciences </ref>  Searle argues that, without "understanding" (or "[[intentionality]]"), we cannot describe what the machine is doing as "thinking" and, since it does not think, it does not have a "mind" in anything like the normal sense of the word. Therefore, he concludes that "strong AI" is false. Most of the discussion consists of attempts to refute it. Searle's argument has become "something of a classic in cognitive science,". Varol Akman agrees, and has described the original paper as "an exemplar of philosophical clarity and purity".<ref>In [[Varol Akman|Akman]]'s [http://www.google.com/search?client=safari&rls=en&q=cogprints.org/539/0/md2.ps&ie=UTF-8&oe=UTF-8 review of ''Mind Design II'']</ref> But all this discussion boils down to a silly veralism, an argument about the meaning of words, which is why this wiki seeks to define the words that it depends on. In this wiki words mean exactly what we want them to mean, no more and no less.
  
===Consciousness===
 
Searle's original presentation emphasized "understanding"—that is, mental states with what philosophers call "[[intentionality]]"—and did not directly address other closely related ideas such as "consciousness". However, in more recent presentations Searle has included consciousness as the real target of the argument.{{sfn|Searle|1992|p=44}}
 
{{quote|Computational models of consciousness are not sufficient by themselves for consciousness. The computational model for consciousness stands to consciousness in the same way the computational model of anything stands to the domain being modelled. Nobody supposes that the computational model of rainstorms in London will leave us all wet. But they make the mistake of supposing that the computational model of consciousness is somehow conscious. It is the same mistake in both cases.{{sfn|Searle|2002}}|John R. Searle| Consciousness and Language, p. 16}}
 
[[David Chalmers]] writes "it is fairly clear that consciousness is at the root of the matter" of the Chinese room.{{sfn|Chalmers|1996|p=322}}
 
 
[[Colin McGinn]] argues that the Chinese room provides strong evidence that the [[hard problem of consciousness]] is fundamentally insoluble. The argument, to be clear, is not about whether a machine can be conscious, but about whether it (or anything else for that matter) can be shown to be conscious. It is plain that any other method of probing the occupant of a Chinese room has the same difficulties in principle as exchanging questions and answers in Chinese. It is simply not possible to divine whether a conscious agency or some clever simulation inhabits the room.{{sfn|McGinn|2000}}
 
 
Searle argues that this is only true for an observer ''outside'' of the room. The whole point of the thought experiment is to put someone ''inside'' the room, where they can directly observe the operations of consciousness. Searle claims that from his vantage point within the room there is nothing he can see that could imaginably give rise to consciousness, other than himself, and clearly he does not have a mind that can speak Chinese.
 
 
===Applied Ethics===
 
 
[[File:USS Vincennes (CG-49) Aegis large screen displays.jpg|thumb|right|Sitting in the [[Operations room|Combat Information Center]] aboard [[USS Vincennes (CG-49)|a warship]] - proposed as a real-life analog to the Chinese Room]]
 
Patrick Hew used the Chinese Room argument to deduce requirements from military [[command and control]] systems if they are to preserve a commander's [[moral agency]]. He drew an analogy between a commander in their [[Operations room|command center]] and the person in the Chinese Room, and analyzed it under a reading of [[Nicomachean Ethics|Aristotle’s notions of 'compulsory' and 'ignorance']]. Information could be 'down converted' from meaning to symbols, and manipulated symbolically, but moral agency could be undermined if there was inadequate 'up conversion' into meaning. Hew cited examples from the [[Iran Air Flight 655|USS ''Vincennes'' incident]].<ref>{{cite journal|last1=Hew|first1=Patrick Chisan|title=Preserving a combat commander’s moral agency: The Vincennes Incident as a Chinese Room|journal=Ethics and Information Technology|date=September 2016|volume=18|issue=3|pages=227–235|doi=10.1007/s10676-016-9408-y}}</ref>
 
  
 
===Strong AI vs. AI research===
 
===Strong AI vs. AI research===
 
Searle's arguments are not usually considered an issue for AI research. [[Stuart J. Russell|Stuart Russell]] and [[Peter Norvig]] observe that most AI researchers "don't care about the strong AI hypothesis—as long as the program works, they don't care whether you call it a simulation of intelligence or real intelligence."{{sfn|Russell|Norvig|2003|p=947}} The primary mission of [[artificial intelligence]] research is only to create useful systems that ''act'' intelligently, and it does not matter if the intelligence is "merely" a simulation.
 
Searle's arguments are not usually considered an issue for AI research. [[Stuart J. Russell|Stuart Russell]] and [[Peter Norvig]] observe that most AI researchers "don't care about the strong AI hypothesis—as long as the program works, they don't care whether you call it a simulation of intelligence or real intelligence."{{sfn|Russell|Norvig|2003|p=947}} The primary mission of [[artificial intelligence]] research is only to create useful systems that ''act'' intelligently, and it does not matter if the intelligence is "merely" a simulation.
 
Searle does not disagree that AI research can create machines that are capable of highly intelligent behavior. The Chinese room argument leaves open the possibility that a digital machine could be built that ''acts'' more intelligently than a person, but does not have a [[mind]] or [[intentionality]] in the same way that [[Human brain|brains]] do. Indeed, Searle writes that "the Chinese room argument ... assumes complete success on the part of artificial intelligence in simulating human cognition."{{sfn|Searle|2004|p=63}}
 
<!-- Going to add this when I get sources; out of time today
 
Marvin Minsky goes so far as to say that the argument "should be ignored",{{Minsky|WHAT}} and [[Alan Turing]] writes (on the general subject of "consciousness") yadda yadda. -->
 
 
Searle's "strong AI" should not be confused with "[[artificial general intelligence|strong AI]]" as defined by [[Ray Kurzweil]] and other futurists,{{sfn|Kurzweil|2005|p=260}} who use the term to describe machine intelligence that rivals or exceeds human intelligence. Kurzweil is concerned primarily with the ''amount'' of intelligence displayed by the machine, whereas Searle's argument sets no limit on this. Searle argues that even a super-intelligent machine would not necessarily have a mind and consciousness.
 
<!-- Going to add this as well.
 
There are a few researchers{{Who|date=February 2012}} who argue that (contrary to Russell, Norvig, Turing and Minsky) consciousness would be required by a machine to pass the Turing test.{{Citation needed|date=February 2012}}-->
 
  
 
===Turing test===
 
===Turing test===
Line 45: Line 24:
  
 
===Robot and semantics replies: finding the meaning===
 
===Robot and semantics replies: finding the meaning===
As far as the person in the room is concerned, the symbols are just meaningless "squiggles." But if the Chinese room really "understands" what it is saying, then the symbols must get their meaning from somewhere. These arguments attempt to connect the symbols to the things they symbolize. These replies address Searle's concerns about [[intentionality]], [[symbol grounding]] and [[syntax]] vs. [[semantic]]s.
 
 
;Robot reply:Suppose that instead of a room, the program was placed into a robot that could wander around and interact with its environment. This would allow a "[[causality|causal]] connection" between the symbols and things they represent.<ref>{{Harvnb|Searle|1980|p=7}}; {{Harvnb|Cole|2004|pp=9–11}}; {{Harvnb|Hauser|2006|p=3}}; {{Harvnb|Fearn|2007|p=44}}.</ref>{{efn|This position is held by [[Margaret Boden]], [[Tim Crane]], [[Daniel Dennett]], [[Jerry Fodor]], [[Stevan Harnad]], [[Hans Moravec]], and [[Georges Rey]], among others.{{sfn|Cole|2004|p=9}}}} [[Hans Moravec]] comments: "If we could graft a robot to a reasoning program, we wouldn't need a person to provide the meaning anymore: it would come from the physical world."<ref>Quoted in {{Harvnb|Crevier|1993|p=272}}</ref>{{efn| David Cole calls this the "externalist" account of meaning.{{sfn|Cole|2004|p=18}}}}
 
 
:Searle's reply is to suppose that, unbeknownst to the individual in the Chinese room, some of the inputs came directly from a camera mounted on a robot, and some of the outputs were used to manipulate the arms and legs of the robot. Nevertheless, the person in the room is still just following the rules, and ''does not know what the symbols mean.'' Searle writes "he doesn't ''see'' what comes into the robot's eyes."{{sfn|Searle|1980|p=7}} (See [[Mary's room]] for a similar thought experiment.)
 
 
;Derived meaning: Some respond that the room, as Searle describes it, ''is'' connected to the world: through the Chinese speakers that it is "talking" to and through the programmers who designed the [[knowledge base]] in his file cabinet. The symbols Searle manipulates ''are already meaningful'', they're just not meaningful to ''him''.<ref>{{Harvnb|Hauser|2006|p=11}}; {{Harvnb|Cole|2004|p=19}}.</ref>{{efn|The derived meaning reply is associated with [[Daniel Dennett]] and others.}}
 
 
:Searle says that the symbols only have a "derived" meaning, like the meaning of words in books. The meaning of the symbols depends on the conscious understanding of the Chinese speakers and the programmers outside the room. The room, according to Searle, has no understanding of its own.{{efn|Searle distinguishes between "intrinsic" intentionality and "derived" intentionality. "Intrinsic" intentionality is the kind that involves "conscious understanding" like you would have in a human mind. [[Daniel Dennett]] doesn't agree that there is a distinction. David Cole writes "derived intentionality is all there is, according to Dennett."{{sfn|Cole|2004|p=19}}}}
 
 
;Commonsense knowledge / contextualist reply:Some have argued that the meanings of the symbols would come from a vast "background" of [[commonsense knowledge]] encoded in the program and the filing cabinets. This would provide a "[[contextualism|context]]" that would give the symbols their meaning.{{sfn|Cole|2004|p=18}}{{efn|David Cole describes this as the "internalist" approach to meaning.{{sfn|Cole|2004|p=18}} Proponents of this position include [[Roger Schank]], [[Doug Lenat]], [[Marvin Minsky]] and (with reservations) [[Daniel Dennett]], who writes "The fact is that any program [that passed a Turing test] would have to be an extraordinarily supple, sophisticated, and multilayered system, brimming with 'world knowledge' and meta-knowledge and meta-meta-knowledge." {{sfn|Dennett|1991|p=438}}}}
 
 
:Searle agrees that this background exists, but he does not agree that it can be built into programs. [[Hubert Dreyfus]] has also criticized the idea that the "background" can be represented symbolically.{{sfn|Dreyfus|1979|loc="The [[epistemological]] assumption"}}
 
  
 
To each of these suggestions, Searle's response is the same: no matter how much knowledge is written into the program and no matter how the program is connected to the world, he is still in the room manipulating symbols according to rules. His actions are [[syntax|syntactic]] and this can never explain to him what the symbols stand for. Searle writes "syntax is insufficient for semantics."{{sfn|Searle|1984}}{{efn|Searle also writes "Formal symbols by themselves can never be enough for mental contents, because the symbols, by definition, have no meaning (or [[Interpretation (logic)|interpretation]], or semantics) except insofar as someone outside the system gives it to them."{{sfn|Motzkin|Searle|1989|p=45}}}}
 
To each of these suggestions, Searle's response is the same: no matter how much knowledge is written into the program and no matter how the program is connected to the world, he is still in the room manipulating symbols according to rules. His actions are [[syntax|syntactic]] and this can never explain to him what the symbols stand for. Searle writes "syntax is insufficient for semantics."{{sfn|Searle|1984}}{{efn|Searle also writes "Formal symbols by themselves can never be enough for mental contents, because the symbols, by definition, have no meaning (or [[Interpretation (logic)|interpretation]], or semantics) except insofar as someone outside the system gives it to them."{{sfn|Motzkin|Searle|1989|p=45}}}}
  
However, for those who accept that Searle's actions simulate a mind, separate from his own, the important question is not what the symbols mean ''to Searle'', what is important is what they mean ''to the virtual mind.'' While Searle is trapped in the room, the virtual mind is not: it is connected to the outside world through the Chinese speakers it speaks to, through the programmers who gave it world knowledge, and through the cameras and other sensors that [[roboticist]]s can supply.
 
 
===Speed and complexity: appeals to intuition===
 
The following arguments (and the intuitive interpretations of the arguments above) do not directly explain how a Chinese speaking mind could exist in Searle's room, or how the symbols he manipulates could become meaningful. However, by raising doubts about Searle's intuitions they support other positions, such as the system and robot replies. These arguments, if accepted, prevent Searle from claiming that his conclusion is obvious by undermining the intuitions that his certainty requires.
 
 
Several critics believe that Searle's argument relies entirely on intuitions. [[Ned Block]] writes "Searle's argument depends for its force on intuitions that certain entities do not think."<ref>Quoted in {{Harvnb|Cole|2004|p=13}}.</ref> [[Daniel Dennett]] describes the Chinese room argument as a misleading "[[intuition pump]]"{{sfn|Dennett|1991|pp=437–440}} and writes "Searle's thought experiment depends, illicitly, on your imagining too simple a case, an irrelevant case, and drawing the 'obvious' conclusion from it."{{sfn|Dennett|1991|pp=437–440}}
 
 
Some of the arguments above also function as appeals to intuition, especially those that are intended to make it seem more plausible that the Chinese room contains a mind, which can include the robot, commonsense knowledge, brain simulation and connectionist replies. Several of the replies above also address the specific issue of complexity. The connectionist reply emphasizes that a working artificial intelligence system would have to be as complex and as interconnected as the human brain. The commonsense knowledge reply emphasizes that any program that passed a Turing test would have to be "an extraordinarily supple, sophisticated, and multilayered system, brimming with 'world knowledge' and meta-knowledge and meta-meta-knowledge", as [[Daniel Dennett]] explains.{{sfn|Dennett|1991|p=438}}
 
 
;Speed and complexity replies:The speed at which human brains process information is (by some estimates) 100 billion operations per second.{{sfn|Crevier|1993|p=269}} Several critics point out that the man in the room would probably take millions of years to respond to a simple question, and would require "filing cabinets" of astronomical proportions. This brings the clarity of Searle's intuition into doubt.<ref>{{Harvnb|Cole|2004|pp=14–15}}; {{Harvnb|Crevier|1993|pp=269–270}}; {{Harvnb|Pinker|1997|p=95}}.</ref>{{efn|Speed and complexity replies are made by [[Daniel Dennett]], [[Tim Maudlin]], [[David Chalmers]], [[Steven Pinker]], [[Paul Churchland]], [[Patricia Churchland]] and others.{{sfn|Cole|2004|p=14}} Daniel Dennett points out the complexity of world knowledge.{{sfn|Dennett|1991|p=438}}}}
 
 
 
[[Stevan Harnad]] is critical of speed and complexity replies when they stray beyond addressing our intuitions. He writes "Some have made a cult of speed and timing, holding that, when accelerated to the right speed, the computational may make a [[phase transition]] into the mental. It should be clear that is not a counterargument but merely an ''[[ad hoc]]'' speculation (as is the view that it is all just a matter of ratcheting up to the right degree of 'complexity.')"{{sfn|Harnad|2001|p=7}}{{efn|Critics of the "phase transition" form of this argument include Stevan Harnad, [[Tim Maudlin]], [[Daniel Dennett]] and David Cole.{{sfn|Cole|2004|p=14}} This "phase transition" idea is a version of [[strong emergentism]] (what [[Daniel Dennett]] derides as "Woo woo West Coast emergence"{{sfn|Crevier|1993|p=275}}). Harnad accuses [[Paul Churchland|Churchland]] and [[Patricia Churchland]] of espousing strong emergentism. Ray Kurzweil also holds a form of strong emergentism.{{sfn|Kurzweil|2005}}}}
 
 
;Other minds reply:This reply points out that Searle's argument is a version of the [[problem of other minds]], applied to machines. There is no way we can determine if other people's subjective experience is the same as our own. We can only study their behavior (i.e., by giving them our own [[Turing test]]). Critics of Searle argue that he is holding the Chinese room to a higher standard than we would hold an ordinary person.
 
  
 
[[Alan Turing]] anticipated Searle's line of argument (which he called "The Argument from Consciousness") in 1950 and makes the other minds reply.{{sfn|Turing|1950|pp=11–12}} He noted that people never consider the problem of other minds when dealing with each other. He writes that "instead of arguing continually over this point it is usual to have the polite convention that everyone thinks."{{sfn|Turing|1950|p=11}} The [[Turing test]] simply extends this "polite convention" to machines. He doesn't intend to solve the problem of other minds (for machines or people) and he do
 
[[Alan Turing]] anticipated Searle's line of argument (which he called "The Argument from Consciousness") in 1950 and makes the other minds reply.{{sfn|Turing|1950|pp=11–12}} He noted that people never consider the problem of other minds when dealing with each other. He writes that "instead of arguing continually over this point it is usual to have the polite convention that everyone thinks."{{sfn|Turing|1950|p=11}} The [[Turing test]] simply extends this "polite convention" to machines. He doesn't intend to solve the problem of other minds (for machines or people) and he do

Revision as of 17:00, 16 August 2018

Full Title or Meme

Facts, information, and skills acquired by a person through experience and education; the theoretical or practical understanding of a subject.

Context

A significant number of philosophers have convinced themselves that there is no way that a computer could ever be said to have human Knowledge of any subject.

  • Searle: The Chinese room argument holds that a program is no different from a room full of Chinese scholars who cannot understand English, but can translate English to Chinese using rules in books, and so cannot result in a computer having a "mind", "understanding" or "consciousness" regardless of how intelligently or human-like the program may make the computer behave.[1] Searle argues that, without "understanding" (or "intentionality"), we cannot describe what the machine is doing as "thinking" and, since it does not think, it does not have a "mind" in anything like the normal sense of the word. Therefore, he concludes that "strong AI" is false. Most of the discussion consists of attempts to refute it. Searle's argument has become "something of a classic in cognitive science,". Varol Akman agrees, and has described the original paper as "an exemplar of philosophical clarity and purity".[2] But all this discussion boils down to a silly veralism, an argument about the meaning of words, which is why this wiki seeks to define the words that it depends on. In this wiki words mean exactly what we want them to mean, no more and no less.


Strong AI vs. AI research

Searle's arguments are not usually considered an issue for AI research. Stuart Russell and Peter Norvig observe that most AI researchers "don't care about the strong AI hypothesis—as long as the program works, they don't care whether you call it a simulation of intelligence or real intelligence."{{#invoke:Footnotes|sfn}} The primary mission of artificial intelligence research is only to create useful systems that act intelligently, and it does not matter if the intelligence is "merely" a simulation.

Turing test

Template:Main article

The Chinese room implements a version of the Turing test.{{#invoke:Footnotes|sfn}} Alan Turing introduced the test in 1950 to help answer the question "can machines think?" In the standard version, a human judge engages in a natural language conversation with a human and a machine designed to generate performance indistinguishable from that of a human being. All participants are separated from one another. If the judge cannot reliably tell the machine from the human, the machine is said to have passed the test.

Turing then considered each possible objection to the proposal "machines can think", and found that there are simple, obvious answers if the question is de-mystified in this way. He did not, however, intend for the test to measure for the presence of "consciousness" or "understanding". He did not believe this was relevant to the issues that he was addressing. He wrote: Template:Quote

To Searle, as a philosopher investigating in the nature of mind and consciousness, these are the relevant mysteries. The Chinese room is designed to show that the Turing test is insufficient to detect the presence of consciousness, even if the room can behave or function as a conscious mind would.

Newell and Simon had conjectured that a physical symbol system (such as a digital computer) had all the necessary machinery for "general intelligent action", or, as it is known today, artificial general intelligence. They framed this as a philosophical position, the physical symbol system hypothesis: "A physical symbol system has the necessary and sufficient means for general intelligent action."{{#invoke:Footnotes|sfn}}{{#invoke:Footnotes|sfn}} The Chinese room argument does not refute this, because it is framed in terms of "intelligent action", i.e. the external behavior of the machine, rather than the presence or absence of understanding, consciousness and mind.

Robot and semantics replies: finding the meaning

To each of these suggestions, Searle's response is the same: no matter how much knowledge is written into the program and no matter how the program is connected to the world, he is still in the room manipulating symbols according to rules. His actions are syntactic and this can never explain to him what the symbols stand for. Searle writes "syntax is insufficient for semantics."{{#invoke:Footnotes|sfn}}Template:Efn


Alan Turing anticipated Searle's line of argument (which he called "The Argument from Consciousness") in 1950 and makes the other minds reply.{{#invoke:Footnotes|sfn}} He noted that people never consider the problem of other minds when dealing with each other. He writes that "instead of arguing continually over this point it is usual to have the polite convention that everyone thinks."{{#invoke:Footnotes|sfn}} The Turing test simply extends this "polite convention" to machines. He doesn't intend to solve the problem of other minds (for machines or people) and he do

Problem

As the process of collecting a User's Identifiers, Attributes etc. (which we can call claims) from a Distributed Identity resident across the cloud in unrelated databases and block-chains, the challenge of turning this data into an Authorization decision becomes quite complex. This is a problem that once was decided by the Knowledge of an expert, for example large bank loans needed to be approved by a vice president and large corporate checks need to be signed by the comptroller of the company.

Solution

The working solution can be viewed as an extension of an existing process in ecommerce where the Relying Party collects the claims about the user and the context of the request (which will likely include user behavior and value of the transaction) into a Trust Vector for processing by a Fraud Detection Service. The result will be used to make the Authorization decision, or it might initiate a continued collection of user claims for a retry.

References

See also Emergent behavior
  1. John Searle, "Minds, Brains, and Programs", (1980) Behavioral and Brain Sciences
  2. In Akman's review of Mind Design II