Difference between revisions of "Explanation"
From MgmtWiki
(→Solutions) |
(→Solutions) |
||
| Line 9: | Line 9: | ||
==Solutions== | ==Solutions== | ||
* The only possible explanation would be one that was made at the same time as the choice, but even then, as Malcom Gladwell explained in his book ''Blink''<ref>Malcom Gladwell, ''Blink: The Power of Thinking Without Thinking'' (2022-04-05) ASIN B00097DWY0</ref> the choice might have been make very early and the explanation later. | * The only possible explanation would be one that was made at the same time as the choice, but even then, as Malcom Gladwell explained in his book ''Blink''<ref>Malcom Gladwell, ''Blink: The Power of Thinking Without Thinking'' (2022-04-05) ASIN B00097DWY0</ref> the choice might have been make very early and the explanation later. | ||
| + | * In Daniel Kahneman's work blink is called "system 1" which, like neural networks, makes rapid, heuristic, decisions, and the more rigorous and methodic "system 2" come into play, perhaps after the decision is made and "second thoughts" come into play. | ||
* Yann LeCun, chief AI scientist considers widespread concerns about explanations about how an AI works to be a "non-issue". If user Adopt "self-supervised learning, things that are not trained for a give task, but are trained generically, the problems disappear. <ref name="Monroe" /> This sounds like the arrogance of the technologist. | * Yann LeCun, chief AI scientist considers widespread concerns about explanations about how an AI works to be a "non-issue". If user Adopt "self-supervised learning, things that are not trained for a give task, but are trained generically, the problems disappear. <ref name="Monroe" /> This sounds like the arrogance of the technologist. | ||
Revision as of 13:24, 2 October 2022
Full Title or Meme
Artificial Intelligence engines are being asked for an Explanation of how they came to a decision. Does that make any sense?
Context
Problems
- It is well known that users are likely to leave checkboxes as they were if that speeds up the process. For example, both the Dutch and the Belgium driver's license show a check box for organ donation. The Dutch box is initially unchecked, the Belgian box is initially checked. The Dutch acceptance of organ donation is 27%, the Belgium acceptance in 98%. When people were asked to make an Explanation their choice, they typically were able to make a cogent explanation of their "choice".[1] What possible value could that explanation be to understanding?
- For ethical and safety reason, users often expect an explanation of how the networks came to a conclusion in medical, financial, legal and military applications.[2]
Solutions
- The only possible explanation would be one that was made at the same time as the choice, but even then, as Malcom Gladwell explained in his book Blink[3] the choice might have been make very early and the explanation later.
- In Daniel Kahneman's work blink is called "system 1" which, like neural networks, makes rapid, heuristic, decisions, and the more rigorous and methodic "system 2" come into play, perhaps after the decision is made and "second thoughts" come into play.
- Yann LeCun, chief AI scientist considers widespread concerns about explanations about how an AI works to be a "non-issue". If user Adopt "self-supervised learning, things that are not trained for a give task, but are trained generically, the problems disappear. [2] This sounds like the arrogance of the technologist.
Reverences
- ↑ Justin Gregg, If Nietzsche were a Narwhal Little Brown (2022-08) ISBN 978-0316388061
- ↑ 2.0 2.1 Dan Monroe, Neurosymbolic AI, CACM 65 No 10 pp 11-12 (2022-10)
- ↑ Malcom Gladwell, Blink: The Power of Thinking Without Thinking (2022-04-05) ASIN B00097DWY0
