Strong Self-Modification
From AGIRI.org
By strong self-modification is meant the ability of a mind to modify all of its cognitive processes in all of their aspects of operation.
Humans cannot do this, no matter how self-actualized they may become. AGIs, properly designed and educated, should be able to, one day.
Strong self-modification presents a serious challenge in terms of ensuring Friendly AI.

