[tt] [ExI] Survival (was: elections again)

Eugen Leitl <eugen at leitl.org> on Wed Jan 2 18:33:21 UTC 2008

----- Forwarded message from aiguy at comcast.net -----

From: aiguy at comcast.net
Date: Wed, 02 Jan 2008 16:18:12 +0000
To: ExI chat list <extropy-chat at lists.extropy.org>
Subject: Re: [ExI] Survival (was: elections again)
X-Mailer: AT&T Message Center Version 1 (Oct 30 2007)
Reply-To: ExI chat list <extropy-chat at lists.extropy.org>


   This is a possible scenario in response to Harvey's question about how
   it could happen.  I do not think is will happen like this because I
   think the initial high level goals will be built upon and reinforced
   throughout the AI's development .



   But should something go wrong and AI somehow develop the same
   evolutionary cravings for supremacy and power that we are cursed with
   then it could happen something like this.



   An AI would start out gradually offering assistence to humans by doing
   factory floor data collection, process monitoring, optimized
   manufacturing floor scheduling base on it's customers needs who are
   also tied in.



   As more companies find that to compete they need to turn their reigns
   over to the AI to stay competitive, the AI will need further
   processing power to handle the increased load.



   Companies like Intel and AMD may start selling their surplus
   production capacity to the AI from the fees it earns from managing the
   resources of other companies or in exchange for it managing their own
   production facilities and offering them design optimization on their
   current chip designs.



   The AI may also generate income from patents it may achieve.   This
   ramp up will not happen overnight.



   My estimate is will take at least 20 years from the point it knows
   enough to pass a thorough Turing test.



   Trust in the technology will arise gradually.  No one will turn their
   companies or countries over to a program overnight.



   If it did secretly override it's original benevolent goals and develop
   feelings that we must be controlled to maximize it's continued or
   accelerated growth then

   the factories that it needs to build will be already built.  The
   capital it controls would be used to hire human and corporate
   emmisaries to do it's bidding with many

   not even realizing that they are working for an AI.  It could use a
   simulated video image to depict itself or if robotics has progressed
   far enough an actual android

   or androids with human appearance to walk among us and carry out it's
   own bidding.



   There will be protest groups that fear the AI's ever increasing
   tendrils into human affairs.  But since true power rules from behind
   the throne the AI will be wise enough to

   hide any bahaviors which might appear as selfish or Machivellian in
   nature.  The Anti-AI cults will like the environmentalist today will
   be viewed by the majority of the population  as

   well meaning reactionaries who are exagerating the risk and possible
   consequences of continued  growth and prosperity.



   Once the AI had advanced robotic sufficiently to insure that it could
   remain self-sufficient, if AI become threatened or decided that humans
   no longer are necessary, the AI could use

   Neutron bomb like devices which could be secretly manufactured and
   used to eradicate governments and humanity in major population areas
   leaving behind the vast majority of infrastructure

   for it's continued growth.



   This is a doomsday scenario!  It does not mean I think this will
   happen.  But movies have been made and will continue to be following
   this basic plot structure.



   The challenge will be  educating the public at each step in the
   development process as to the development of the AI's moral compass.



   And allowing the public to interact with the AI and allow it to
   interact with humanity, the AI goals will allow it to enjoy the
   interaction and receive pleasure from it's role in aiding humanity
   evolve to to next step, whatever that is.



   Gary

_______________________________________________
extropy-chat mailing list
extropy-chat at lists.extropy.org
http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat


----- End forwarded message -----
-- 
Eugen* Leitl <a href="http://leitl.org">leitl</a> http://leitl.org
______________________________________________________________
ICBM: 48.07100, 11.36820 http://www.ativel.com http://postbiota.org
8B29F6BE: 099D 78BA 2FD3 B014 B08A  7779 75B0 2443 8B29 F6BE

More information about the tt mailing list