1 - we have advanced to autonomous robots on the battlefield -- just ask the russians ;0 (if you believe them)
2 - A friend and I had a very deep conversation about AI the other day... I used to fear and no longer do. Human desires, motivations - the 'caring' Rick mentions in prior post - these are all derived from our chemically driven, hormonally charged nuerochemical factories we call brains, and is the foundation upon which our intelligence rests.
In the case of 'artificial intelligence', where there is no biophysics (my word) going on... what are the motivating factors?? Only what we program in, as far as I can tell. Even self-preservation wouldn't be there if we didn't put it there to start.
I haven't read much in the realm of psychology as I don't like the content providers much, but isn't it possible that self-awareness requires that biophysic foundation?
Now, don't get me wrong, robots can be truly autonomous and fully capable of intelligence (see IBM Watson's or the russian combat bots), but my point is... the AI can't be truly aware & self-motivated if it's just a non-biological construct.
And yes, I'm familiar with the Turing test ;0 I'm just recently convinced that a pure construct AI won't be able to pass it AND demonstrate self-awareness, self-motivation, and self-discipline.