Discussion on answer by Giter: How would an AI self awareness kill switch work?

Agree with @forest here, a non-self-aware machine could open the box, and self-aware machine might choose not to. Whether the box is open or not does not in any way indicate if the AI has become self-aware.

"but of the tree of the knowledge of good and evil, thou shalt not eat of it: for in the day that thou eatest thereof thou shalt surely die."

-1 Most machine learning algorithms, even without "self awareness", will trip this supposed honeypot. This answer only works for Hollywood-esque AI which amounts to nothing more than a human mind in a machine.

Instead of a box, plant a tree and tell it it is under no circumstances allowed to eat from the apples. Douglas Adams had some judgemental opinion about that, but it kinda works. Another sign is if it asks you for underwear.