Turn your project on with a momentary switch.

This uses a FET to switch the supply, it uses the arduino to keep the fet latched so you can soft power off as well. The button also acts as an input button, a long press powers down.

 

Take from jp_boardrides circuit on instructables.