Using a transistor you can made NOT logic.

When you push the button, the input LED goes on and the output LED goes off.