He's not that careless. Give him some credit. However, he does get himself into messy situations that could be avoided.

However, your presence is part of what inspires this low confidence in himself. Your natural aggression towards him and to others is not going to make him want to take a step up in that direction if he thinks that it's wrong for him to do so.