Now that I am driving I realize that there is an unwritten agreement between drivers on the road that not everybody follows.

The agreement goes like this. Hey, we're both driving huge hunks of metal (or fiberglass) on wheels; Let's not do anything crazy. Unfortunately, this is not always the case.