There are two types of voice chat in Halo 2:

Broadcast Voice
Broadcast Voice works like teamspeak. You press a button and your voice goes to your teammates.

Proximity Voice
Proximity Voice means that players nearby can hear you speak. It appears that this is always on.