Toll gates are your prison gates. They are the first indication that you are once again entering your prison, the city. It is quite ironic that you have to fall in line in order to do so.