What is the GPS antenna port and GPS LED for? Do I always need to connect the GPS antenna?

For location tracking applications connect the GPS antenna to the modem's GPS antenna port.

If location tracking is not required, then no need to connect GPS antenna. The GPS LED is to indicate the status of the GPS after the antenna is connected.