I assume you mean the water pipe. You need to disconnect the hoses that are going to it and there are 2 bolts holding it in place.

The line I'm talking about, has rubber hose from the low side of the radiator. Connects to the hard pipe, runs underneath the exhaust manifold and towards the water pump.

you're talking about this one and it's the water pipe. I can't recall how easy this would be with the exhaust and turbo in place, but as you can see there is a bolt holding it on just under the #1 exhaust and there's 2 more holding it on at the top of the gearbox to block.
I can only assume it will be a PITA to get out without taking the turbo off as the coolant lines for the turbo will more than likely snap in the pipe if you try to take them out and if you have the turbo lines down, you're pretty much going to stripping alot of the components off the turbo at this point go ahead and drop the turbo and make life easy.
Why do you need to take the pipe off anyway?

It is a PITA to remove without removing the turbo, so I would recommend just pulling the turbo to make more room and make life a little easier.