Yes the Audigy has only line out, however it is capable of driving a 32 ohm headphone on its own.
What I did was to connect my sons Nad amp and used the headphone out socket to listen to the Audigy. It sounded pretty much OK but I must say the 580's are really ruthless when it comes to less...