Well I'm not a fan of Alienware-D(hell) computers especially if you saw my avatar before I switched it. You would see what I think of Mikey Dell and his computers. That said you can try to upgrade this computer and keep sinking money into but at what cost? What you can do with it is very limited and even at that its still not a great mobo, not a great video card, poor ram and slow cpu. I was faced with a problem like you not that long ago. I have a HP computer that I bought because I didn't want to build my own computer. My thinking was I can always upgrade it. Went a head and bought it even though everyone told me to build my own. Man was I dissapointed. The mobo was a junky 50 dollar Foxconn with a slow front bus speed. The ram was 1066 type which is okay but not that fast plus the POS mobo only supported Elpida, Crucial and Kingston 1066 ram and all that was their cheap value brand junk. The computer only supported one video card so you had no CrossfireX support and the whole computer was to small to accept one high end really long videocard like the 6970 or 6990. So after all that I ended up with a computer that I could pretty much do nothing with in terms of upgrading and the parts that were already in there were junk. I could sink alot of money into trying to make that computer faster or I could just build my own. So I know you said you don't have alot of money right now but I would say save up and build your own computer. You're just throwing money into a sink hole and even after that you still have an ok computer for gaming. If you build it yourself you can put better parts in there and it will be ten times better then anything Mikey D(hell) craps out his butt and try to sell on the market. If you are dead set though on doing what you asked then here's the answers to your questions:
well im getting an old alien ware shell with the liquid cooling an power supply still intact but the power supply is much higher then the 300 watt one I have now so I was going to switch over to that case to support the heat of the 1 gig card and watts needed is this a good idea? how hard is it to remount a motherboard an be successful?
Is that PSU you are going to use an OEM from Dell or an upgrade that was put in later? If its an OEM from Dell I would trash it. I don't know what type of PSU they use in Alienware computer but knowing D(hell) its probably junk. Get a good quality PSU like Corsair or Seasonic (my favorite). You should be fine with something like a 450-550 Watt PSU as long as it's from a quality company. If its already a good quality PSU then no need to upgrade you save some money there.
I have now so I was going to switch over to that case to support the heat of the 1 gig card and watts needed is this a good idea?
You can do that but the 5450 isn't really going to create that much heat, compared to something high-end like a 6970 or 6990 ATI video card. You should still moniter the heat temperatures but with decent case cooling it shouldn't over heat.
how hard is it to remount a motherboard an be successful?
Its not really that hard. What you want to do is make sure all the standoffs on the case match up to the mounting holes. You don't want a standoff touching the back of the mobo where it doesn't belong because that will short out the board.
so it can take this http://www.newegg.com/Product/Prod [...] 6814125405 if i upgrade to the i think its either 450 or 600 watt power supply
You could get that but thats a pretty low end videocard if your going to be using this computer for gaming. I would get atleast a 5570 which I had on the HP mentioned above. It's better then the 5540 but even at that it wasn't great and caused bad lag. If this computer is for gaming then maybe you want to go even a little higher if you can get the money and get something like a 5770.
You probably won't get any bottlenecking because most those parts are all pretty much on the same scale. Your not trying to use a single core cpu with a 6990 videocard. That would cause a bottleneck.