I'm surprised no one mentioned MPG. Granted, we are only talking 1 MPG more on the LS4 for both city and highway. Curb weight is more with the LS4 like 3600 vs 3484. This is according to specs on 2006 GP from Edmunds.
I was a little surprised on the MPG. But when I started looking at the G8 GT compared to my Impala SS, going V8 would only cost me 1 MPG city and 2 highway (Imp: 16/26 vs G8: 15/24). Of course, the G8 has the DoD.
Besides the mod cost being lower on the 3800, the other big thing on the 3800 is just how many there are out there across several GM car lines across so many years. The 3800 can be had cheap I bet compared to the LS4 which isn't in as many cars, especially compared to the other LS engines.