chamois and saddle question

Out of necessity, or laziness in the laundry department, I've done a couple of 45-60 minute rides lately without tri or bike shorts, just plain old Under Armor spandex shorts. What I've discovered is that I am actually more comfortable this way. I have a heavy saddle, Specialized Dolce Gel. It seems that the chamois combined with the somewhat cushy saddle might cause more chaffing and pressure.

So now I'm wondering if the I should consider a much lighter and harder saddle and use tri shorts. My thinking is that it would be lighter and I would be taking the cushion out of the seat and putting it in my shorts. Or maybe I should just invest in more Under Armor shorts and consider myself lucky that I found the right saddle regardless of its wt.

I really don't want to spend the money to find that the Ruby or the Jett don't work for me. I'm partial to Specialized women's specific now that I've had the Dolce. I assume the geometry of the cut out would be the same and I know that it works for me.

Am I the only one who finds sans chamois more comfortable?