I am getting to this point myself. I have a little SX130IS, and I love it but I wish it had a few more features (optical viewfinder most of all). My Rebel XS never gets taken anywhere because it's a lot to haul around. And I'm terrified of getting dust on the sensor changing lenses.
I think the ideal camera would be a fixed lens camera with a generous zoom range. It would have an optical viewfinder, hot shoe, depth of field preview button, full manual mode and take full HD video with a microphone in jack, and an HDMI out port. And let it take 4 AA batteries so you can use rechargeables or lithium cells you can find anywhere. Also it should have image stabilization, and the option for full manual focus, and the ability to attach lens accessories like caps, filters, hoods, ring lights and special effect lenses via a threaded mount on the front of the fixed lens.
I really like the DSLRs but they need to make the sensor easy to clean by housing it in some kind of extremely hard sapphire glass or something so you can just swab it clean without destroying it. But I think the way to go is with a do-it-all bridge camera and that's the way I'm leaning now as well.