I'm 56, 5'11'' and a beefy 155lbs . I have the Versys 650 with TKC80 tires (second set, I love them for everything, truly). The bike is just an amazing machine--fantastic on road and surprisingly good on rough technical trails. I ride quite a bit on jeep roads and ATV trails and I can keep up with true dual-purpose bikes for the most part. I admit I've dropped it twice in the woods, just low speed "walk-off" dumps. It's not bad to pick up actually. But the reality for me is that ten years from now I'll need a lighter bike. Something like the X300 for sure. I've ridden one and can attest that it's super nimble and easy to handle but lacks the "kick in the pants" acceleration and precise, confident cornering characteristics of the 650.
I'm giving mixed messages, sorry! I guess it comes down to what you're willing to give up and what you HAVE to give up in terms of compromises. I don't have to give up the performance of the 650 yet, but that day is coming.