My phone costs 600 quid
So was the xperia when I bought it. At that time the 800 for something like £400. When I replaced the phone with like for like it was essentially an obsolete model and set me back £200.
But as I have already pointed out you can get a toughened, waterproof phone with a bigger and more detailed display than a garmin for around £150. This makes garmin's (800-1000) look quite sick in terms of value for money.
I set my phone up and start riding. There's no need to touch it until I'm finished. My current Audax data screen has 12 info fields which are fully readable by aged varifocal needing eyes and occupy less than 1/4 of the screen. I have no need to fiddle with the phone whilst on the move. So it doesn't matter if I'm wearing gloves or not. On the rare occasion I need to do something whilt riding I just lick the end of my gloved finger and that's sufficient.
My phone is water proof. I wouldn't have bought it if it wasn't. Waterproofness and ANT+ were what attracted me the the Xperia range of phones. I believe Samsung now do ANT+ in some models but don't have as good a range in term of waterproof phones.
The apps I use for navigating allow me to upload to a range of fitness sites. Even if they didn't its still quite simple to export the ride in a wide range of formats.
I admit that I took a risk when I strapped a £600 phone to the handlebars of my bike but in retrospect it has worked exceptionally well. And scince Oct 2013 when the Xperia Z Ultra was first sold.
Try your phone with Locus maps (assuming its an android phone). Its a bit of an eye opener.