I applied for my licence so I could start learning straight away once I was 17.
I found it very tiring at first as there was so much to concentrate on and you are using your hands and feet in completely different ways to that which you are used to. It didn't come naturally to me, but with practice it became a lot easier and before too long was like second nature.
I was taught to drive by my uncle. He was a bit of a c-unit and made out he was doing it cheaply for us (he wasn't). I passed 2nd time. I wouldn't say learing to drive is especially hard, but driving by the very tight constraints required to pass the test can be quite tricky. As Harrison has alluded to, the old adage is that you 'really start learning how to drive after you've passed your test'
If you don't want to do it, don't. I personally couldn't imagine not being able to drive as I do enjoy it and it makes life a lot easier for me - but it's not for everyone.