Want to build latest g++ for Raspberry Pi - worth it?

It's irritating to have a C++ compiler that partially supports C++11 standards, so I'm mulling over building the latest stable g++ for my Raspberry Pi. This is for work, but some people over here are reluctant to upgrade OS versions (not me) which might give me latest and greatest stuff. So, having said that, it is wise, worth my time, etc. to build the latest g++? Any pitfalls, gotchas, etc?

Just a snapshot of my system particulars:

uname -a
Linux rpi3 3.12.22+ #691 PREEMPT Wed Jun 18 18:29:58 BST 2014 armv6l GNU/Linux

g++ --version
g++ (Debian 4.6.3-14+rpi1) 4.6.3

I've downloaded 4.8.5.