Upgrading MySQL with Replication

Short version is you replicate to another server switch to it, upgrade, then switch back.

"You can keep the outage to only a few minutes while performing this upgrade, removing the need for potentially expensive downtime. If you need the downtime to be zero, you probably want to be looking at a Circular Replication system, though that’s getting a little outside of this blog post."