Christian Unity

In John 17, Jesus prays for the coming church to be unified, so that through that unity the world would know He was sent by God. What did He mean by that? What does the world see when they look at the church? With so many denominational rifts, how can we find the unity that Christ prayed for?