The goal is to speak as one. And I think of Babel. There, the people joined to a build a tower to their own abilities. Some think they united to build stair steps to heaven, to enter the divine kingdom.
God rejected their efforts, knowing that this kind of unity would lead them into more trouble. If they built this tower, they'd work together for other projects that would not lead them to God but to further depravity.
Unity in God is a beautiful thing. Unity without God leads to projects that serve lower desires.
To be set apart for God is to be given the freedom to pursue the things of Philippians:
whatever is true, whatever is noble, whatever is right, whatever is pure, whatever is lovely, whatever is admirable--if anything is excellent or praiseworthy--think about such things. (Phil 4:8)