The punctuation is pretty much straight from the bible.
This is a song of joy and of thanks to God. The thanks is reflected in its third verse, "The LORD has done great things for us". But still more exuberant than expressions of thanks is the joyousness of the author. The author shows the people as gleeful to return to Zion after 2 generations of detention by the Babylonians, as is expressed in verse 1 and 2: "When the Lord restored the captives of Zion, we were like those who dream. Then our mouth was filled with laughter, and our tongue with joyful singing"
Vice President Pence also received a copy
Vice President Mike Pence @VP
It was an amazing moment I’ll never forget... when 3 Americans stepped onto the tarmac at @JBA_NAFW & gave me a signed personal note with Psalm 126 on the back. “When the Lord brought back the captives to Zion...” To these men of faith & courage - God bless you & welcome home!i