Advanced Concurrency


🙋 Need help? Ask an expert now!

Wait for Goroutines to Return

In Go, we use the sync.WaitGroup structure in order to wait for a group of goroutines to finish their task prior to doing something else -- like maybe sending an email with a summary report to a user.

In Practice

package main
            import (
            func main() {
                // Create a new WaitGroup
                var wg sync.WaitGroup
                // Let's pretend we're doing something useful here -- like iterating over a slice of datasets
                for i := 1; i < 11; i++ {
                    // In this example, we increment one-by-one, however, you can also increment once by the total, e.g., `wg.Add(10)` in this case
                    // NB: remember that the `wg.Add` call must occur before the corresponding `wg.Done`, because if `wg.Done` count exceeds the number added,
                    //     we will encounter a panic in the goroutine that calls `wg.Done`
                    go addNumber(i, i*10+i, &wg)
                // This will block this goroutine until all other goroutines have called `wg.Done` and the count of 'outstanding' routines is therefore 0
                // NB: If you want to 'timeout' you can use Go's context timeout channel or even just the Timer chan factory in the "time" package
                // Yay we finished!
                fmt.Println("All goroutines done, exiting...")
            func addNumber(idx, n int, wg *sync.WaitGroup) {
                // Best practice is to defer this call, so that regardless what happens, even if there's a panic elsewhere in the goroutine,
                // the main goroutine will not be stuck forver (waiting on the wg.Wait() to return)
                defer wg.Done()
                // NB: In the event that you might want to be able to notify the main goroutine of an error, the idiomatic way to do that would be
                //     to pass errors into a `chan` that the main goroutine would check for errors after all of the goroutines have returned
                fmt.Println("In goroutine number", idx, "and we found that n*n =", n*n)

In the event that you need to 'throttle' the waitgroups, or process data in chunks, the SizedWaitGroup section is a great reference!

Edit Me on GitHub!