From @eeaston:

Running the dispose method when using OutOfProcess mode throws errors due to I think closed process handles.

    // Clean-up for the class is in the IDisposable.Dispose implementation
    public void Dispose()
    {
        wb.Close(SaveChanges: false);
    }