The 40th Reunion included a Saturday night cocktail party and dinner at the Swan Club and a Sunday brunch at Mim's