If you go to Koh Taen and Koh Madsum (Pig Island), the catamaran departs from Tongkru(South part of Koh Samui) Beach.
Koh Taen and Koh Madsum