Some people got carried away thinking they were auditioning for Survivor and decided to swim to shore