Roseau, Dominica — John Robert Hart, 41 and Dennis Jay Mayer, 43, will remember their 2012 cruise vacation for all the wrong reasons: the two men were thrown into jail for having sex on the boat.

The Palm Springs men were on a gay-friendly Atlantis Cruise when they were hauled off the boat in Dominica after someone on the dock said they saw them having sex. 

The men were put into jail cells on charges of "buggery" while the cruise ship left for St. Barts without them.

On Thursday morning, Hart and Mayer pleaded guilty to indecent exposure and were fined $900. Their release was pending as of Thursday morning.

The ship is owned by Celebrity Cruises, although this particular trip was organized by Atlantis.

Atlantis is a West Hollywood, Calif.-based company which specializes in cruise vacations for gay and lesbian passengers, and president Rich Campbell told the AP that their boats will "happily return" to Dominica.

"Many countries and municipalities that gay men visit and live in have antiquated laws on their books. These statutes don't pose a concern to us in planning a tourist visit."

Maybe they should.