The move follows complaints from the Vietnamese government.
Some quarter of a million Vietnamese refugees passed through Bidong island between 1975 and 1991.
One plaque on the monument speaks of the hundreds of thousands of Vietnamese people who perished on the way to freedom.
Another thanks the people and the government of Malaysia and the Malaysian Red Crescent society for the help they gave the refugees.
However, the memorial has upset the Vietnamese government.
