Chincoteague wild ponies make annual swim Every year, thousands of visitors from far and wide head to the remote Virginia island of Chincoteague to watch wild ponies make their annual swim across a small channel. According to legend, these wild horses are the descendants of a herd that washed ashore when a Spanish galleon was shipwrecked there in the 18th century.