In the 16th century the tower was in ruins and required important restructuring. The tower was also badly damaged in the 1755 Lisbon earthquake and in 1760 when the top level was added, the repairs were undertaken. Shortly after this, the tower was in threat of demolition to make way for the widening of the road. Thankfuly it was saved by strong opposition by the people of Seville. In 1868 the tower was put up for sale as scrap but again the people saved it. In the 14th century people gave the tower more respect and restored it to a glorious state. Over the centuries the tower has been a prison and a chapel, and later a gunpowder store. Today it houses the city's naval Museum.

The two other towers in this set of three are the Abdelaziz Tower, a small construction named after the Muslim Prince and said to be the place for the first Christian flag to be flown during the Reconquest, and the Silver Tower dating from the 13th century. This was the last construction built for defence purposes by the Arabs in Seville. It is of octagonal shape and has hooded turrets and ornamental brick footings.