I believe, after Tower pulled out, later the army blew up the fort. Unlike the other navy forts, this one was well outside territorial waters of those days - so less risky to be prosecuted for any pirates that moved in. The Concrete stumps, may still be there.