There's a granite hulk sitting in the middle of Casco Bay, just off the coast of Portland, Maine, that most visitors photograph from a distance without ever knowing they can actually land on it. Fort Gorges is a roofless, green-encrusted island fort on Hog Island Ledge, abandoned by the military long ago and slowly being swallowed by vegetation. No ferry stops there and there's no dock — you arrive by paddling up to its small beach.

The backstory is a classic tale of military obsolescence. Built to shore up American coastal defenses after the War of 1812, construction started in 1858 and finished in 1864, by which point Civil War-era advances in weaponry had already made its design outdated. The fort never fired a shot in its intended role; it later served as a storage depot through both World Wars before the federal government handed it to the city of Portland in 1960. It landed on the National Register of Historic Places in 1973, but preservation has been slow — the ocean location makes maintenance brutally expensive, and the structure remains rough around the edges.

That roughness is part of the appeal. The two-story fort, built from local granite that has held up for over 160 years, is open to anyone brave enough to get there, and exploring it feels genuinely adventurous rather than curated. The courtyard is overgrown, the views from the upper floors stretch across the bay to the Portland skyline, and entry is free — with the caveats that you explore at your own risk and should steer clear of hazardous areas.

Getting there takes a bit of planning. Experienced kayakers can launch from Portland's East End Beach and cross open water, but conditions, tides and boat traffic all matter, so check before setting out. If you're not confident on the water, Portland Paddle runs three-hour guided sea kayaking tours that include time to wander the fort, and the nonprofit Friends of Fort Gorges also organizes boat trips. Prefer to stay dry? Casco Bay Lines' Mailboat Run cruises past the fort, giving you a proper look without committing to a landing.

Whatever route you choose, come prepared: there are no restrooms, no facilities and no shelter on the island. Pack a headlamp for the dark interior passages, wear sturdy shoes, and bring warm, water-resistant layers — this is Maine, and the bay is cold even in summer.

Fort Gorges suits travellers who like their sightseeing with a side of eeriness: urban explorers, kayakers, history buffs and photographers chasing something stranger than a lighthouse. Pair it with a weekend in Portland itself, which pairs a walkable old port district with an outsized food scene, and you've got a New England trip with a genuinely memorable centrepiece — a fort that never fought, now quietly surrendering to nature.