Port Herman had its origins as a summer camp.
In the mid 1980s, the the present day PHB Condominium project was started. There are 38 waterfront units that make up Port Herman Beach Condominium today.
In 2007, all six residential buildings underwent a major renovation which included new siding, new roofs and major structural enhancements.
In 2003, a major hurricane, Isabelle, struck the eastern seaboard of the United States and devastated many waterfront communities. Port Herman easily survived the storm with no damage to any of the residential buildings or water treatment plant. The dock was fully submerged but required no repairs due to the storm.