Sag Harbor is an incorporated village in Suffolk County, New York, United States, in the towns of Southampton and East Hampton on eastern Long Island. The village developed as a working port on Gardiners Bay. The population was 2,772 at the time of the 2020 census.