Crime, Prisons: United States. New Hampshire. Newport. Sullivan County Jail: New Hampshire State Charitable and Correctional Institutions: Old Sullivan County Jail. Newport, New Hampshire.