Billy Joel is not only celebrated in the Rock and Roll Hall of Fame and the Songwriters Hall of Fame, but in the Long Island Music Hall of Fame as well—since it’s in New York’s scenic town of Oyster Bay that he came of age.

In a city known worldwide for its storybook Victorians, this 1889 Queen Anne home, located on a lovely block in Pacific Heights, fits right in. Its eye-catching façade features decorative millwork, stately columns and marble steps, elegant sashed and bay windows, and whimsical trim, all telltale elements of the period style.