I enjoy wandering the neighborhoods around Soho, Little Italy, Greenwich Village, Hell's Kitchen, etc. You can find some cute local shops and restaurants in those areas, and just get a nice feel for the city. Check out the flea markets that they have throughout the city (usually on weekends, but some are on weekdays). I like hanging out in Washington Square Park too. Not as touristy as Central Park.