Victoria's Secret stunner Lily Aldridge and Taylor Swift headed to Robert DeNiro's NYC eatery Locanda Verde for lunch