Listen, in 1969 half a million or so scrappy youths got themselves to White Lake, New York for a music festival. Honor them by leaving the five boroughs and getting a little nature (and art) with your music this summer.
In conjunction with Ground Control Touring (they basically have All The Good Bands), Storm King Art Center is hosting a summer concert series featuring The Feelies and and Alex Bleeker & the Freaks (9/20), Lee Ranaldo (8/9), and Porches and Frankie Cosmos (6/28). These all cost $15 (or $12 for seniors and $8 for students).
Storm King is located at 1 Museum Road in New Windsor, New York, which is about one hour from New York City. It's not that easy to get to, and if you want to avoid Port Authority you're best off renting a car (they offer Zipcar discounts, too).