What makes this worth the trip over a bar patio: you're in the park, which means fog rolls in around 4pm and the crowd skews local rather than tourist. The live music component varies week to week — some Saturdays get proper bands, some get solo acoustic sets — so check the lineup before you commit a full afternoon to it. Food options inside the garden are limited; eat before you go or grab something from the vendors along Fulton.
Getting there is where people waste time. Google Maps has been unreliable around the western park edges since the Great Highway reconfiguration — it may route you in circles distinguishing between the upper and lower segments. Take the 5-Fulton or 21-Hayes Muni lines and walk in from the north; it's the cleanest approach. If you're driving, park along Fulton Street itself rather than hunting inside the park. No dedicated BART stop; closest is Forest Hill or Carl & Cole on the N-Judah, then a 15-minute walk or rideshare.
If you've got two hours: arrive by 2pm before the fog commits, grab a drink, catch one full set, and walk out through the Panhandle on your way back.

