Google maps v3

I have a Google map on a site with multiple markers. I’ve been trying to find a way to add a label or infowindow for each of these. It seems simple enough to set up so that the infowindow displays on click but I wanted the name of each marker to be displayed all the time. Is this possible?