This hasn't been a problem in my experience in Chicago (and to a much greater extent Oak Park). In both, there were lots of homeless people around the library --- but they weren't at the same table as you, and they didn't disrupt anything.