YMCA leaders said financial struggles forced the decision, but for some longtime members, it's a loss that cuts deep.