Activists angered after swimming pool bans women, but sports centre says decision was based on financial reasons.