Police open probe and regulator says affair is ‘a shame’ for Germany as payments group withdraws previous results