Tens of thousands of grandparents are missing out on £230 of National Insurance credits, a former pensions minister says.