However only £31m has been returned.
Under the new voluntary scheme banks must agree to compensate fraud victims for losses if it can be proved that they have failed to protect them.
Also responding to the Authorised Push Payment Scams Steering Group, Lloyds said it wanted to make all customers pay an extra levy every time they made a big bank transfer in order to to pay for the compensation scheme.
Barclays warned it needed to “limit its liabilities” in various ways which could include slowing down and blocking payments for genuine customers
And Nationwide suggested customers it has identified as “vulnerable” may need to be barred from some banking services because they presented too much of a risk of getting scammed and it having to pay compensation.
Commenting on the publication of the consultation responses, Stephen Jones, chief executive of UK Finance, said: “The finance industry is committed to ensuring consumers are better protected from the threat of authorised push payment scams, stopping money going to criminals and supporting customers if they become victims.
“The voluntary code will be an important part of this and so it is vital that we get it right.”