Joel Joffe, Baron Joffe