Congress leader Rahul Gandhi on Monday asserted that, as the Leader of the Opposition in the Lok Sabha, he has the right to speak in the House, but he was not being allowed, even as members of the ruling government continued to make their statements.