This was after they disrupted President Jacob Zuma's State-Of-The-Nation speech and members of the main opposition walked out in protest.
(READ MORE: S.Africa's Zuma to face hostility when parliament opens)
EFF lawmakers interrupted Zuma with questions over alleged graft in a 23 million US dollar upgrade to his Nkandla home. Speaker Baleka Mbete told the EFF members that it was "not a question session" before asking for them to be removed when carried on.
Opposition Democratic Alliance lawmakers then walked out.