Not happy with eviction of MLA brothers: Pb Speaker