The Justice Select Committee has recommended a bill to make English an official language be passed without any changes, despite strong opposition to the move.