It depends on the conversation – if the conversation starter hasn't checked the "Allow anyone in the conversation to invite others" button when starting it, only they can invite people. They (or you, if it's your conversation) can click "Edit Conversation" above the first post to get to that option to change it.