Waiting 24 hours to invite

When I went to invite a guy, it told me that I had to wait 24 hours to reinvite him to my guild...Um, what? I didn't invite him into the guild and him leave or me kick. This isn't me reinviting him. He left his guild and then I can't invite him for 24 hours. I could understand if they left or you kicked them and wanted to reinvite them back but this is just silly. I shouldn't have to wait a full day to invite him. And it is happening with one other guy. I'm trying to get my guild up so that I have active members. I went out of my comfort zone and did this in hopes I could have people that can help me and me help them in return but if this is happening, it is more frustrating than expected.

Make it so that it is one hour tops for another guild to be able to invite the person in question. That sounds more than reasonable.