Callers shouldn't have to expect that irc_channel_del_user() frees the channel so if it wants to (temporary channels), do it via a timer.