I think it's fair and perfectly possible under the rules (if Elf can bring in a full body Anti-Magic, this is way less OP), but it's also a dick move. I don't see it as violating the spirit of anything, as people can and do inconvenience each other all the time, but... well...
You're not a Ghostbuster, bro.