I fall asleep to EDM all the time, so having it thumping near me probably wouldn't bother me much at all.
I used to fall asleep listening to Faith No More albums on headphones, so I might be a bit skewed on my opinion.
Since you technically asked, in the title what our thoughts are, my thoughts are it's not that big a deal.
However if you are actually suffering from biological issues, I would suggest getting earplugs, or perhaps getting some perscription sleeping pills for the event timeframe. Or, as others have suggested, just go visit a friend for a few days or something.
If this is a yearly festival, that brings in tons of money in taxes and sales for the city I seriously doubt they are going to shut it down. It's only once a year, they have a permit to do it. If you really don't like it that much, try and get your city ordinances changed, by taking part in your local government. Perhaps something like "no such parties within city limits, or *insert distance* from residential areas" might help in the long run. But, I'm guessing you probably aren't going to be motivated enough to join the political movement of your city, just to shut up a party for 3 days a year.
Otherwise, yeah, go on a trip, find some friends and crash with them, or go join the party.