They are not needed for anything else and as long as you have your roads upgraded (if you wanted blossom street) you can sell them.
However, do not sell your Fairy Portal until you get a quest that tells you to do so. Then, you will no longer need anything from the fairy age.