What kind of freedoms do you want that religious people are a danger to you?
Potentially every religion can be turned bad and create problems.
If you think about a world where the greed-factor and the 'gods' money or status by possession is severely diminished or even gone, people might look to other things for their own sense of self, or sense of life. A whole lot of people. And you still gonna have those that are able and willing to seduce the masses for whatever cause.
We are going to have to change with the times. We will see how that works.
As for what freedoms specifically, nothing special. Good values.
Keep in mind that my stance is that the world would already be better without
any religion, and that religious freedom is only the next best thing.
And while I definitely acknowledge the interrelatedness of our core values in society and some religious values, I do not believe that Christianity for example is part of the core. Rather that it developed side by side and with each other. I'm not saying it was
despite either, but I believe that mainly common sense is the driving force.