Do you lose trophies on casual ladder?

Do you lose trophies in the casual one or only in ranked one?

Yes, you gain/lose trophies in the casual one also. The only thing is that there is a trophy floor in the casual mode — so if you are in the arena at 6000 trophies, you won’t be able to drop below it once you have reached it.