It sounds like dust or dirt is getting trapped in the wheel. Might be worth gently cleaning it with Isopropyl or similar?