Should I roll with higher belts?

Yes, rolling with higher belts accelerates learning. They expose your mistakes and show what is possible. Approach these rolls as learning opportunities, not competitions. Ask questions afterward. Higher belts usually enjoy helping lower belts who show good attitudes.