Is it rude to load up one's plate with only one item at a buffet-style party?

For example, would it be rude to take six rolls and nothing else? ume that the person just likes rolls; it's not that s/he is allergic to all the other food, or has dietary restrictions.