Having the ability to organize the colors a product is available in would not only allow you to make the product page look better but would also improve the customers buying experience. The easier it is for customers to find and choose what they want, the more likely they are to buy.
Here's a comparison of the difference -
Deco's order for Hanes Beefy-T colors:
Custom Ink's order for Hanes Beefy-T colors:
It would be nice to click and drag the colors but even just adding the sort arrows like the sizing page would do the trick.
I feel like we should have the tools necessary to create the best possible user experience whether we use them or not and being able to easily and intuitively select a product color is a pretty standard function of any online store.
Let me know what you guys think.