The only downside is more items in the backpack. And since it's the only way currently and for the foreseeable future to have potions outside of battle I say go for it.
In battle, those potions that are designed to be used in battle- potion, super potion, hyper potion, max potion. (we've seen...