Adding gold to your portfolio can be beneficial, but experts say you should think twice about certain assets.