Two different techniques for adding additional data sets to existing global fits using Bayesian reweighting have been proposed in the literature. The derivation of each reweighting formalism is critically reviewed. A simple example is constructed that conclusively favors one of the two formalisms. The effects of this choice for global fits is discussed.