That cost is amortized over all requests made against all copies of the model though. Fortunately we don't have to re-train the model every time we want to perform inference.