We consider a linear elliptic equation in divergence form on a bounded domain (or on $\R^d$) in dimension $d\geq 2$, whose coefficients are perturbed by a stationary noise of correlation length $\e>0$. We give estimates on the fluctuation of the solution in function of the correlation length $\e$ of the noise, both in terms of strong $L^2$ and weak $L^1$ norms. This result can be seen as a quantification of the propagation of uncertainties in linear elliptic partial differential equations.