Scientists can be susceptible to the temptation to use complicated mathematical and statistical procedures to lend an air of scientific objectivity to conclusions. But the key task of data analysis is not to apply a fancy technique but rather to use a number of analytical approaches in an integrated manner to elucidate scientifically what is happening. Evidence pertaining to important questions in science must be balanced and integrated collections of words, numbers, images and graphics.
In contrast, the hypotheses tested by many experimental biologists often do not derive from general mathematical theories about how the complexity of real world biology operates. More typically they are statistical hypotheses about the properties of a population of individuals subjected to a particular intervention.
Physics envy is also known in general, in linguistics, and in financial modelling.
Here is a paper that discusses physics envy in economics.
One related aspect of physics envy is quantitation envy. Non-physicists are impressed by the incredible ability of physicists to get tax payers to spend gargantuan sums of money on experiments (the $3BN spent on the Large Hadron Collider is a news worthy example) that only a few hundred people understand. This has the unfortunate effect of tempting biologists to spend too much on complex and expensive measurement when often simpler and more elegant means are scientifically more effective (the Danish stereologist Hans Jorgen Gundersen has an aphorism that is relevant; Do more, Less Well).
Cohen, Joel E. (1971). “Mathematics as Metaphor: a review of Dynamical System Theory in Biology. Vol. 1, Stability Theory and Its Applications by Robert Rosen.” Science, New Series, Vol. 172, No. 3984.