It is possible, but it is definitely advised not to do that, both nutrionally speaking and also with regard to prevention of diseases.
In terms of nutrition: the fat content is too high and the level of vitamins and minerals is too low.
Prevention of diseases: the risk to suffer from nutritional diarrhoea and therewith an infectious diarrhoea is much bigger.
To combat Para TBC; first measure to prevent and to combat Para TBC is to feed calf milk replacers and no cow's milk.

Also read the article "Whole milk less suitable for calf rearing"