You are absolutely correct no doubt in that. when we are analyzing generally we can consider the signs directly.
in some cases, it will also give both bhava and sign results. but when you are analyzing minutely you need to consider the bhavas (significance) as very important. wherein some cases if the planet is nearest (3.20° degrees) to the next bhava you need to consider the next bhava only.
i do not need to take stress to judge because we are combining the Vedic , western and KP so i do not miss anything i do also follow progressive aspects minutely and i correlate the dasha to get an accurate prediction