It is easy to overthink/overdo trousers.
If it is warm enough for shorts, I wear em (except in high bug season). I always have some (wicking) longjohns and rain shell if I get cold. This holds me in good shape until it gets down to the freezing mark.
If it is warm, but I need long pants (ticks or thorny brush), I wear nylon pants, some nylon or blend BDUs are easy to find and do the trick, or you can buy a technical equivalent from any of a number of outdoor clothes companies.
Below freezing I go for wool pants. Again backed up by longjohns and rain shell if necessary.
Basically, my number one criteria when I look at a piece of clothing to be worn outdoors is, "How quickly does it dry.' If the answer is "Pretty quickly." and it fits (my body and my pack), it is good.