Let the natural predators do the job, spraying stuff will interrupt their work. Establishing a balance in your outdoor gardens often means you must endure some crop damage. Cannabis can loose a lot of leaf before it becomes a problem. Just look at all of the defo some growers use! I only treat in my outdoor gardens for ants that farm aphids and BTi for caterpillars. Once in a great while I use insecticidal soap to knock down an invasion of something until the natural enemies can get going on them. I cannot grow cannabis outdoors here
I might have been an insect in a previous life because the smell of neem makes me recoil. It might just be my imagination but I think I can taste it in cannabis that it has been used on. I don't have a problem with it as a pesticide from an environmental point, I just don't like it on my food or smoke as a personal preference.