I have these same issues but, I too have smoked a lot of pot so, I can't say for sure that it's not related. Anyhow, my life is very confusing because of this issue. Sorry I can't offer some words of wisdom on the subject but, at least you know that you are not alone. Right?

Maybe some non-smokers will respond and relieve us both.
Take care, Morgan