Doesn't sound like a toxic deck at all, just grindy. If your play group hates it that much i guess it's your call as to what you want to do but i can't see why it would cause that big a problem, just sounds like a deck that requires a bit of thought to get around and beat, rather then just turning guys sideways. Unless there is people on the verge of leaving or just not playing you i wouldn't stop playing it if it's a deck you worked on and really enjoy playing. I stopped playing a Treasure's/
Marionette Master based deck last standard because a lot of people at my LGS hated the burnt for 20+ off treasures out of nowhere and i regret it, i loved the deck and ended up not taking it to nationals because i stopped playing it so far out and wish i had of taken it instead of what i ended up taking. So like i said, unless its at the point where your LGS might suffer numbers wise i would keep playing it and just try to let the few that can't hack it not get to you.