Whatever or not you want the Zhentarims to be dicks here is up to the DM…and whatever or not the party has pissed off the Zhentarims anytime. (Did they kill that Vampire?)

I'd probably just put in a Mission House here. Maybe a bigger Mission House that has the gate.