Yes, the US Marshall Service is part of the Department of Justice.
https://en.wikipedia.org/wiki/United_States_Marshals_Service
And, although they operate under the direction of the Attorney General, the following brings up an interesting point:
The Marshals Service serves as the enforcement and security arm of the U.S. federal judiciary
If the court issues an order and the attorney general subsequently refuses to enforce that order, couldn’t the court then issue an order placing the attorney general under arrest?
It’s honestly been long enough that I don’t remember. I do remember really liking season 2, however. There’s a lot of character development over the course of the series.