I take it the mud is down in the brick, that a simple rinse won't do? I would give the guys at Deidrich a shout. They seem to have a chemical for cleaning just about anything with masonary, but I'll warn you their stuff isn't cheap but works damn good. I ran across some white efflorescence coming out of cinder blocks that the customer wanted removed, and their stuff was the only thing that did the trick.