I knew Spinks would be the obvious choice. Perhaps a fellow named Yaqi Lopez or Marvin Johnson might be able to do the do against prime Charles.
Don't think he'd defeat Ezzard, but a James Scott match inside Rahway Prison is an interesting prospect, big home field advantage there. Seconding the Qawi shout too.
There were some pretty tasty LHW's in that era. A couple of them might have split a series with him, given his hectic schedule.