The phrase “that dog don’t hunt” is an idiom that means that an idea, argument, plan, or suggestion won’t work or is ineffective. It originates from hunting culture, where a dog that won’t hunt is useless for that purpose.
When someone says this, they’re saying that something is not going to be successful.