Intel released some extensions for PyTorch based on oneDNN. It seems like somewhat decent support for quantization was added as well - at least CPU based but it might be more versatile than it looks. Some of the performance benchmarks provided look promising but as always it is better to be careful with such numbers provided.