INC/IPEX support with torch 2.2/2.4

[IlyasMoutawwakil]

An issue to track failures in INC support of torch/ipex 2.2 and IPEX support of torch/ipex 2.4
In #975 I tried to test inc and ipex integrations with torch 2.2 to 2.4, however there seems to be some tests failing with some combinations.

IPEX: https://github.com/huggingface/optimum-intel/actions/runs/11682491850/job/32529735199
INC: https://github.com/huggingface/optimum-intel/actions/runs/11682491836/job/32529729202

[IlyasMoutawwakil]

@jiqing-feng

[jiqing-feng]

We are working on refactoring the ipex, the PR will be landed soon, we will clean all the tests then.

[changwangss]

#1027 remove the torch 2.2, 2.3 version, INC and INC IPEX are currently maintaining torch 2.4 and 2.5.