In my case, my son didn't perform well in P1 and 2 but still I persisted with high hope that he would be OK one day. Now, he's in P6 and I observe his continuous improvement incl of academic, sense of responsibility and EQ.
In your case, please don't concentrate only on academic results. There should be other aspects that you have to take into consideration before thinking of switch of school.