Yeah, Palestinians are indeed Semites, however, the word antisemitism (for historic reasons) is used to refer specifically to hatred of Jews. It makes historical sense that Germans are afraid to criticize the Jews.
I probably disagree with your opinions, but the debate would likely be useless.