Depends what "early" means for you.
You can kill Fuzkao 2 minutes after you reach Second Zone if you grab Big Axe and Burning Helm. (tutorial link below)
I am also going to mention I got pretty bad RNG in that video and he used his strongest move twice. But I still killed him.
So "early" is not exactly an argument in this case.
I wasn't saying "avoid him in the Palace". I was saying that he doesn't always die after that encounter.
He only dies if IW_Fuzkao - IW_FuzkaoDamage = 4 or less
If it's 5+, he teleports away and goes after the Mother (you still get the EXP and Sx)
So the question is really one of preference: 50 Sx vs 5000 EXP (an optimized playthrough that has 60 New Givini score and the Mage Tower bought pretty much ensures he dies in the Palace, but still...)
(also sorry for late reply got sidetracked)