How can I use -O3 compiler optimization flag?

I am building a kernel for arm64 and I want to add -O3 kernel optimization flag to check if this can give any performance improvement. Someone already made a path to do this https://github.com/graysky2/kernel_gcc_patch and reported little improvement in some applications but that patch is only for x86.