Looks similar to this (no implemetable solution in this thread).
How about simply removing org-fancy-priorities-mode from org-mode-hook?
As to “how I can remove it from the hook?”, it might be quicker to talk with doom community. Or someone from this community has experience with doom (I don’t use it…).