How to add a haradware breakpoint on a physical memory address?

I found some memory was rewrite by gpu module, but i have not found where it layout. I just use samples hw_breakpoint module for memory monitor. However, i found it only monitor on a virtual address, in another words, if two variable point the same physical memory, it can't be detected if I just monitor on the other variable. any hints will be very very appreciated.