diff mbox series

[v2,3/3] mm: skip page_cpupid_reset_last atomic update if the value is already reset

Message ID 20210317064730.546507-3-npiggin@gmail.com (mailing list archive)
State New, archived
Headers show
Series [v2,1/3] mm: add __ prefix to page_cpupid_reset_last because it is non-atomic | expand

Commit Message

Nicholas Piggin March 17, 2021, 6:47 a.m. UTC 
Improves performance of a PROT_READ -> PROT_READ|PROT_WRITE -> store
microbenchmark (which goes via the wp_page_reuse fault path) by about
10% on a POWER9.

Signed-off-by: Nicholas Piggin <npiggin@gmail.com>
---
 include/linux/mm.h | 3 +++
 1 file changed, 3 insertions(+)
diff mbox series

Patch

diff --git a/include/linux/mm.h b/include/linux/mm.h
index 2524553ea898..1e1471235055 100644
--- a/include/linux/mm.h
+++ b/include/linux/mm.h
@@ -1420,6 +1420,9 @@  static inline void __page_cpupid_reset_last(struct page *page)
 
 static inline void page_cpupid_reset_last(struct page *page)
 {
+	if (page_cpupid_last(page) == (-1 & LAST_CPUPID_MASK))
+		return;
+
 	page_cpupid_xchg_last(page, (1 << LAST_CPUPID_SHIFT) - 1);
 }