Lines Matching full:period

18  * Record the start of an expedited grace period.
27  * Return the value that the expedited-grace-period counter will have
28  * at the end of the current grace period.
36  * Record the end of an expedited grace period.
46  * Take a snapshot of the expedited-grace-period counter, which is the
47  * earliest value that will indicate that a full grace period has
62  * if a full expedited grace period has elapsed since that snapshot
132  * a new expedited grace period.
149  * Return non-zero if there is no RCU expedited grace period in progress
152  * for the current expedited grace period.
180  * grace period.  This event is reported either to the rcu_node structure on
287  * if some other task completed an expedited grace period that this task
290  * expedited grace period.
347  * expedited grace period needs to wait for.
382 			 * post grace period updater's accesses is enforced by the  in __sync_rcu_exp_select_node_cpus()
483  * Work-queue handler to drive an expedited grace period forward.
500  * Select the nodes that the upcoming expedited grace period needs
534  * Wait for the expedited grace period to elapse, within time limit.
535  * If the time limit is exceeded without the grace period elapsing,
615  * Wait for the expedited grace period to elapse, issuing any needed
676  * Wait for the current expedited grace period to complete, and then
678  * grace period.  Also update all the ->exp_seq_rq counters as needed
688 	// End the previous grace period only after acquiring the mutex  in rcu_exp_wait_wake()
710  * Common code to drive an expedited grace period forward, used by
754 	 * current grace period?  If either is the case, just leave.  in rcu_exp_handler()
784 	 * grace period is still waiting on this CPU, set ->deferred_qs  in rcu_exp_handler()
804 /* PREEMPTION=y, so no PREEMPTION=n expedited grace period to clean up after. */
812  * expedited grace period.
838  * expedited grace period.
921  * blocking the current expedited grace period.
931  * the current expedited grace period.
940  * synchronize_rcu_expedited - Brute-force RCU grace period
942  * Wait for an RCU grace period, but expedite it.  The basic idea is to
971 	/* Is the state is such that the call is a grace period? */  in synchronize_rcu_expedited()
1004 		/* Marshall arguments & schedule the expedited grace period. */  in synchronize_rcu_expedited()
1009 	/* Wait for expedited grace period to complete. */  in synchronize_rcu_expedited()
1014 	/* Let the next expedited grace period start. */  in synchronize_rcu_expedited()
1050 … start_poll_synchronize_rcu_expedited - Snapshot current RCU state and start expedited grace period
1054  * allowing them to determine whether or not any sort of grace period has
1055  * elapsed in the meantime.  If the needed expedited grace period is not
1056  * already slated to start, initiates that grace period.
1084  * start_poll_synchronize_rcu_expedited_full - Take a full snapshot and start expedited grace period
1085  * @rgosp: Place to put snapshot of grace-period state
1087  * Places the normal and expedited grace-period states in rgosp.  This
1090  * grace period (whether normal or expedited) has elapsed in the meantime.
1091  * If the needed expedited grace period is not already slated to start,
1092  * initiates that grace period.
1102  * cond_synchronize_rcu_expedited - Conditionally wait for an expedited RCU grace period
1106  * If any type of full RCU grace period has elapsed since the earlier
1109  * invoke synchronize_rcu_expedited() to wait for a full grace period.
1129  * cond_synchronize_rcu_expedited_full - Conditionally wait for an expedited RCU grace period
1132  * If a full RCU grace period has elapsed since the call to
1136  * to wait for a full grace period.