Peter Oskolkov ab83f455f0 sched: add WF_CURRENT_CPU and externise ttwu ...

Add WF_CURRENT_CPU wake flag that advices the scheduler to
move the wakee to the current CPU. This is useful for fast on-CPU
context switching use cases.

In addition, make ttwu external rather than static so that
the flag could be passed to it from outside of sched/core.c.

Signed-off-by: Peter Oskolkov <posk@google.com>
Signed-off-by: Andrei Vagin <avagin@google.com>
Acked-by: "Peter Zijlstra (Intel)" <peterz@infradead.org>
Link: https://lore.kernel.org/r/20230308073201.3102738-3-avagin@google.com
Signed-off-by: Kees Cook <keescook@chromium.org>

2023-07-17 16:08:08 -07:00

..

autogroup.c

sched/all: Change all BUG_ON() instances in the scheduler to WARN_ON_ONCE()

2022-08-12 11:25:10 +02:00

autogroup.h

sched/headers: Add header guard to kernel/sched/stats.h and kernel/sched/autogroup.h

2022-02-23 08:22:00 +01:00

build_policy.c

sched: Fix missing prototype warnings

2022-05-01 10:03:43 +02:00

build_utility.c

sched: Fix missing prototype warnings

2022-05-01 10:03:43 +02:00

clock.c

Merge tag 'locking-core-2023-06-27' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip

2023-06-27 14:14:30 -07:00

completion.c

sched/completion: Add wait_for_completion_state()

2022-09-07 21:53:49 +02:00

core_sched.c

sched: Rename task_running() to task_on_cpu()

2022-09-07 21:53:47 +02:00

core.c

sched: add WF_CURRENT_CPU and externise ttwu

2023-07-17 16:08:08 -07:00

cpuacct.c

Merge branch 'sched/fast-headers' into sched/core

2022-03-15 09:05:05 +01:00

cpudeadline.c

sched/core: Introduce sched_asym_cpucap_active()

2022-08-02 12:32:45 +02:00

cpudeadline.h

…

cpufreq_schedutil.c

sched/fair, cpufreq: Introduce 'runnable boosting'

2023-06-05 21:13:44 +02:00

cpufreq.c

sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there

2022-02-23 10:58:33 +01:00

cpupri.c

sched/all: Change all BUG_ON() instances in the scheduler to WARN_ON_ONCE()

2022-08-12 11:25:10 +02:00

cpupri.h

sched/cpupri: Add CPUPRI_HIGHER

2020-10-29 11:00:30 +01:00

cputime.c

cputime: remove cputime_to_nsecs fallback

2022-12-27 12:52:17 +01:00

deadline.c

Merge tag 'cgroup-for-6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup

2023-06-27 16:54:21 -07:00

debug.c

sched/debug: Correct printing for rq->nr_uninterruptible

2023-05-08 10:58:39 +02:00

fair.c

sched: add WF_CURRENT_CPU and externise ttwu

2023-07-17 16:08:08 -07:00

features.h

sched/fair: Introduce SIS_UTIL to search idle CPU based on sum of util_avg

2022-06-28 09:08:30 +02:00

idle.c

sched/idle: Mark arch_cpu_idle_dead() __noreturn

2023-03-08 08:44:28 -08:00

isolation.c

sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there

2022-02-23 10:58:33 +01:00

loadavg.c

sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there

2022-02-23 10:58:33 +01:00

Makefile

sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there

2022-02-23 10:58:33 +01:00

membarrier.c

sched/membarrier: Introduce MEMBARRIER_CMD_GET_REGISTRATIONS

2023-01-07 11:29:29 +01:00

pelt.c

sched/headers: Introduce kernel/sched/build_policy.c and build multiple .c files there

2022-02-23 10:58:33 +01:00

pelt.h

sched/fair: Decay task PELT values during wakeup migration

2022-06-28 09:17:46 +02:00

psi.c

sched/psi: use kernfs polling functions for PSI trigger polling

2023-07-10 09:52:30 +02:00

rt.c

sched/rt: Fix bad task migration for rt tasks

2023-04-21 13:24:21 +02:00

sched-pelt.h

sched/fair: Fix "runnable_avg_yN_inv" not used warnings

2019-06-17 12:15:58 +02:00

sched.h

sched: add WF_CURRENT_CPU and externise ttwu

2023-07-17 16:08:08 -07:00

smp.h

sched, smp: Trace smp callback causing an IPI

2023-03-24 11:01:29 +01:00

stats.c

sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there

2022-02-23 10:58:33 +01:00

stats.h

sched/psi: Use task->psi_flags to clear in CPU migration

2022-10-30 10:12:15 +01:00

stop_task.c

sched: Add update_current_exec_runtime helper

2022-08-27 00:05:35 +02:00

swait.c

sched/headers: Introduce kernel/sched/build_utility.c and build multiple .c files there

2022-02-23 10:58:33 +01:00

topology.c

sched/core: Fixed missing rq clock update before calling set_rq_offline()

2023-06-16 22:08:12 +02:00

wait_bit.c

wait_on_bit: add an acquire memory barrier

2022-08-26 09:30:25 -07:00

wait.c

sched/wait: Fix a kthread_park race with wait_woken()

2023-06-16 17:08:01 +02:00