How Kubernetes Schedules Containers: Current Gaps and Future Challenges

What is it about?

Modern software applications are increasingly built using lightweight, modular units called containers. Kubernetes has become the standard platform for orchestrating and managing these containerized applications at scale. At the core of Kubernetes lies the scheduler, an automated component that decides which physical or virtual server will run each incoming task. This placement decision directly determines application response times, energy efficiency, infrastructure costs, and system utilization. However, the default scheduler faces major limitations in modern heterogeneous environments, such as edge and fog computing, IoT networks, and specialized AI hardware accelerators (like GPUs). To bridge this gap, this paper analyzes 96 peer-reviewed studies published between 2016 and 2022, establishing a novel five-domain taxonomy to categorize scheduling approaches across: * infrastructure * cluster architecture * mathematical scheduling algorithms and metrics * application workloads, and * evaluation methodologies. Finally, the survey outlines critical open challenges and future research directions. These include mitigating container interference ("noisy neighbors"), building decentralized and federated multi-cluster schedulers, adopting carbon-aware sustainable policies, and establishing standardized benchmark suites. Ultimately, this work provides researchers and engineers with an essential roadmap to build smarter, faster, and more resilient container orchestration systems.

Featured Image

Photo by Growtika on Unsplash

Photo by Growtika on Unsplash

Why is it important?

* Optimizes the industry standard: Kubernetes is the global standard for container management, yet its default scheduler struggles with complex workloads, edge/IoT environments, and specialized AI hardware. * Fills a major research gap: While earlier surveys focused broadly on virtual machines or generic orchestration, this is the first comprehensive survey specifically dedicated to Kubernetes scheduling. * Provides a clear taxonomy: It categorizes 96 peer-reviewed studies across five distinct architectural domains, offering a unified benchmark for researchers and engineers. * Guides future system design: It identifies critical, unsolved challenges—including container interference ("noisy neighbors"), AI accelerator management, green/carbon-aware computing, and multi-cluster federation.