Skip to content

Commit dbb83df

Browse files
authored
docs: note inotify limits for scale test (#360)
Signed-off-by: Daniel Mungai <chegedan699@gmail.com>
1 parent 4915d5c commit dbb83df

1 file changed

Lines changed: 24 additions & 0 deletions

File tree

docs/TEST_README.md

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -149,6 +149,30 @@ examples/cni-readiness/apply-calico.sh
149149

150150
This section tests how the controller handles new nodes being added to the cluster, simulating an autoscaler.
151151

152+
> **Note: inotify limits on Linux hosts**
153+
> Each `kind` worker node runs its own systemd instance inside a container,
154+
> and each consumes several `inotify` instances (journald, udev, service
155+
> watchers, etc.). The default Linux limit (`fs.inotify.max_user_instances`,
156+
> often 128) is shared across your entire user session — desktop
157+
> environment, editors, browsers, and other file-watching tools all draw
158+
> from the same pool. On some dev enviroments, this budget can already be
159+
> significantly consumed before any kind nodes start, making it easy to
160+
> hit `Failed to allocate manager object: Too many open files` when
161+
> scaling to more worker nodes.
162+
>
163+
> If you see this error, increase the host's limits and retry:
164+
> ```bash
165+
> sudo sysctl fs.inotify.max_user_instances=1024
166+
> sudo sysctl fs.inotify.max_user_watches=1048576
167+
>
168+
> # Persist across reboots
169+
> echo "fs.inotify.max_user_instances = 1024" | sudo tee -a /etc/sysctl.d/99-kind.conf
170+
> echo "fs.inotify.max_user_watches = 1048576" | sudo tee -a /etc/sysctl.d/99-kind.conf
171+
> sudo sysctl --system
172+
> ```
173+
> Delete the affected node and re-run the scale-up command once the
174+
> limits are raised.
175+
152176
1. **Scale up the worker nodes:**
153177
```bash
154178
# Add 2 new worker nodes (for a total of 4 workers)

0 commit comments

Comments
 (0)