Allow running a local kubernetes cluster using kind #4088
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
epicfaace
changed the title
epicfaace
changed the title
|
Whoever reviews this, can you try the steps yourself? Note that while the cluster can communicate with codalab and run workers, it doesn't have access to Docker so it can't run actual bundles yet. #4090 allows workers in the cluster to also launch jobs. |
epicfaace
commented
May 1, 2022
teetone
approved these changes
May 11, 2022
| try: | ||
| user_id = getpass.getuser() | ||
| except Exception: | ||
| # Sometimes getpass.getuser() doesn't work. |
There was a problem hiding this comment.
Does it not work on the cluster? Should we error out instead?
There was a problem hiding this comment.
This error always comes up when I try to run a worker manager locally. I had to make the same change to get cs324 worker managers to work (#3949) so I thought I might as well add it in this PR.
|
|
||
| ## Start a local Kubernetes Batch Worker Manager (with kind, for testing / development only) | ||
|
|
||
| If you want to test or develop with kubernetes locally, follow these steps to do so: |
There was a problem hiding this comment.
nit: capitalize Kubernetes
Merged
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Allow running a local kubernetes cluster using kind (https://kind.sigs.k8s.io/). kind is a lightweight way to run kubernetes, which runs through a Docker container itself. This way, we can continue to use the Docker daemon for local development and not have to install additional things (for example, other local kubernetes deployments such as minikube require you to install and run a VM)