Add uv cache and prefetch to optimize for venv creation#660
Add uv cache and prefetch to optimize for venv creation#660ananthsub wants to merge 1 commit intoNVIDIA-NeMo:mainfrom
Conversation
Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
ananthsub
changed the title
ananthsub
changed the title
| # UV caching directory overrides to local folders. | ||
| environ["UV_CACHE_DIR"] = str(CACHE_DIR / "uv") | ||
| # Use setdefault so a pre-warmed cache (e.g., in a container) is not overridden. | ||
| environ.setdefault("UV_CACHE_DIR", str(CACHE_DIR / "uv")) |
There was a problem hiding this comment.
can we move this environ resolution to somewhere like here?
Line 262 in f0c830d
want to centralize all parameterized pieces through the global config rather than through environment variables.
There was a problem hiding this comment.
can we migrate this into cli.py, perhaps using the RunHelper as an inspiration? https://github.com/ananthsub/Gym/blob/b8a659be067692e7678a7ce791d3fde5fb03c380/nemo_gym/cli.py#L227
Specifically, we want to remove all environment variables and reuse the existing helper functions such as https://github.com/ananthsub/Gym/blob/b8a659be067692e7678a7ce791d3fde5fb03c380/nemo_gym/cli.py#L65
bxyu-nvidia
left a comment
bxyu-nvidia
left a comment
There was a problem hiding this comment.
What is the expected user experience? can you add some guidance on when this should be used and with what recommended arguments? and also some details about how to use this with NeMo RL?
2 participants
fixes #659