feat(registry): add public architecture registration and entry-point discovery - #3645
Open
pstjohn wants to merge 3 commits into
Open
feat(registry): add public architecture registration and entry-point discovery#3645pstjohn wants to merge 3 commits into
pstjohn wants to merge 3 commits into
Conversation
Contributor
|
🌿 Preview your docs: https://nvidia-preview-preview-ae0013712db0.docs.buildwithfern.com/nemo/automodel |
Contributor
|
Wow thank you @pstjohn for adding it! |
pstjohn
force-pushed
the
u-2-public-registry
branch
from
August 25, 2026 01:27
f72c2e2 to
66aaa67
Compare
jgerh
reviewed
Aug 26, 2026
jgerh
left a comment
Contributor
There was a problem hiding this comment.
Completed tech pubs review of docs/model-coverage/overview.mdx and provided some copyedits and suggested text revisions.
Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com> Signed-off-by: Peter St. John <pstjohn@nvidia.com>
pstjohn
force-pushed
the
u-2-public-registry
branch
from
August 26, 2026 18:27
5c98c66 to
fd53aac
Compare
jgerh
reviewed
Aug 27, 2026
jgerh
left a comment
Contributor
There was a problem hiding this comment.
Completed tech pubs review of docs/model-coverage/overview.mdx and provided copyedits and duplicate text deletions.
Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com> Signed-off-by: Peter St. John <pstjohn@nvidia.com>
Author
|
/ok to test ae00137 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds public out-of-tree architecture registration.
Custom model architectures (e.g. multimodal VLMs built by decorating a Hub-resolved text-only model) must register with AutoModel's model registry before construction. Today that requires importing the private
nemo_automodel._transformers.registry.ModelRegistryand callingregister()in every process that resolves architectures — including isolated Ray workers and CLI subprocesses where import-order dependencies are fragile._ModelRegistrynow scansnemo_automodel.architecturesentry points on first access, same shape as vLLM'svllm.general_plugins. Entries arearch_name = module.path:ClassNameand are added to the lazy mapping without importing the target module; import happens on first architecture resolution, exactly like the built-inMODEL_ARCH_MAPPINGentries.We also export a public
register_architecture():This just delegates to the same
_ModelRegistry.register, so explicit and entry-point-discovered registrations share one code path.With entry-point discovery, you can now declare their architecture once in your
pyproject.tomland every process discovers it automatically:This uses Python's standard
importlib.metadata.entry_points()(PEP 621).