Skip to content

Update multimodal in-framework FastAPI from NeMo to Megatron Bridge #511

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
meatybobby wants to merge 5 commits into
base: main
Choose a base branch
from
Open

Update multimodal in-framework FastAPI from NeMo to Megatron Bridge #511

meatybobby wants to merge 5 commits into from
+339 −187

Conversation

@meatybobby
Copy link
Contributor

@meatybobby meatybobby commented Nov 14, 2025 •
edited
Loading

Update multimodal in-framework FastAPI:

  • Move loading http/https images in server
  • Support image_url in content
  • Change default top_k=0 in FastAPI for vLLM compatibility
  • Move nemo to megatron bridge

@copy-pr-bot
Copy link

copy-pr-bot bot commented Nov 14, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions bot added documentation Improvements or additions to documentation deploy scripts tests multimodal labels Nov 14, 2025
@meatybobby meatybobby requested a review from marta-sd November 14, 2025 18:30
@meatybobby
Copy link
Contributor Author

meatybobby commented Nov 17, 2025

/ok to test 11d78ec

@athitten athitten added the r0.3.0 r0.3.0 label Nov 18, 2025
@meatybobby meatybobby changed the title Update multimodal in-framework FastAPI Update multimodal in-framework FastAPI from NeMo to Megatron Bridge Jan 29, 2026
@meatybobby
Copy link
Contributor Author

meatybobby commented Jan 29, 2026

/ok to test bd2172e

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@marta-sd marta-sd marta-sd approved these changes

@athitten athitten Awaiting requested review from athitten athitten is a code owner

@oyilmaz-nvidia oyilmaz-nvidia Awaiting requested review from oyilmaz-nvidia oyilmaz-nvidia is a code owner

@pthombre pthombre Awaiting requested review from pthombre pthombre is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

common deploy documentation Improvements or additions to documentation multimodal r0.3.0 r0.3.0 scripts tests

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@meatybobby @marta-sd @athitten