feat: add end-to-end ML workflow tutorial notebook and docs - #728
feat: add end-to-end ML workflow tutorial notebook and docs#728prakharsingh-74 wants to merge 30 commits into
Conversation
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
@andreyvelich Can you please review this PR? |
andreyvelich
left a comment
There was a problem hiding this comment.
This is great, thank you for working on it @prakharsingh-74!
It might be also good to add example with PipelinesClient() that runs
Spark Data Processing -> PyTorch Training -> HP Tuning -> Model Registration.
Do we prefer to add another Notebook for it?
cc @MStokluska @kramaranya @Fiona-Waters @tariq-hasan
/ok-to-test
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
14c2e88 to
7c20ec0
Compare
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
7c20ec0 to
473e287
Compare
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
fbd42b0 to
18a5cb3
Compare
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
…aining functions Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
|
@andreyvelich sir, can you guide me for resolving the CI fails which are occuring on adding of KFP control plane? |
|
@HumairAK @kramaranya @MStokluska @mprahl @alyssacgoins would you be able to help @prakharsingh-74 correctly install KFP control plane in our CI? |
|
Hey @prakharsingh-74 you’ll want to use |
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
|
Thanks for the mentorship, @alyssacgoins! Ready for the review and merge, @andreyvelich. Also, if there are any more issues available, feel free to assign or point me to them. I’ll be happy to take them up and solve them. |
|
/lgtm |
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
|
@andreyvelich Sir, PR is ready for the final look |
|
/lgtm |
|
New changes are detected. LGTM label has been removed. |
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
Signed-off-by: prakharsingh-74 <prakharsingh7014@gmail.com>
013c0f2 to
8df44fe
Compare
|
@alyssacgoins can you please check why CI are getting failed again? |
fixes: #258
Description
This PR introduces a unified end-to-end ML workflow tutorial to demonstrate how the various clients in the Kubeflow SDK (
OptimizerClient,TrainerClient, andModelRegistryClient) integrate.Why is this needed?
Currently, each SDK client is documented in isolation. Providing a cohesive workflow tutorial helps users understand the intended developer experience of utilizing the SDK as a unified ML platform.
Changes
OptimizerClient.TrainerClient.ModelRegistryClient(includes a mock fallback for robust E2E test execution).toctreeindex.hubdependency extra and execute the new notebook as part of E2E verification.Verification
uv run ruff checkanduv run ruff formatto ensure styling guidelines are met.uv run ty check kubeflow/hubto verify type safety.uv run sphinx-build -b html docs/source docs/_build/htmlto verify the documentation builds successfully without new warnings or compilation issues.