Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

CPP GPU test running too long #13924

Closed
lanking520 opened this issue Jan 17, 2019 · 1 comment
Closed

CPP GPU test running too long #13924

lanking520 opened this issue Jan 17, 2019 · 1 comment
Labels
C++ Related to C++ CI

Comments

@lanking520
Copy link
Member

URL:
http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-gpu/detail/PR-13914/3/pipeline/278

Currently CPP GPU takes around 72 minutes to finish all its trainning tasks and it is not ideal for a PR CI test to handle that. Essentially the CI to verify the PR is to ensure the functionalities didn't have any problems. The performance test ideally should be placed under the nightly tests. As @leleamol recommended, some improvement can be taken in here such as the number of epoch to be set to 1. This would bring down the runtime for this test to under 30 minutes and save time.

@marcoabreu
@lanking520 lanking520 added C++ Related to C++ CI labels Jan 17, 2019
@ChaiBapchya ChaiBapchya mentioned this issue Jan 26, 2019
Open
@leleamol leleamol mentioned this issue Feb 14, 2019
Merged
7 tasks
@lanking520
Copy link
Member Author

Close this issue since problem fixed. Thanks @leleamol for his contribution!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
C++ Related to C++ CI
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@lanking520