FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

Install tensorflow-gcs-config from the python-tensorflow-whl by mcollins42 · Pull Request #788 · Kaggle/docker-python · GitHub

Repository navigation

Install tensorflow-gcs-config from the python-tensorflow-whl - #788

Merged
mcollins42 merged 2 commits into
masterfrom
update-tensorflow-wheel-py37-3
Apr 27, 2020
Merged

mcollins42 merged 2 commits into
masterfrom
update-tensorflow-wheel-py37-3

Conversation

Copy link
Copy Markdown
Contributor

Update the version of python-tensorflow-whl used in the build and install tensorflow-gcs-config from the wheel.

http://b/152051681

mcollins42 requested a review from rosbo April 24, 2020 19:32

rosbo left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Choose a reason Spam Abuse Off Topic Outdated Duplicate Resolved Low Quality

Can you add a test to ensure we don't have regression for the tensorflow-gcs-config package?

  1. You can add a new file at tests/test_tensorflow_gcs_config.py.
  2. Wait until ci built has built this image.
  3. Run docker pull gcr.io/kaggle-images/update-tensorflow-wheel-py37-3-staging
  4. Iterate until you have a good test that passes: ./test -i gcr.io/kaggle-images/update-tensorflow-wheel-py37-3-staging -p tests/test_tensorflow_gcs_config.py

Copy link
Copy Markdown
Contributor Author

I can add a test, but beyond checking if the module loads (this was failing with the binary distribution) and that a call to the main entry point doesn't fail, it's not clear how we would check whether the package is actually working in a test environment. Any thoughts? I'm not sure how far we've gone with some of the other packages.

rosbo commented Apr 24, 2020 •
edited
Loading

Copy link
Copy Markdown
Contributor

Checking that the module can load would be a good start. You could add it here:
https://github.com/Kaggle/docker-python/blob/master/tests/test_imports.py

I don't know the tensorflow-gcs-config package much but here are some examples of advanced test:

I wouldn't go as far as running a GCS emulator for this simple test.

Copy link
Copy Markdown
Contributor Author

I tried adding a test to import the module and call the main entry point configure_gcs, but sadly even that call immediately makes a request to the Google OAuth server to validate the credential passed in, so add it to test_imports.py seems to be the most we can do without some serious hacking.

mcollins42 merged commit acfe293 into master Apr 27, 2020
mcollins42 added a commit that referenced this pull request May 1, 2020
mcollins42 added a commit that referenced this pull request May 6, 2020
rosbo deleted the update-tensorflow-wheel-py37-3 branch May 14, 2020 23:31
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants


Back | FazBrowse Home | New Git URL