Merge pull request #829 from Kaggle/unpin-distributed · AI-For-Rural/docker-python@4b8bc76 · GitHub

AI-For-Rural / docker-python Public

forked from Kaggle/docker-python

• Notifications You must be signed in to change notification settings
• Fork 0
• Star 1

• Code
• Pull requests
• Actions
• Projects
• Security and quality
• Insights

Additional navigation options

Commit 4b8bc76

Browse filesBrowse the repository at this point in the historyBrowse files

rosbo

authored

Merge pull request Kaggle#829 from Kaggle/unpin-distributed

Unpin distributed

2 parents 6cc39c3 + 56c109c commit 4b8bc76
Copy full SHA for 4b8bc76

2 files changed

+6-3Lines changed: 6 additions & 3 deletions

File tree

Expand file treeCollapse file tree

Open diff view settings

Filter options

• Dockerfile
• test

Expand file treeCollapse file tree

Open diff view settings

Collapse file

‎Dockerfile‎

Copy file name to clipboardExpand all lines: Dockerfile

+1-3Lines changed: 1 addition & 3 deletions

Original file line number	Diff line number	Diff line change
@@ -49,9 +49,7 @@ RUN conda config --add channels conda-forge && \
49	49	/tmp/clean-layer.sh
50	50
51	51	# The anaconda base image includes outdated versions of these packages. Update them to include the latest version.
52		- # b/150498764 distributed 2.11.0 fails at import while trying to reach out to 8.8.8.8 since the network is disabled in our hermetic tests.
53		- RUN pip install distributed==2.10.0 && \
54		- pip install seaborn python-dateutil dask && \
	52	+ RUN pip install seaborn python-dateutil dask && \
55	53	pip install pyyaml joblib pytagcloud husl geopy ml_metrics mne pyshp && \
56	54	pip install pandas && \
57	55	# Install h2o from source.

Collapse file

‎test‎

Copy file name to clipboardExpand all lines: test

+5Lines changed: 5 additions & 0 deletions

Original file line number	Diff line number	Diff line change
@@ -87,13 +87,18 @@ fi
87	87	# By default, TensorFlow maps nearly all of the GPU memory visible to the process.
88	88	# This is causing issue when other libraries are trying to run tests using a GPU.
89	89	# See: https://www.tensorflow.org/guide/gpu#allowing_gpu_memory_growth
	90	+ #
	91	+ # Note about `--hostname localhost` (b/158137436)
	92	+ # hostname defaults to the container name which fails DNS name
	93	+ # resolution with --net=none (required to keep tests hermetic). See details in bug.
90	94	docker run --rm -t --read-only --net=none \
91	95	-e HOME=/tmp -e KAGGLE_DATA_PROXY_TOKEN=test-key \
92	96	-e KAGGLE_USER_SECRETS_TOKEN_KEY=test-secrets-key \
93	97	-e KAGGLE_URL_BASE=http://127.0.0.1:8001 \
94	98	-e KAGGLE_DATA_PROXY_URL=http://127.0.0.1:8000 \
95	99	-e KAGGLE_DATA_PROXY_PROJECT=test \
96	100	-e TF_FORCE_GPU_ALLOW_GROWTH=true \
	101	+ --hostname localhost \
97	102	--shm-size=2g \
98	103	-v $PWD:/input:ro -v /tmp/python-build/working:/working \
99	104	-v /tmp/python-build/tmp:/tmp -v /tmp/python-build/devshm:/dev/shm \

0 commit comments

Comments

0 (0)