Adding pandarallel library (#1005) · JasonYangCode/docker-python@8d00db0 · GitHub

JasonYangCode / docker-python Public

forked from Kaggle/docker-python

• Notifications You must be signed in to change notification settings
• Fork 0
• Star 1

• Code
• Pull requests
• Actions
• Projects
• Security and quality
• Insights

Additional navigation options

Commit 8d00db0

Browse filesBrowse the repository at this point in the historyBrowse files

manuelsh

authored

Adding pandarallel library (Kaggle#1005)

* Adding pandarallel library Pandarallel allows to execute pandas apply method in parallel, which allows to do data preprocessing faster and easier. This is very he;pful in kernel only competiotions. See: https://github.com/nalepae/pandarallel * Adding test to pandarallel Adding a simple test

1 parent 3d7dd66 commit 8d00db0
Copy full SHA for 8d00db0

2 files changed

+12Lines changed: 12 additions & 0 deletions

File tree

Expand file treeCollapse file tree

Open diff view settings

Filter options

• Dockerfile
• tests
  • test_pandarralel.py

Expand file treeCollapse file tree

Open diff view settings

Collapse file

‎Dockerfile‎

Copy file name to clipboardExpand all lines: Dockerfile

+1Lines changed: 1 addition & 0 deletions

Original file line number	Diff line number	Diff line change
@@ -427,6 +427,7 @@ RUN pip install flashtext && \
427	427	pip install jax==0.2.12 jaxlib==0.1.64 && \
428	428	# ipympl adds interactive widget support for matplotlib
429	429	pip install ipympl==0.7.0 && \
	430	+ pip install pandarallel && \
430	431	/tmp/clean-layer.sh
431	432
432	433	# Download base easyocr models.

Collapse file

‎tests/test_pandarralel.py‎

Copy file name to clipboard

+11Lines changed: 11 additions & 0 deletions

Original file line number	Diff line number	Diff line change
@@ -0,0 +1,11 @@
	1	+ import unittest
	2	+
	3	+ import pandas as pd
	4	+ from pandarallel import pandarallel
	5	+
	6	+ pandarallel.initialize()
	7	+
	8	+ class TestPandarallel(unittest.TestCase):
	9	+ def test_pandarallel(self):
	10	+ data = pd.read_csv("/input/tests/data/train.csv")
	11	+ data['label_converted'] = data['label'].parallel_apply(lambda x: x+1)

0 commit comments

Comments

0 (0)