This directory contains examples to demonstrate how to use BigDL Orca XShards for distributed data preprocesing.

We recommend you to use Anaconda to prepare the environment:

conda create -n bigdl python=3.7  # "bigdl" is the conda environment name, you can use any name you like.
conda activate bigdl
pip install --pre --upgrade bigdl-orca[ray]

• For auto_mpg.py, the dataset can be downloaded from here.
• For diabetes.py, the dataset can be downloaded from here.
• For ionosphere.py, the dataset can be downloaded from here.
• For tabular_playground_series.py, the dataset can be downloaded from here.
• For titanic.py, the dataset can be downloaded from here.
• For answer_correctness_analysis.py, the dataset can be downloaded from here
• For house_price_analysis.py, the dataset can be downloaded from here