The TimerBed Evaluation Suite and The VL-Time Method
This repository contains the implementation of TimerBed and the proposed VL-Time method for time series reasoning tasks.
- /Dataset: Contains datasets for 6 time reasoning tasks, unified into a classification task format. Due to size limitations, RCW and ECG datasets are not included in this repository but will be made available in the final version through alternative means.
- /SupervisedModels: Contains supervised time series models used for comparison.
- /LLMs: Contains LLM-based methods, including traditional numerical modeling and the proposed VL-Time method.
Step 1: Install Dependencies
Install the required libraries by running:
-
Navigate to the SupervisedModels directory:
-
Run experiments using scripts in the scripts folder. For example:
- Use --root_path to specify the dataset
- Use --model to specify the model
-
Navigate to the LLMs directory:
-
Set up API key:
- Add your API key in /LLMs/Method/LMM.py
- Specifically, set the openai_api_key
-
Prepare visualization data:
- Place the visualization data in the LLMs/Dataset folder
- Currently, data for visual modeling is provided
-
Run experiments:
- Set modal="L" for traditional numerical modeling
- Set modal="V" for VL-Time visual modeling
- Use --model to specify different LLMs
- Set --num_shot_per_class=0 for zero-shot reasoning; use values >0 for few-shot setting
- Use --hint="Please solve this problem step by step" for chain-of-thought reasoning
This library is constructed based on the following repos:
https://github.com/thuml/Time-Series-Library/
https://github.com/stanfordmlgroup/ManyICL