SpeechBrain EEG by ddavidebb · Pull Request #975 · speechbrain/speechbrain · GitHub

This is the first commit for a motor imagery decoding recipe based on a benchmark motor imagery dataset (BNCI2014001).
README and other minors are missing.

Please, add a short docstring that explain what we are doing here

Here you should improve the docstring with a better description of what we are doing + description of the arguments (see other docstrings)

Please, add a docstring + description of input/output arguments

Improve docstring (like above)

Is that needed? I don't use mne used and I think we solved the warning issue in the previous recipe, right?

The number of classes seems hardcoded it. Can we put in the yaml file?

Please, write the header. Here is the place where I would mention the EEGNET

I think this should be output_folder: results/MOABB_BNCI2014001/<seed>. Otherwise, it is hardcoded.

An alternative here would be to define the model in lobes (e.g. speechbrain/lobes/EEGNET.py). However, defining it every time doesn't look that bad to me in the end.

Thank you @ddavidebb , great job! This looks already in a good shape.
Beyond the punctual comments done above, let me share a couple of additional suggestions:

It looks like train.py is dataset-specific (BNCI2014001). However, I think the code should be easily made dataset-independent. For instance, instead of importing the library at the beginning, you can import it right after reading the hparams file. You can add a variable like in the yaml file (e.g., dataset="moabb.datasets.BNCI2014001") and import the library from this string using importlib like:

moabb_dataset= importlib.import_module(hparams["dataset"])
moabb_dataset = moabb_dataset()

e.g, https://www.devdungeon.com/content/import-python-module-string-name

If we are able to make the train.py dataset independent we can share it across all the datasets that we would like to address. Not sure about that, but maybe we can even create a single train.py for all the MOABB tasks (i.e., not only for Motor imagery detection). What do you think?

The MOABB_dataio_iterators.py looks something in common to all the MOABB datasets. One possible approach here (already used in other recipes for the data preparation part) could be to put the script in recipes/MOABB/ and add a symboling link in recipes/MOABB/MOABB/MotorImagery_decoding/BNCI2014001/

I think this is used on the StratifiedKFold splits...
don't we want to split the data such that we don't have the same sessions of the same subject on train and test?
I think there's a data leakage problem if we do like this. In fact, you already "know" your subject from the train set.
Maybe this is implemented somewhere else and I am just missing it!

…into eeg_decoding

…in parallel

…ile, added baselines, added EEGConformer, removed DeepConvNet and LMDA

… hparam space of ShallowConvNet and EEGConformer

I'm now going to merge the content of this PR in develop and open a new one in speechbrain/benchmarks with the EEG recipes.

ddavidebb added 4 commits September 8, 2021 19:29

first commit moabb motor imagery

f2ce000

initial commit MOABB motor imagery

9064d14

initial motor imagery commit

6d0b09e

First commit Motor imagery decoding

780c28b

ddavidebb requested a review from mravanelli September 8, 2021 17:50

ddavidebb added enhancement New feature or request work in progress Not ready for merge labels Sep 8, 2021

fixed linters

8bd5251

mravanelli requested changes Sep 8, 2021

View reviewed changes

mravanelli assigned ddavidebb Sep 8, 2021

fpaissan reviewed Sep 9, 2021

View reviewed changes

ddavidebb and others added 18 commits October 1, 2021 17:08

Reviewed after first round of revision

f058418

Removed outdated files

24f3704

Reviewed code after second round of revision

461abf3

reviewed README

78f6153

reviewed README

1177330

solved checkpoint saving issue + test on single best metrics

9d6861d

fixed linters

5b59e2e

fixed linters

0f78172

Merge branch 'develop' of https://github.com/speechbrain/speechbrain …

d1b2a42

…into eeg_decoding

fixed CNN transpose issue

11dff42

script for results aggregation

b0f6e2b

add docstring and parameter for result dir parsing

db37c79

fixed cross-session

c2a7f7e

direct results folder

bd39d7e

fixed linters

654399c

passing desired metrics as parameters

5706c87

tentive fix to nested dictionary

12e4679

small fixed in parsing and README

082db17

ddavidebb and others added 26 commits August 14, 2023 07:52

Fixed read/write conflicts mne config file when training many models …

331741d

…in parallel

Added hparam files for other architectures

0f25d5b

Updated LMDA, forcing odd kernel size in depth attention

9ba76e3

Fixed activation in LMDA

6336200

Fixed issue in deepconvnet

1593cc4

Fixed issue with shallowconvnet

2f0f5f0

Fixed issue with lmda

8f70136

Added template yaml files

66633a0

small fix on orion flag

8a98401

extend fix to all files

7da9a95

fix style

4b09ff2

Merge remote-tracking branch 'upstream/develop' into eeg_decoding

ced2922

fix useless file

5e070a2

Added bash script to save yaml files, fixed issue with orion config f…

164f8fe

…ile, added baselines, added EEGConformer, removed DeepConvNet and LMDA

Fixed issue in yaml

3d39ccd

Fixed issue in baseline yaml

321c9f7

Removed baselines, fixes in code format of ShallowConvNet, changes in…

6fd881e

… hparam space of ShallowConvNet and EEGConformer

Updated yaml files after hparam tuning

221f2da

Updated EEGConformer

208bccb

Updated README.md

dcc29c7

Updated README.md

5b791fe

Merge remote-tracking branch 'upstream/develop' into eeg_decoding

9861876

fix linters

d0296f5

improve README

e412656

remove unnecesary folder

e8be915

remove files that will be added into speechbrain benchmark

e431763

mravanelli removed the work in progress Not ready for merge label Oct 2, 2023

mravanelli approved these changes Oct 2, 2023

View reviewed changes

mravanelli merged commit 48f5ddd into speechbrain:develop Oct 2, 2023

+              if __name__ == "__main__":
+                  argv = sys.argv[1:]
+                  # Temporary switching off deprecation warning from mne
+                  import warnings  # noqa

+                  # to run on a subset of subjects: moabb_dataset.subject_list = [1, 2, 3, 4]
+                  moabb_dataset.download(path=hparams["data_folder"])
+                  moabb_paradigm = MotorImagery(
+                      n_classes=4,

SpeechBrain EEG by ddavidebb · Pull Request #975 · speechbrain/speechbrain · GitHub

Uh oh!

SpeechBrain EEG - #975

SpeechBrain EEG#975
mravanelli merged 240 commits into
speechbrain:developfrom
ddavidebb:eeg_decoding

ddavidebb commented Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli Sep 8, 2021

Uh oh!

mravanelli commented Sep 8, 2021

Uh oh!

fpaissan Sep 9, 2021

Uh oh!

mravanelli commented Oct 2, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

+                      self.iterator_tag = "within-session"
+                  def prepare(self, dataset):
+                      if not (isinstance(dataset, BaseDataset)):



		class LeaveOneSubjectOut(object):
		"""Leave one subject out"""

		@@ -0,0 +1,144 @@
		###################################################

+              # DIRECTORIES
+              data_folder: !PLACEHOLDER  #'/path/to/MOABB_BNCI2014001'
+              output_folder: '/home/prometheus/Documents/results/MOABB_BNCI2014001' #!ref results/MOABB_BNCI2014001/<seed>

+              p_drop: 0.5  # dropout rate
+              padding_mode: 'constant'
+              layer0: !new:speechbrain.nnet.CNN.Conv2d

		@@ -0,0 +1,409 @@
		import numpy as np



		class WithinSession(object):
		"""Within Session """



		class CrossSession(object):
		"""Cross Session """

		return standardized


		def nth(iterable, n, default=None):

SpeechBrain EEG by ddavidebb · Pull Request #975 · speechbrain/speechbrain · GitHub

Uh oh!

SpeechBrain EEG - #975

SpeechBrain EEG#975mravanelli merged 240 commits intospeechbrain:developspeechbrain/speechbrain:developfrom ddavidebb:eeg_decodingddavidebb/speechbrain-1:eeg_decodingCopy head branch name to clipboard

Conversation

ddavidebb commented Sep 8, 2021

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mravanelli commented Sep 8, 2021

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mravanelli commented Oct 2, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

SpeechBrain EEG#975
mravanelli merged 240 commits into
speechbrain:developfrom
ddavidebb:eeg_decoding