Note

Click here to download the full example code

# Spatiotemporal permutation F-test on full sensor data¶

Tests for differential evoked responses in at least one condition using a permutation clustering test. The FieldTrip neighbor templates will be used to determine the adjacency between sensors. This serves as a spatial prior to the clustering. Spatiotemporal clusters will then be visualized using custom matplotlib code.

See the FieldTrip website for a caveat regarding the possible interpretation of “significant” clusters.

```
# Authors: Denis Engemann <denis.engemann@gmail.com>
# Jona Sassenhagen <jona.sassenhagen@gmail.com>
#
# License: BSD (3-clause)
import numpy as np
import matplotlib.pyplot as plt
from mpl_toolkits.axes_grid1 import make_axes_locatable
import mne
from mne.stats import spatio_temporal_cluster_test
from mne.datasets import sample
from mne.channels import find_ch_adjacency
from mne.viz import plot_compare_evokeds
print(__doc__)
```

## Set parameters¶

```
data_path = sample.data_path()
raw_fname = data_path + '/MEG/sample/sample_audvis_filt-0-40_raw.fif'
event_fname = data_path + '/MEG/sample/sample_audvis_filt-0-40_raw-eve.fif'
event_id = {'Aud/L': 1, 'Aud/R': 2, 'Vis/L': 3, 'Vis/R': 4}
tmin = -0.2
tmax = 0.5
# Setup for reading the raw data
raw = mne.io.read_raw_fif(raw_fname, preload=True)
raw.filter(1, 30, fir_design='firwin')
events = mne.read_events(event_fname)
```

Out:

```
Opening raw data file /home/circleci/mne_data/MNE-sample-data/MEG/sample/sample_audvis_filt-0-40_raw.fif...
Read a total of 4 projection items:
PCA-v1 (1 x 102) idle
PCA-v2 (1 x 102) idle
PCA-v3 (1 x 102) idle
Average EEG reference (1 x 60) idle
Range : 6450 ... 48149 = 42.956 ... 320.665 secs
Ready.
Reading 0 ... 41699 = 0.000 ... 277.709 secs...
Filtering raw data in 1 contiguous segment
Setting up band-pass filter from 1 - 30 Hz
FIR filter parameters
---------------------
Designing a one-pass, zero-phase, non-causal bandpass filter:
- Windowed time-domain design (firwin) method
- Hamming window with 0.0194 passband ripple and 53 dB stopband attenuation
- Lower passband edge: 1.00
- Lower transition bandwidth: 1.00 Hz (-6 dB cutoff frequency: 0.50 Hz)
- Upper passband edge: 30.00 Hz
- Upper transition bandwidth: 7.50 Hz (-6 dB cutoff frequency: 33.75 Hz)
- Filter length: 497 samples (3.310 sec)
```

## Read epochs for the channel of interest¶

```
picks = mne.pick_types(raw.info, meg='mag', eog=True)
reject = dict(mag=4e-12, eog=150e-6)
epochs = mne.Epochs(raw, events, event_id, tmin, tmax, picks=picks,
baseline=None, reject=reject, preload=True)
epochs.drop_channels(['EOG 061'])
epochs.equalize_event_counts(event_id)
X = [epochs[k].get_data() for k in event_id] # as 3D matrix
X = [np.transpose(x, (0, 2, 1)) for x in X] # transpose for clustering
```

Out:

```
Not setting metadata
Not setting metadata
288 matching events found
No baseline correction applied
Created an SSP operator (subspace dimension = 3)
4 projection items activated
Loading data for 288 events and 106 original time points ...
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on MAG : ['MEG 1711']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on MAG : ['MEG 1711']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
Rejecting epoch based on EOG : ['EOG 061']
49 bad epochs dropped
Removing projector <Projection | Average EEG reference, active : True, n_channels : 60>
Dropped 19 epochs: 50, 51, 84, 93, 95, 96, 129, 146, 149, 150, 154, 156, 157, 189, 194, 200, 202, 210, 211
```

## Find the FieldTrip neighbor definition to setup sensor adjacency¶

```
adjacency, ch_names = find_ch_adjacency(epochs.info, ch_type='mag')
print(type(adjacency)) # it's a sparse matrix!
plt.imshow(adjacency.toarray(), cmap='gray', origin='lower',
interpolation='nearest')
plt.xlabel('{} Magnetometers'.format(len(ch_names)))
plt.ylabel('{} Magnetometers'.format(len(ch_names)))
plt.title('Between-sensor adjacency')
```

Out:

```
Reading adjacency matrix for neuromag306mag.
<class 'scipy.sparse.csr.csr_matrix'>
```

## Compute permutation statistic¶

How does it work? We use clustering to “bind” together features which are similar. Our features are the magnetic fields measured over our sensor array at different times. This reduces the multiple comparison problem. To compute the actual test-statistic, we first sum all F-values in all clusters. We end up with one statistic for each cluster. Then we generate a distribution from the data by shuffling our conditions between our samples and recomputing our clusters and the test statistics. We test for the significance of a given cluster by computing the probability of observing a cluster of that size. For more background read: Maris/Oostenveld (2007), “Nonparametric statistical testing of EEG- and MEG-data” Journal of Neuroscience Methods, Vol. 164, No. 1., pp. 177-190. doi:10.1016/j.jneumeth.2007.03.024

```
# set cluster threshold
threshold = 50.0 # very high, but the test is quite sensitive on this data
# set family-wise p-value
p_accept = 0.01
cluster_stats = spatio_temporal_cluster_test(X, n_permutations=1000,
threshold=threshold, tail=1,
n_jobs=1, buffer_size=None,
adjacency=adjacency)
T_obs, clusters, p_values, _ = cluster_stats
good_cluster_inds = np.where(p_values < p_accept)[0]
```

Out:

```
stat_fun(H1): min=0.004107 max=196.094418
Running initial clustering
Found 8 clusters
Permuting 999 times...
0%| | : 0/999 [00:00<?, ?it/s]
0%| | : 1/999 [00:00<00:34, 28.86it/s]
0%| | : 4/999 [00:00<00:16, 59.04it/s]
1%| | : 7/999 [00:00<00:14, 69.29it/s]
1%| | : 9/999 [00:00<00:14, 66.46it/s]
1%|1 | : 13/999 [00:00<00:12, 77.84it/s]
2%|1 | : 16/999 [00:00<00:12, 79.86it/s]
2%|1 | : 19/999 [00:00<00:12, 81.20it/s]
2%|2 | : 22/999 [00:00<00:11, 82.32it/s]
3%|2 | : 25/999 [00:00<00:11, 83.17it/s]
3%|2 | : 28/999 [00:00<00:11, 83.79it/s]
3%|3 | : 31/999 [00:00<00:11, 84.37it/s]
3%|3 | : 34/999 [00:00<00:11, 84.83it/s]
4%|3 | : 37/999 [00:00<00:11, 85.16it/s]
4%|4 | : 41/999 [00:00<00:10, 88.39it/s]
4%|4 | : 43/999 [00:00<00:11, 85.66it/s]
5%|4 | : 46/999 [00:00<00:11, 85.91it/s]
5%|5 | : 50/999 [00:00<00:10, 88.69it/s]
5%|5 | : 52/999 [00:00<00:10, 86.24it/s]
6%|5 | : 55/999 [00:00<00:10, 86.38it/s]
6%|5 | : 59/999 [00:00<00:10, 88.86it/s]
6%|6 | : 62/999 [00:00<00:10, 88.84it/s]
6%|6 | : 64/999 [00:00<00:10, 86.60it/s]
7%|6 | : 68/999 [00:00<00:10, 88.89it/s]
7%|7 | : 71/999 [00:00<00:10, 88.87it/s]
7%|7 | : 74/999 [00:00<00:10, 88.83it/s]
8%|7 | : 77/999 [00:00<00:10, 88.82it/s]
8%|8 | : 80/999 [00:00<00:10, 88.81it/s]
8%|8 | : 83/999 [00:00<00:10, 88.77it/s]
9%|8 | : 87/999 [00:00<00:10, 90.67it/s]
9%|8 | : 89/999 [00:01<00:10, 88.65it/s]
9%|9 | : 92/999 [00:01<00:10, 88.62it/s]
10%|9 | : 96/999 [00:01<00:09, 90.47it/s]
10%|9 | : 98/999 [00:01<00:10, 88.54it/s]
10%|# | : 101/999 [00:01<00:10, 88.50it/s]
11%|# | : 105/999 [00:01<00:09, 90.29it/s]
11%|# | : 107/999 [00:01<00:10, 88.43it/s]
11%|#1 | : 111/999 [00:01<00:09, 90.14it/s]
11%|#1 | : 114/999 [00:01<00:09, 90.06it/s]
12%|#1 | : 116/999 [00:01<00:10, 88.28it/s]
12%|#2 | : 120/999 [00:01<00:09, 89.96it/s]
12%|#2 | : 123/999 [00:01<00:09, 89.89it/s]
13%|#2 | : 125/999 [00:01<00:09, 88.12it/s]
13%|#2 | : 128/999 [00:01<00:09, 88.10it/s]
13%|#3 | : 132/999 [00:01<00:09, 89.77it/s]
13%|#3 | : 134/999 [00:01<00:09, 88.04it/s]
14%|#3 | : 138/999 [00:01<00:09, 89.70it/s]
14%|#4 | : 141/999 [00:01<00:09, 89.63it/s]
14%|#4 | : 144/999 [00:01<00:09, 89.56it/s]
15%|#4 | : 147/999 [00:01<00:09, 89.50it/s]
15%|#5 | : 151/999 [00:01<00:09, 91.04it/s]
15%|#5 | : 153/999 [00:01<00:09, 89.32it/s]
16%|#5 | : 157/999 [00:01<00:09, 90.87it/s]
16%|#6 | : 160/999 [00:01<00:09, 90.75it/s]
16%|#6 | : 162/999 [00:01<00:09, 89.06it/s]
17%|#6 | : 166/999 [00:01<00:09, 90.61it/s]
17%|#6 | : 169/999 [00:01<00:09, 90.50it/s]
17%|#7 | : 172/999 [00:01<00:09, 90.39it/s]
18%|#7 | : 175/999 [00:01<00:09, 90.30it/s]
18%|#7 | : 178/999 [00:02<00:09, 90.22it/s]
18%|#8 | : 181/999 [00:02<00:09, 90.13it/s]
18%|#8 | : 184/999 [00:02<00:09, 90.06it/s]
19%|#8 | : 187/999 [00:02<00:09, 89.99it/s]
19%|#9 | : 190/999 [00:02<00:08, 89.90it/s]
19%|#9 | : 193/999 [00:02<00:08, 89.84it/s]
20%|#9 | : 196/999 [00:02<00:08, 89.78it/s]
20%|#9 | : 199/999 [00:02<00:08, 89.72it/s]
20%|## | : 203/999 [00:02<00:08, 91.19it/s]
21%|## | : 206/999 [00:02<00:08, 91.06it/s]
21%|## | : 209/999 [00:02<00:08, 90.92it/s]
21%|##1 | : 212/999 [00:02<00:08, 90.79it/s]
22%|##1 | : 216/999 [00:02<00:08, 92.18it/s]
22%|##1 | : 219/999 [00:02<00:08, 91.98it/s]
22%|##2 | : 222/999 [00:02<00:08, 91.81it/s]
23%|##2 | : 225/999 [00:02<00:08, 91.63it/s]
23%|##2 | : 228/999 [00:02<00:08, 91.48it/s]
23%|##3 | : 232/999 [00:02<00:08, 92.85it/s]
24%|##3 | : 235/999 [00:02<00:08, 92.63it/s]
24%|##3 | : 237/999 [00:02<00:08, 90.92it/s]
24%|##4 | : 241/999 [00:02<00:08, 92.28it/s]
24%|##4 | : 244/999 [00:02<00:08, 92.10it/s]
25%|##4 | : 247/999 [00:02<00:08, 91.91it/s]
25%|##5 | : 250/999 [00:02<00:08, 91.74it/s]
25%|##5 | : 253/999 [00:02<00:08, 91.59it/s]
26%|##5 | : 256/999 [00:02<00:08, 91.44it/s]
26%|##6 | : 260/999 [00:02<00:07, 92.80it/s]
26%|##6 | : 262/999 [00:02<00:08, 91.08it/s]
27%|##6 | : 265/999 [00:02<00:08, 90.95it/s]
27%|##6 | : 269/999 [00:02<00:07, 92.32it/s]
27%|##7 | : 271/999 [00:03<00:08, 90.65it/s]
27%|##7 | : 274/999 [00:03<00:08, 90.55it/s]
28%|##7 | : 278/999 [00:03<00:07, 91.95it/s]
28%|##8 | : 281/999 [00:03<00:07, 91.78it/s]
28%|##8 | : 284/999 [00:03<00:07, 91.59it/s]
29%|##8 | : 287/999 [00:03<00:07, 91.45it/s]
29%|##9 | : 290/999 [00:03<00:07, 91.31it/s]
29%|##9 | : 293/999 [00:03<00:07, 91.17it/s]
30%|##9 | : 296/999 [00:03<00:07, 91.04it/s]
30%|##9 | : 299/999 [00:03<00:07, 90.93it/s]
30%|### | : 302/999 [00:03<00:07, 90.81it/s]
31%|### | : 306/999 [00:03<00:07, 92.19it/s]
31%|### | : 308/999 [00:03<00:07, 90.53it/s]
31%|###1 | : 312/999 [00:03<00:07, 91.91it/s]
32%|###1 | : 315/999 [00:03<00:07, 91.75it/s]
32%|###1 | : 318/999 [00:03<00:07, 91.59it/s]
32%|###2 | : 321/999 [00:03<00:07, 91.44it/s]
33%|###2 | : 325/999 [00:03<00:07, 92.78it/s]
33%|###2 | : 327/999 [00:03<00:07, 91.08it/s]
33%|###3 | : 331/999 [00:03<00:07, 92.44it/s]
34%|###3 | : 335/999 [00:03<00:07, 93.72it/s]
34%|###3 | : 337/999 [00:03<00:07, 91.96it/s]
34%|###4 | : 341/999 [00:03<00:07, 93.27it/s]
34%|###4 | : 344/999 [00:03<00:07, 93.03it/s]
35%|###4 | : 346/999 [00:03<00:07, 91.31it/s]
35%|###5 | : 350/999 [00:03<00:07, 92.65it/s]
35%|###5 | : 353/999 [00:03<00:06, 92.44it/s]
36%|###5 | : 356/999 [00:03<00:06, 92.24it/s]
36%|###6 | : 360/999 [00:03<00:06, 93.54it/s]
36%|###6 | : 363/999 [00:04<00:06, 93.29it/s]
37%|###6 | : 366/999 [00:04<00:06, 93.05it/s]
37%|###6 | : 369/999 [00:04<00:06, 92.82it/s]
37%|###7 | : 373/999 [00:04<00:06, 94.09it/s]
38%|###7 | : 375/999 [00:04<00:06, 92.34it/s]
38%|###7 | : 379/999 [00:04<00:06, 93.63it/s]
38%|###8 | : 382/999 [00:04<00:06, 93.38it/s]
39%|###8 | : 385/999 [00:04<00:06, 93.14it/s]
39%|###8 | : 389/999 [00:04<00:06, 94.40it/s]
39%|###9 | : 392/999 [00:04<00:06, 94.11it/s]
39%|###9 | : 394/999 [00:04<00:06, 92.34it/s]
40%|###9 | : 398/999 [00:04<00:06, 93.64it/s]
40%|#### | : 401/999 [00:04<00:06, 93.38it/s]
40%|#### | : 404/999 [00:04<00:06, 93.13it/s]
41%|#### | : 407/999 [00:04<00:06, 92.91it/s]
41%|####1 | : 410/999 [00:04<00:06, 92.70it/s]
41%|####1 | : 413/999 [00:04<00:06, 92.47it/s]
42%|####1 | : 417/999 [00:04<00:06, 93.77it/s]
42%|####2 | : 420/999 [00:04<00:06, 93.52it/s]
42%|####2 | : 422/999 [00:04<00:06, 91.80it/s]
43%|####2 | : 426/999 [00:04<00:06, 93.12it/s]
43%|####2 | : 429/999 [00:04<00:06, 92.90it/s]
43%|####3 | : 431/999 [00:04<00:06, 91.21it/s]
44%|####3 | : 435/999 [00:04<00:06, 92.56it/s]
44%|####3 | : 438/999 [00:04<00:06, 92.36it/s]
44%|####4 | : 441/999 [00:04<00:06, 92.17it/s]
44%|####4 | : 444/999 [00:04<00:06, 92.00it/s]
45%|####4 | : 447/999 [00:04<00:06, 91.83it/s]
45%|####5 | : 450/999 [00:04<00:05, 91.66it/s]
45%|####5 | : 454/999 [00:04<00:05, 93.00it/s]
46%|####5 | : 456/999 [00:05<00:05, 91.30it/s]
46%|####5 | : 459/999 [00:05<00:05, 91.14it/s]
46%|####6 | : 463/999 [00:05<00:05, 92.48it/s]
47%|####6 | : 465/999 [00:05<00:05, 90.79it/s]
47%|####6 | : 469/999 [00:05<00:05, 92.16it/s]
47%|####7 | : 472/999 [00:05<00:05, 91.99it/s]
48%|####7 | : 475/999 [00:05<00:05, 91.81it/s]
48%|####7 | : 478/999 [00:05<00:05, 91.64it/s]
48%|####8 | : 481/999 [00:05<00:05, 91.50it/s]
48%|####8 | : 484/999 [00:05<00:05, 91.36it/s]
49%|####8 | : 487/999 [00:05<00:05, 91.22it/s]
49%|####9 | : 491/999 [00:05<00:05, 92.57it/s]
49%|####9 | : 493/999 [00:05<00:05, 90.89it/s]
50%|####9 | : 496/999 [00:05<00:05, 90.75it/s]
50%|##### | : 500/999 [00:05<00:05, 92.12it/s]
50%|##### | : 502/999 [00:05<00:05, 90.45it/s]
51%|##### | : 505/999 [00:05<00:05, 90.36it/s]
51%|##### | : 509/999 [00:05<00:05, 91.75it/s]
51%|#####1 | : 511/999 [00:05<00:05, 90.11it/s]
52%|#####1 | : 515/999 [00:05<00:05, 91.51it/s]
52%|#####1 | : 518/999 [00:05<00:05, 91.37it/s]
52%|#####2 | : 520/999 [00:05<00:05, 89.74it/s]
52%|#####2 | : 523/999 [00:05<00:05, 89.68it/s]
53%|#####2 | : 527/999 [00:05<00:05, 91.10it/s]
53%|#####2 | : 529/999 [00:05<00:05, 89.49it/s]
53%|#####3 | : 532/999 [00:05<00:05, 89.43it/s]
54%|#####3 | : 536/999 [00:05<00:05, 90.87it/s]
54%|#####3 | : 538/999 [00:05<00:05, 89.27it/s]
54%|#####4 | : 541/999 [00:05<00:05, 89.24it/s]
54%|#####4 | : 544/999 [00:05<00:05, 89.20it/s]
55%|#####4 | : 546/999 [00:06<00:05, 87.69it/s]
55%|#####5 | : 550/999 [00:06<00:05, 89.22it/s]
55%|#####5 | : 553/999 [00:06<00:05, 89.20it/s]
56%|#####5 | : 555/999 [00:06<00:05, 87.68it/s]
56%|#####5 | : 558/999 [00:06<00:05, 87.73it/s]
56%|#####6 | : 561/999 [00:06<00:04, 87.78it/s]
56%|#####6 | : 563/999 [00:06<00:05, 86.34it/s]
57%|#####6 | : 567/999 [00:06<00:04, 87.93it/s]
57%|#####6 | : 569/999 [00:06<00:04, 86.49it/s]
57%|#####7 | : 572/999 [00:06<00:04, 86.58it/s]
58%|#####7 | : 575/999 [00:06<00:04, 86.68it/s]
58%|#####7 | : 578/999 [00:06<00:04, 86.78it/s]
58%|#####8 | : 581/999 [00:06<00:04, 86.86it/s]
58%|#####8 | : 584/999 [00:06<00:04, 86.94it/s]
59%|#####8 | : 587/999 [00:06<00:04, 87.01it/s]
59%|#####8 | : 589/999 [00:06<00:04, 85.61it/s]
59%|#####9 | : 593/999 [00:06<00:04, 87.24it/s]
60%|#####9 | : 595/999 [00:06<00:04, 85.83it/s]
60%|#####9 | : 598/999 [00:06<00:04, 85.97it/s]
60%|###### | : 601/999 [00:06<00:04, 86.10it/s]
60%|###### | : 604/999 [00:06<00:04, 86.19it/s]
61%|###### | : 606/999 [00:06<00:04, 84.81it/s]
61%|######1 | : 610/999 [00:06<00:04, 86.47it/s]
61%|######1 | : 612/999 [00:06<00:04, 85.11it/s]
62%|######1 | : 615/999 [00:06<00:04, 85.29it/s]
62%|######1 | : 618/999 [00:06<00:04, 85.46it/s]
62%|######2 | : 621/999 [00:06<00:04, 85.61it/s]
62%|######2 | : 623/999 [00:06<00:04, 84.28it/s]
63%|######2 | : 627/999 [00:06<00:04, 85.97it/s]
63%|######3 | : 630/999 [00:07<00:04, 86.11it/s]
63%|######3 | : 632/999 [00:07<00:04, 84.76it/s]
64%|######3 | : 636/999 [00:07<00:04, 86.43it/s]
64%|######3 | : 638/999 [00:07<00:04, 85.06it/s]
64%|######4 | : 641/999 [00:07<00:04, 85.21it/s]
64%|######4 | : 644/999 [00:07<00:04, 85.38it/s]
65%|######4 | : 647/999 [00:07<00:04, 85.53it/s]
65%|######5 | : 650/999 [00:07<00:04, 85.65it/s]
65%|######5 | : 653/999 [00:07<00:04, 85.80it/s]
66%|######5 | : 656/999 [00:07<00:03, 85.94it/s]
66%|######5 | : 659/999 [00:07<00:03, 86.05it/s]
66%|######6 | : 662/999 [00:07<00:03, 86.17it/s]
66%|######6 | : 664/999 [00:07<00:03, 84.81it/s]
67%|######6 | : 668/999 [00:07<00:03, 86.45it/s]
67%|######7 | : 671/999 [00:07<00:03, 86.55it/s]
67%|######7 | : 674/999 [00:07<00:03, 86.63it/s]
68%|######7 | : 677/999 [00:07<00:03, 86.72it/s]
68%|######8 | : 680/999 [00:07<00:03, 86.81it/s]
68%|######8 | : 683/999 [00:07<00:03, 86.90it/s]
69%|######8 | : 686/999 [00:07<00:03, 86.98it/s]
69%|######8 | : 689/999 [00:07<00:03, 87.06it/s]
69%|######9 | : 692/999 [00:07<00:03, 87.13it/s]
70%|######9 | : 695/999 [00:07<00:03, 87.20it/s]
70%|######9 | : 698/999 [00:07<00:03, 87.26it/s]
70%|####### | : 700/999 [00:07<00:03, 85.83it/s]
70%|####### | : 704/999 [00:07<00:03, 87.40it/s]
71%|####### | : 707/999 [00:07<00:03, 87.46it/s]
71%|####### | : 709/999 [00:07<00:03, 86.01it/s]
71%|#######1 | : 713/999 [00:07<00:03, 87.62it/s]
72%|#######1 | : 716/999 [00:08<00:03, 87.67it/s]
72%|#######1 | : 718/999 [00:08<00:03, 86.23it/s]
72%|#######2 | : 721/999 [00:08<00:03, 86.35it/s]
72%|#######2 | : 724/999 [00:08<00:03, 86.46it/s]
73%|#######2 | : 727/999 [00:08<00:03, 86.55it/s]
73%|#######3 | : 730/999 [00:08<00:03, 86.65it/s]
73%|#######3 | : 733/999 [00:08<00:03, 86.75it/s]
74%|#######3 | : 736/999 [00:08<00:03, 86.84it/s]
74%|#######3 | : 739/999 [00:08<00:02, 86.93it/s]
74%|#######4 | : 742/999 [00:08<00:02, 87.02it/s]
74%|#######4 | : 744/999 [00:08<00:02, 85.62it/s]
75%|#######4 | : 747/999 [00:08<00:02, 85.78it/s]
75%|#######5 | : 750/999 [00:08<00:02, 85.92it/s]
75%|#######5 | : 753/999 [00:08<00:02, 86.04it/s]
76%|#######5 | : 756/999 [00:08<00:02, 86.17it/s]
76%|#######5 | : 759/999 [00:08<00:02, 86.29it/s]
76%|#######6 | : 761/999 [00:08<00:02, 84.91it/s]
77%|#######6 | : 765/999 [00:08<00:02, 86.58it/s]
77%|#######6 | : 768/999 [00:08<00:02, 86.68it/s]
77%|#######7 | : 771/999 [00:08<00:02, 86.78it/s]
77%|#######7 | : 774/999 [00:08<00:02, 86.88it/s]
78%|#######7 | : 777/999 [00:08<00:02, 86.97it/s]
78%|#######7 | : 779/999 [00:08<00:02, 85.55it/s]
78%|#######8 | : 782/999 [00:08<00:02, 85.70it/s]
79%|#######8 | : 785/999 [00:08<00:02, 85.84it/s]
79%|#######8 | : 787/999 [00:08<00:02, 84.47it/s]
79%|#######9 | : 790/999 [00:08<00:02, 84.68it/s]
79%|#######9 | : 792/999 [00:08<00:02, 83.39it/s]
80%|#######9 | : 795/999 [00:08<00:02, 83.65it/s]
80%|#######9 | : 798/999 [00:08<00:02, 83.89it/s]
80%|######## | : 800/999 [00:09<00:02, 82.66it/s]
80%|######## | : 803/999 [00:09<00:02, 82.96it/s]
81%|######## | : 806/999 [00:09<00:02, 83.25it/s]
81%|######## | : 808/999 [00:09<00:02, 82.04it/s]
81%|########1 | : 811/999 [00:09<00:02, 82.36it/s]
81%|########1 | : 814/999 [00:09<00:02, 82.68it/s]
82%|########1 | : 817/999 [00:09<00:02, 82.98it/s]
82%|########2 | : 820/999 [00:09<00:02, 83.26it/s]
82%|########2 | : 823/999 [00:09<00:02, 83.54it/s]
83%|########2 | : 825/999 [00:09<00:02, 82.32it/s]
83%|########2 | : 828/999 [00:09<00:02, 82.64it/s]
83%|########3 | : 832/999 [00:09<00:01, 84.42it/s]
83%|########3 | : 834/999 [00:09<00:01, 83.15it/s]
84%|########3 | : 837/999 [00:09<00:01, 83.43it/s]
84%|########4 | : 840/999 [00:09<00:01, 83.70it/s]
84%|########4 | : 842/999 [00:09<00:01, 82.46it/s]
85%|########4 | : 846/999 [00:09<00:01, 84.22it/s]
85%|########4 | : 849/999 [00:09<00:01, 84.44it/s]
85%|########5 | : 851/999 [00:09<00:01, 83.17it/s]
85%|########5 | : 854/999 [00:09<00:01, 83.44it/s]
86%|########5 | : 857/999 [00:09<00:01, 83.70it/s]
86%|########5 | : 859/999 [00:09<00:01, 82.47it/s]
86%|########6 | : 863/999 [00:09<00:01, 84.26it/s]
87%|########6 | : 866/999 [00:09<00:01, 84.45it/s]
87%|########6 | : 868/999 [00:09<00:01, 83.15it/s]
87%|########7 | : 872/999 [00:09<00:01, 84.90it/s]
88%|########7 | : 875/999 [00:09<00:01, 85.08it/s]
88%|########7 | : 877/999 [00:09<00:01, 83.78it/s]
88%|########8 | : 881/999 [00:09<00:01, 85.49it/s]
88%|########8 | : 884/999 [00:09<00:01, 85.64it/s]
89%|########8 | : 886/999 [00:10<00:01, 84.30it/s]
89%|########8 | : 889/999 [00:10<00:01, 84.52it/s]
89%|########9 | : 892/999 [00:10<00:01, 84.72it/s]
90%|########9 | : 895/999 [00:10<00:01, 84.91it/s]
90%|########9 | : 898/999 [00:10<00:01, 85.09it/s]
90%|######### | : 901/999 [00:10<00:01, 85.26it/s]
90%|######### | : 904/999 [00:10<00:01, 85.43it/s]
91%|######### | : 907/999 [00:10<00:01, 85.59it/s]
91%|#########1| : 910/999 [00:10<00:01, 85.74it/s]
91%|#########1| : 912/999 [00:10<00:01, 84.40it/s]
92%|#########1| : 915/999 [00:10<00:00, 84.62it/s]
92%|#########1| : 918/999 [00:10<00:00, 84.82it/s]
92%|#########2| : 920/999 [00:10<00:00, 83.53it/s]
92%|#########2| : 923/999 [00:10<00:00, 83.79it/s]
93%|#########2| : 926/999 [00:10<00:00, 84.04it/s]
93%|#########2| : 928/999 [00:10<00:00, 82.78it/s]
93%|#########3| : 932/999 [00:10<00:00, 84.56it/s]
93%|#########3| : 934/999 [00:10<00:00, 83.29it/s]
94%|#########3| : 937/999 [00:10<00:00, 83.54it/s]
94%|#########4| : 940/999 [00:10<00:00, 83.80it/s]
94%|#########4| : 942/999 [00:10<00:00, 82.57it/s]
95%|#########4| : 945/999 [00:10<00:00, 82.87it/s]
95%|#########4| : 948/999 [00:10<00:00, 83.16it/s]
95%|#########5| : 951/999 [00:10<00:00, 83.43it/s]
95%|#########5| : 954/999 [00:10<00:00, 83.66it/s]
96%|#########5| : 956/999 [00:10<00:00, 82.44it/s]
96%|#########5| : 959/999 [00:10<00:00, 82.74it/s]
96%|#########6| : 962/999 [00:10<00:00, 83.01it/s]
97%|#########6| : 965/999 [00:10<00:00, 83.29it/s]
97%|#########6| : 968/999 [00:11<00:00, 83.55it/s]
97%|#########7| : 971/999 [00:11<00:00, 83.78it/s]
98%|#########7| : 975/999 [00:11<00:00, 85.51it/s]
98%|#########7| : 977/999 [00:11<00:00, 84.18it/s]
98%|#########8| : 980/999 [00:11<00:00, 84.38it/s]
98%|#########8| : 984/999 [00:11<00:00, 86.07it/s]
99%|#########8| : 987/999 [00:11<00:00, 86.20it/s]
99%|#########9| : 990/999 [00:11<00:00, 86.29it/s]
99%|#########9| : 994/999 [00:11<00:00, 87.89it/s]
100%|#########9| : 996/999 [00:11<00:00, 86.45it/s]
100%|##########| : 999/999 [00:11<00:00, 87.87it/s]
100%|##########| : 999/999 [00:11<00:00, 88.05it/s]
Computing cluster p-values
Done.
```

Note. The same functions work with source estimate. The only differences are the origin of the data, the size, and the adjacency definition. It can be used for single trials or for groups of subjects.

## Visualize clusters¶

```
# configure variables for visualization
colors = {"Aud": "crimson", "Vis": 'steelblue'}
linestyles = {"L": '-', "R": '--'}
# organize data for plotting
evokeds = {cond: epochs[cond].average() for cond in event_id}
# loop over clusters
for i_clu, clu_idx in enumerate(good_cluster_inds):
# unpack cluster information, get unique indices
time_inds, space_inds = np.squeeze(clusters[clu_idx])
ch_inds = np.unique(space_inds)
time_inds = np.unique(time_inds)
# get topography for F stat
f_map = T_obs[time_inds, ...].mean(axis=0)
# get signals at the sensors contributing to the cluster
sig_times = epochs.times[time_inds]
# create spatial mask
mask = np.zeros((f_map.shape[0], 1), dtype=bool)
mask[ch_inds, :] = True
# initialize figure
fig, ax_topo = plt.subplots(1, 1, figsize=(10, 3))
# plot average test statistic and mark significant sensors
f_evoked = mne.EvokedArray(f_map[:, np.newaxis], epochs.info, tmin=0)
f_evoked.plot_topomap(times=0, mask=mask, axes=ax_topo, cmap='Reds',
vmin=np.min, vmax=np.max, show=False,
colorbar=False, mask_params=dict(markersize=10))
image = ax_topo.images[0]
# create additional axes (for ERF and colorbar)
divider = make_axes_locatable(ax_topo)
# add axes for colorbar
ax_colorbar = divider.append_axes('right', size='5%', pad=0.05)
plt.colorbar(image, cax=ax_colorbar)
ax_topo.set_xlabel(
'Averaged F-map ({:0.3f} - {:0.3f} s)'.format(*sig_times[[0, -1]]))
# add new axis for time courses and plot time courses
ax_signals = divider.append_axes('right', size='300%', pad=1.2)
title = 'Cluster #{0}, {1} sensor'.format(i_clu + 1, len(ch_inds))
if len(ch_inds) > 1:
title += "s (mean)"
plot_compare_evokeds(evokeds, title=title, picks=ch_inds, axes=ax_signals,
colors=colors, linestyles=linestyles, show=False,
split_legend=True, truncate_yaxis='auto')
# plot temporal cluster extent
ymin, ymax = ax_signals.get_ylim()
ax_signals.fill_betweenx((ymin, ymax), sig_times[0], sig_times[-1],
color='orange', alpha=0.3)
# clean up viz
mne.viz.tight_layout(fig=fig)
fig.subplots_adjust(bottom=.05)
plt.show()
```

Out:

```
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
combining channels using "gfp"
```

## Exercises¶

What is the smallest p-value you can obtain, given the finite number of permutations?

use an F distribution to compute the threshold by traditional significance levels. Hint: take a look at

`scipy.stats.f`

**Total running time of the script:** ( 0 minutes 23.681 seconds)

**Estimated memory usage:** 128 MB