Datasets / CRCNS:bf-1

Basal forebrain LFP recordings from rats in home cage and during arena exploration

electrophysiological Norway rat 20.0 MB 3 files
  • 4 reproduced
  • 4 partially reproduced
  • 2 not reproduced
  • 18 blocked

Tested on dataset version unversioned

View on CRCNS Paper JSON How to read outcomes

Claims

From the paper 10.1073/pnas.1712431115

Reproducing Nair et al. (2018) from CRCNS bf-1 10

Notebook reproduce_nair_2018.ipynb

Reproduced4

  • ReproducedResults, BF Gamma Deactivation During Exploration, paragraph 1

    The BF gamma reduction in the arena was significant in every one of the 22 hemispheres analyzed individually.

    BF gamma reductions were significant in all brain hemispheres (n = 22) when analyzed individually (unpaired t test P < 0.01).

    Results, BF Gamma Deactivation During Exploration, paragraph 1

    What the paper reports

    • unpaired t test, p < 0.01 (n = 22 hemispheres, each tested on its own)

    All 12 arena recordings have lower gamma than the home-cage recording of the same session number, unpaired t test over epochs, largest p = 2.7e-30 (2-s), 1.9e-20 (peak-to-peak rule), 1.1e-07 (10-s). Rat 3's arena session 2 is tested against both of rat 3's home-cage files, p < 1e-100 either way with 2-s epochs as delivered, 7.1e-80 and 4.7e-93 under the peak-to-peak rule, 6.2e-30 and 6.8e-33 with 10-s epochs.

    How the test differed from the paper’s method

    • The unit is a rat and session (12 recordings) where the paper tested 22 hemispheres (criterion).
  • ReproducedResults, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3B

    In the arena, BF gamma power did not vary with movement-sensor quartile.

    This analysis, shown in Fig. 3B, demonstrates that BF gamma activity in the arena was largely unrelated to locomotor behavior (one-way ANOVA...

    Results, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3B

    What the paper reports

    • one-way ANOVA, p > 0.1

    Per-rat quartile means of arena gamma 32.3, 32.7, 32.0, 33.5 (quartiles within each recording), one-way ANOVA F = 0.005, p = 1.0, eta squared 0.0007; quartiles within each rat p = 0.998. Variants give p > 0.1 too (ANOVA over epochs p = 0.60 and 0.19; repeated-measures p = 0.38 and 0.28; 10-s epochs and the peak-to-peak rule p >= 0.99; movement shifted by one segment p >= 0.998). The one-way ANOVA on quartile means divided by each rat's mean, a variant, gives p = 0.12 and 0.33. The criterion's test cannot see a within-rat effect against the between-rat spread (it misses the home-cage rise), so the variants are the informative ones; all give p > 0.1.

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • The segments come already down-sampled to 400 Hz and cleaned by the depositors. The SI's peak-to-peak rule applied again (claims file header, reading b) drops 16.8% of segments, against the SI's 1-4%; both readings are run.
  • ReproducedSI, Low-Frequency Power Modulations in Home Cage and Arena, paragraph 2; Fig. S2

    In the BF, delta and beta power, like gamma, were higher in the home cage than in the arena, while theta power was strongly suppressed in the home cage.

    In the BF, in addition to the gamma enhancement in the home cage, beta and delta oscillations are also elevated, whereas theta power is strongly suppressed relative to values recorded in the arena.

    SI, Low-Frequency Power Modulations in Home Cage and Arena, paragraph 2; Fig. S2

    What the paper reports

    • paired t test, p < 0.05

    Over 6 rats, home cage against arena, delta 334 against 223 (p = 0.030), theta 161 against 252 (p = 0.00045), beta 46.7 against 35.0 (p = 0.024), gamma 62.7 against 32.6 (p = 0.012), paired t tests. All four bands hold in the stated directions under all 12 epoch, artifact and pairing readings.

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • The segments come already down-sampled to 400 Hz and cleaned by the depositors. The SI's peak-to-peak rule applied again (claims file header, reading b) drops 16.8% of segments, against the SI's 1-4%; both readings are run.
  • ReproducedSI, Distributions of Theta and Gamma Power Within Each State Are Unimodal, paragraph 1; Fig. S3

    Within each condition, the distributions of BF theta and gamma power over 2-s epochs were unimodal, with no evidence of substates, in each of six rats.

    These results were confirmed (at P > 0.1) in a total of six animals, in total yielding no evidence for multimodality in either behavioral state or frequency band.

    SI, Distributions of Theta and Gamma Power Within Each State Are Unimodal, paragraph 1; Fig. S3

    What the paper reports

    • Hartigan dip test, p > 0.1 (n = six rats)

    Hartigan dip tests of 2-s theta and gamma power, per rat and condition, sessions pooled, 24 tests, smallest p = 0.554; each session alone, 46 tests (rat 3 has one home-cage file), smallest p = 0.102 (rat 5 home cage session 1, gamma); dip statistics 0.0065 to 0.028. The left-out duplicate file gives p = 0.99 and 0.96. On log10 power, a variant the criterion does not name (it tests power), the pooled reading gives p > 0.1 (smallest 0.462) and each session alone gives one test below 0.05, rat 5's home-cage session 1, gamma, p = 0.035, the test that gives the smallest p (0.102) on raw power.

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • P-values come from the diptest package's tabulated null distribution; the paper does not say how its p-values were obtained (a standard choice).

Partially reproduced4

  • Partially reproducedResults, BF Gamma Deactivation During Exploration, paragraph 1; Figure 3A

    BF gamma power was reduced by 35 +/- 3% when rats moved from the home cage to the novel arena, a highly significant reduction.

    The main finding of the present study is a striking (35 ± 3%) and highly significant (paired t test, P < 10−5) reduction of this BF gamma activity when rats were transferred from their home cage to a novel, empty arena which they explored during a 10-min interval (Fig. 3A).

    Results, BF Gamma Deactivation During Exploration, paragraph 1; Figure 3A

    What the paper reports

    • paired t test, p < 10⁻⁵ (n = 22 hemispheres)

    Home-cage gamma (mean periodogram power, 30-80 Hz) exceeds arena gamma in 6 of 6 rats; the reduction is 48.0% under reading (a) and 48.0% under reading (b), paired t test t = 3.84, p = 0.012 over 6 rats (11 session pairs, 47.7%, p = 0.00047). Every epoch (2 s, 10 s), artifact and pairing reading gives 46.8% to 48.1%, outside 35 +/- 3%, with p from 0.0002 to 0.014. Per rat the reduction is 37.3% to 63.9%. Leaving out 49-51 Hz (a line at 50 Hz in one file) gives 44.7%; the amplitude spectrum, which the data descriptor's example uses and the paper does not, gives 24.0%. The paper's p < 1e-5 rests on 22 hemispheres and is not reached with six rats (reported, not required by the criterion).

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • The segments come already down-sampled to 400 Hz and cleaned by the depositors. The SI's peak-to-peak rule applied again (claims file header, reading b) drops 16.8% of segments, against the SI's 1-4%; both readings are run.
    • The paper does not say how the spectrum is scaled or windowed; a plain periodogram is used (claims file header, a standard choice that cannot change a ratio).
  • Partially reproducedResults, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3Cverifier disagreed at first

    BF gamma was larger in the home cage than in either of the two daily arena sessions, and slightly larger (5.62 +/- 1.2%) in the second arena session than in the first, with no interaction between day and session.

    was larger in the home cage than during either of the two arenaexploration sessions (two-way ANOVA with factors day and session and post hoc tests... In addition, gamma activity was slightly increased during the second arena-exploration session compared with the first session (5.62 ± 1.2%; post hoc test... and there was no significant interaction between day and session number.

    Results, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3C

    What the paper reports

    • home cage against each arena session: two-way ANOVA with factors day and session, post hoc tests, p < 10⁻⁴
    • second against first arena session: post hoc test, p < 0.01

    Per-rat gamma, home cage 62.7, arena session 1 35.4 and arena session 2 29.8 (means over rats). The home cage exceeds both arena sessions by Bonferroni-corrected paired t tests (p = 0.038 and 0.035; peak-to-peak rule 0.045 and 0.041; 10-s epochs 0.038 and 0.033) but not by Tukey's HSD on per-rat values (p = 0.30 and 0.19), which treats the 18 values as independent groups and ignores the pairing within rat. The criterion names Tukey as the standard reading and the paired tests as a variant; the outcome rests on the variant, chosen because the rats are paired across conditions. The second part, a rise from the first to the second daily arena session, cannot be tested: the descriptor calls sessions 1 and 2 two separate examples of each session type, and nothing in the data set gives a day or the order of trials. Arena session 2 is 15.9% below session 1 (group means -15.7%, paired t p = 0.020), against +5.62 +/- 1.2%; this is reported and not judged.

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • The segments come already down-sampled to 400 Hz and cleaned by the depositors. The SI's peak-to-peak rule applied again (claims file header, reading b) drops 16.8% of segments, against the SI's 1-4%; both readings are run.
    • The data set has no day labels, so the day factor is dropped and the arena sessions are compared within rat by a paired t test, as the criterion says.
    • The data set's session numbers are not taken as the first and second daily arena sessions. The descriptor calls them two separate examples (Session 1 and 2) of each session type, and rat 3's home-cage session 2 is an excerpt of its session 1, so the files may be chosen excerpts. The arena 2 against arena 1 part of the criterion is therefore not judged (metadata_insufficient), and the outcome rests on the home-cage part.
  • Partially reproducedResults, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3Drests on an assumption

    Within arena sessions BF gamma stayed suppressed but rose with time spent in the arena (r = 0.72, n = 22).

    While gamma activity was continuously suppressed in the arena, it was positively correlated with time spent in the arena (r = 0.72, n = 22, P < 10−4) during individual exploration sessions, as shown in Fig. 3D.

    Results, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3D

    What the paper reports

    • correlation, r = 0.72, p < 10⁻⁴ (n = 22)

    Reading (a), 1-min bins over the first 10 min, gamma averaged over the 12 arena recordings, r = 0.859, p = 0.0015 (n = 10 bins); its 2-s variant r = 0.197, p = 0.0006. Reading (b), mean of per-recording r, 0.129 (one-sample t p = 0.056; per recording -0.27 to 0.40). Reading (c), all epochs pooled, r = 0.045, p = 0.0094. No reading the criterion names puts r within 0.72 +/- 0.072; the correlation is positive at p < 0.05 under (a) and (c). With the 10-min window anchored at the file end (the transfer, on Fig. 3D's axis) (a) gives r = 0.885, p = 0.00066 and (b) r = 0.130, p = 0.021. Reading (b) does not depend on where a file's clock starts; over whole files it gives r = 0.165, p = 0.011. In 9 of 12 arena files the first minute has more movement than the middle, consistent with entry near t = 0 but not proof of it; several of the differences are small (403.9 against 389.2). Bin width moves r across the tolerance. Within tolerance are 30-s bins, 0.744 and 0.747 (start and end anchor), and 20-s bins with the end anchor, 0.662 (p = 6.9e-5); outside are 20-s bins from the start, 0.645, and 2-min bins, 0.860 and 0.969. The criterion names no partial outcome; partially reproduced is used because the positive correlation holds while its size at the criterion's 1-min bins does not match.

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • The paper's n = 22 matches its hemispheres; here 12 arena recordings.
    • Each file's clock starts at 0 and files run 8.8 to 13 min, longer than the SI's 10-min trial, and nothing says where arena entry is. The 10-min window is taken from the file start and, as a reading, from the file end; both give the same outcome, and reading (b) is shown over whole files, which needs no anchor.
    • Assumed 1-min bins for reading (a), as the criterion names them (Figure 3D's axis runs in minutes); the criterion says the bin width is open, and 30-s bins put r within tolerance (0.744 and 0.747), as do 20-s bins with the end anchor (0.662), which would give reproduced. Asked of the paper's authors with the question on what was correlated (findings).
  • Partially reproducedSI, Analysis of Excursions to DMN Brain State During Arena Exploration, paragraph 2; Fig. S5

    During about 20 min of arena exploration, BF gamma made on average eight brief excursions into the home-cage range, lasting 8 to 44 s (16 +/- 8 s), with a clear rise in gamma power (0.56 +/- 0.27) and no change in theta power (-0.01 +/- 0.82) relative to 4 to 8 s before the peak.

    We found on average eight excursions during the 20 min spent in the arena, corresponding to about one excursion every 2–3 min. Excursions lasted between 8 and 44 s, with an average duration of 16 ± 8 s. Based on a comparison of LFP power at the gamma peak to the average values 4–8 s before the peak, gamma transitions were associated with clear increases in gamma power (0.56 ± 0.27, paired t tests... but no concomitant significant modulations in theta power (−0.01 ± 0.82, paired t tests... P > 0.1) were found.

    SI, Analysis of Excursions to DMN Brain State During Arena Exploration, paragraph 2; Fig. S5

    What the paper reports

    • gamma power at the peak against 4 to 8 s before: paired t tests, p < 0.001 (n = six rats)
    • theta power at the peak against 4 to 8 s before: paired t tests, p > 0.1 (n = six rats)

    Across the 12 readings (scale raw, log10 or normalized; threshold from 20 bins or kernel density; arena sessions together or each alone), the gamma rise at the peak is significant in all (p 0.0001 to 0.04, paired t over 6 rats) and the theta change is not significant (p > 0.1) in 10, among them every log10 reading (raw and normalized scales with 20 bins and sessions together give theta p = 0.028 and 0.040). No reading matches the count or durations; 10.7 to 14.5 excursions per 20 min against 8, mean duration 5.1 to 5.6 s against 16 +/- 8 (within tolerance only at its lower bound, not reached), and durations from 2 s against the paper's shortest of 8 s; under log10 with 20 bins 13 of 82 excursions last 8 s or more. No reading puts the threshold near 2.6 (raw 25 to 109, log10 1.38 to 2.03, normalized 0.54 to 1.11), so the 0.56 and -0.01 values are reported and not judged (log10 rise 0.144, theta change 0.035). As a scale-free comparison, shown and not judged, the gamma rise over the mean threshold is 0.39 to 0.44 on the raw and normalized scales, against 0.56 / 2.6 = 0.215 in the paper.

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • The boxcar runs over the sequence of retained segments within a file; the two arena files are analysed as separate series, as they share no clock.
    • The paper's power scale, histogram bins and minimum excursion length are not given; the readings of the criterion are run and none gives durations of 8 s or more only.
    • At the ends of a file the boxcar averages the two values that exist (round 1 used zero padding, which lowered the end values to two thirds); the paper does not say how ends were handled.

Not reproduced2

  • Not reproducedResults, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3Bquestion to the reader

    In the home cage, BF gamma power increased with movement-sensor quartile.

    BF gamma activity increased with locomotor behavior in the home cage (one-way ANOVA...

    Results, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3B

    What the paper reports

    • one-way ANOVA, p < 0.05

    Home-cage gamma rises from the first to the fourth movement quartile in 6 of 6 rats (means 50.3, 62.1, 68.4, 72.0; Q4/Q1 1.43), but the criterion's one-way ANOVA over quartiles on per-rat quartile means gives F = 0.31, p = 0.82 (quartiles within each rat p = 0.77, eta squared 0.045), because per-rat home-cage gamma ranges from 36 to 145. Variants that take the rat into account find the rise (repeated-measures ANOVA p = 2.0e-05; ANOVA over epochs p = 3.9e-46; one-way ANOVA on quartile means divided by each rat's mean p = 1.6e-09), and no epoch, artifact or movement-shift reading brings the one-way p below 0.74. Whether the per-rat one-way ANOVA is the paper's test is asked of a reader (questions/crcns-bf-1.yaml), and what the paper's observations were is asked of its authors (findings).

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • The segments come already down-sampled to 400 Hz and cleaned by the depositors. The SI's peak-to-peak rule applied again (claims file header, reading b) drops 16.8% of segments, against the SI's 1-4%; both readings are run.
    • The paper does not say what the ANOVA's observations are; the criterion takes per-rat quartile means, and the epoch-level and repeated-measures tests are shown as variants.
  • Not reproducedResults, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3B

    Gamma suppression in the arena remained highly significant when epochs matched for movement were compared, for example the fourth home-cage quartile against the third arena quartile.

    gamma suppression during exploration remained highly significant when LFP epochs matched for movement were analyzed (e.g., the fourth and third movement quartiles for home cage and arena, respectively; one-way ANOVA

    Results, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3B

    What the paper reports

    • one-way ANOVA, p < 0.001

    Reading (a), home-cage Q4 against arena Q3, and reading (b), the closest mean movement values, pick the same pair (mean movement 356 against 333). Home-cage gamma 72.0 against arena 32.0, higher in 6 of 6 rats, but the one-way ANOVA of the per-rat means gives p = 0.070 (quartiles within each rat p = 0.070). A paired t test of the same values, a variant, gives p = 0.0071; matching quartiles within each rat gives one-way p = 0.099 and paired p = 0.0091. The one-way ANOVA on the two values divided by each rat's mean, a variant, gives p = 7.5e-08. The choice of test is asked of a reader with fig3b-home-cage-gamma-increases-with-movement (questions/crcns-bf-1.yaml).

    How the test differed from the paper’s method

    • The data set gives one BF signal per rat for six rats, so tests run over rats (n = 6), or session pairs as a variant, where the paper used 22 hemispheres (claims file header). The two sessions of a condition are averaged per rat (n = 6); rat 3's home-cage session 2 is left out as a second deposit of its session 1, so rat 3's home cage is session 1 alone.
    • The segments come already down-sampled to 400 Hz and cleaned by the depositors. The SI's peak-to-peak rule applied again (claims file header, reading b) drops 16.8% of segments, against the SI's 1-4%; both readings are run.
    • Movement values differ in scale between rats (rats 4 and 5 about a quarter of the others), so matching by the mean over rats of the quartile movement values is approximate; a within-rat match is shown as a variant.

Not tested in a notebook 18

2 metadata insufficient, 16 data missing from the dataset

Blocked18

  • BlockedResults, BF Gamma Deactivation During Exploration, paragraph 1· Metadata insufficient

    In four more rats with bipolar BF electrodes, home-cage gamma was also strong and was reduced by 24 +/- 3% during arena exploration.

    Strong BF gamma activity in the home cage was also observed in these bipolar recordings, and this oscillatory activity was again strongly suppressed during arena exploration, (24 ± 3% reduction; paired t tests... 10−4).

    Results, BF Gamma Deactivation During Exploration, paragraph 1

    What the paper reports

    • paired t tests, p < 10⁻⁴ (n = four rats with bipolar electrodes)

    The paper's four bipolar rats are not identified in the data set. The descriptor and the files name rats 1 to 6 with one LFP channel each and say nothing about electrode type, so no recording can be taken as bipolar. The bucket holds no other files.

  • BlockedResults, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3C· Metadata insufficient

    BF gamma power was consistent over the 3 days of testing.

    was consistent over the 3 d of testing (one-way ANOVA... (Fig. 3C)

    Results, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3C

    What the paper reports

    • one-way ANOVA, p > 0.1

    The data set gives sessions 1 and 2 of each type with no day; the paper's arena exploration ran over 3 days. No file name, variable or document gives the day.

  • BlockedResults, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3D· Data missing from the dataset

    BF gamma increased rapidly when the rat was transferred back from the arena to its home cage.

    Nevertheless, gamma increased rapidly when the rat was transferred back to its home cage.

    Results, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3D

    Needs a recording continuous across the transfer from arena to home cage. Each file has its own clock starting at 0 and holds one condition, so no recording spans a transfer, and no file can be placed in time relative to another.

  • BlockedResults, Behavioral Analyses, paragraph 1; Figure 2B· Data missing from the dataset

    In the arena, with or without objects, rats spent most of their time exploring the arena and the objects when present (87.8 +/- 3.6%), 7.6 +/- 1.7% grooming and 1.80 +/- 0.9% in quiet wakefulness (mean +/- SEM, seven rats, video tracking and motion sensor).

    In the arena, tracking analyses showed that rats spent a large majority of their time (87.8 ± 3.6%, mean ± SEM) exploring the arena itself and objects when these were present. Only 7.6 ± 1.7% of the total time was spent grooming in this exploratory context, and animals were rarely in a state of quiet wakefulness (1.80 ± 0.9%).

    Results, Behavioral Analyses, paragraph 1; Figure 2B

    Needs the video tracking and ELAN behaviour scoring of seven rats; the data set holds only LFP and one movement-sensor value per 2-s segment, and the paper names no other deposit.

  • BlockedResults, Behavioral Analyses, paragraph 1; Figure 2B· Data missing from the dataset

    Rats explored less in the home cage than in the arena with or without objects, and in the home cage they divided their time about equally between quiet wakefulness and grooming.

    By contrast, rats exhibited significantly less exploratory locomotor behavior in the home cage than in the arena with or without objects (paired t tests... Instead, they divided their time about equally (paired t test... between states of quiet wakefulness and grooming (Fig. 2).

    Results, Behavioral Analyses, paragraph 1; Figure 2B

    What the paper reports

    • exploration, home cage against arena and against object arena: paired t tests, p < 0.001 (n = seven rats)
    • quiet wakefulness against grooming in the home cage: paired t test, p > 0.1 (n = seven rats)

    Needs behaviour scoring from video, not in the data set (see behavior-arena-time-budget).

  • BlockedResults, Behavioral Analyses, paragraph 1· Data missing from the dataset

    Mean movement speed from video was 8.9 +/- 0.5 cm/s in arena exploration, 6.9 +/- 0.7 cm/s in object exploration and 1.4 +/- 0.4 cm/s in the home cage; both exploration conditions exceeded the home cage, and arena exceeded object exploration.

    mean speed... arena exploration, 8.9 ± 0.5 cm/s; object exploration, 6.9 ± 0.7 cm/s; home cage, 1.4 ± 0.4 cm/s). Locomotor behavior was greater in both exploration conditions than in the home cage (ANOVA with post hoc tests... In addition, locomotion during arena exploration was increased compared with object exploration

    Results, Behavioral Analyses, paragraph 1

    What the paper reports

    • each exploration condition against home cage: ANOVA with post hoc tests, p < 0.01
    • arena against object exploration: ANOVA with post hoc tests, p < 0.05

    Needs video speed in cm/s; the movement sensor is a dimensionless acceleration value per segment, and no video or tracking is in the data set.

  • BlockedResults, BF Gamma Deactivation During Exploration, paragraph 3; Figure 3E and 3F· Data missing from the dataset

    BF gamma was higher during grooming than during quiet wakefulness, and both were higher than during arena exploration; in the arena, rats groomed 4.6 +/- 0.3% of the time, with elevated gamma during those pauses.

    The results, shown in Fig. 3F, indicate that gamma activity was higher during grooming than during quiet wakefulness (one-way ANOVA with post hoc tests... P < 0.001), but gamma activity was elevated during both quiet wakefulness and grooming compared with arena exploration (P < 0.01 and P < 0.001, respectively).

    Results, BF Gamma Deactivation During Exploration, paragraph 3; Figure 3E and 3F

    What the paper reports

    • grooming against quiet wakefulness: one-way ANOVA with post hoc tests, p < 0.001
    • quiet wakefulness against arena exploration: one-way ANOVA with post hoc tests, p < 0.01
    • grooming against arena exploration: one-way ANOVA with post hoc tests, p < 0.001

    Needs behaviour labels per epoch (grooming, quiet wakefulness, exploration), not in the data set.

  • BlockedResults, BF Gamma Deactivation During Exploration, paragraph 4; Figure 4A and 4C· Data missing from the dataset

    BF gamma suppression was maintained during object exploration, attenuated as much as in empty-arena exploration relative to the home cage, and not different from the arena value.

    We found that gamma suppression was maintained during the object-exploration task, with gamma being similarly attenuated for object and empty arena exploration compared with home-cage values (one-way ANOVA... and was not significantly different from the arenaexploration value (P > 0.1).

    Results, BF Gamma Deactivation During Exploration, paragraph 4; Figure 4A and 4C

    What the paper reports

    • object exploration against home cage: one-way ANOVA, p < 0.01
    • arena exploration against home cage: one-way ANOVA, p < 0.001
    • object against arena exploration: one-way ANOVA, p > 0.1
    • object exploration against home cage, per recording: paired t test, p < 10⁻⁶
    • arena exploration against home cage, per recording: paired t test, p < 10⁻⁵

    The data set holds only 'Arena' and 'HCage' sessions; the day-4 object sessions are not in it.

  • BlockedResults, BF Gamma Deactivation During Exploration, paragraph 5; Figure 5A· Data missing from the dataset

    Of 49 well-isolated BF neurons in six rats, 25 were phase locked to broadband (30 to 80 Hz) gamma oscillations.

    We recorded 49 well-isolated BF neurons in six animals. Of these neurons, 25 exhibited significant phase locking to broadband (30–80 Hz) gamma oscillations

    Results, BF Gamma Deactivation During Exploration, paragraph 5; Figure 5A

    The data set holds no single units or 24 kHz recordings, only 400 Hz LFP.

  • BlockedResults, BF Gamma Deactivation During Exploration, paragraph 5; Figure 5C and 5D· Data missing from the dataset

    Phase locking, measured by the phase-locked index, was maximal at gamma frequencies in both the home cage and the arena.

    We calculated a phase-locked index (PLI) as the coefficient of variation over the 25 bins at each band pass, and with this metric phase locking was found to be maximal at gamma frequencies in both the home cage and arena (one-way ANOVA, P < 0.005)

    Results, BF Gamma Deactivation During Exploration, paragraph 5; Figure 5C and 5D

    What the paper reports

    • one-way ANOVA, p < 0.005 (n = phase-locked BF neurons)

    Needs single units (see fig5a-phase-locked-neurons).

  • BlockedResults, BF Gamma Deactivation During Exploration, paragraph 5· Data missing from the dataset

    Phase-locked BF neurons had shorter spikes (214 +/- 5 us, trough to peak) than non-phase-locked neurons (247 +/- 12 us).

    Spike durations of the phase-locked neurons were significantly shorter (mean = 214 ± 5 μs) than for the non–phase-locked neurons (mean = 247 ± 12 μs; P < 0.05)

    Results, BF Gamma Deactivation During Exploration, paragraph 5

    What the paper reports

    • p < 0.05 (n = 25 phase-locked and 24 non-phase-locked neurons)

    Needs single-unit waveforms (see fig5a-phase-locked-neurons).

  • BlockedResults, Gamma Oscillations in BF Cortical Projection Targets, paragraph 1; Figure 6A· Data missing from the dataset

    As in the BF, ACC gamma power was higher in the home cage than during arena exploration and switched rapidly to the elevated state on transfer to the home cage.

    We observed that, as in the BF, gamma LFP activity was elevated in the ACC when rats were in their home cage, compared with arena exploration (paired t test... (Fig. 6A, Left). As in the BF, gamma activity switched rapidly to an elevated state when rats were transferred to their home cage after arena exploration.

    Results, Gamma Oscillations in BF Cortical Projection Targets, paragraph 1; Figure 6A

    The data set holds one BF channel per file; no ACC recordings.

  • BlockedResults, Gamma Oscillations in BF Cortical Projection Targets, paragraph 1; Figure 6A· Data missing from the dataset

    VC gamma power (40 to 60 Hz) did not differ between arena and home cage and did not switch rapidly on transfer to the home cage, while high gamma (60 to 100 Hz) was higher during arena exploration.

    Thus, VC gamma activity (40–60 Hz) was unchanged between arena-exploration and home-cage environments [paired t test... However, we did observe enhanced high gamma activity between 60 and 100 Hz during arena exploration (paired t test... Rapid switching of the ACC but not VC gamma upon transfer from the arena to the home cage.

    Results, Gamma Oscillations in BF Cortical Projection Targets, paragraph 1; Figure 6A

    What the paper reports

    • VC 40 to 60 Hz, arena against home cage: paired t test, p > 0.1
    • VC 60 to 100 Hz, arena against home cage: paired t test, p < 10⁻⁸

    No VC recordings in the data set.

  • BlockedResults, Gamma Oscillations in BF Cortical Projection Targets, paragraph 1; Figure 6B· Data missing from the dataset

    Gamma coherence with the BF was greater for the ACC than for the VC, and for both areas it was higher in the home cage than in the arena.

    We found that coherence at gamma frequencies was greater between the BF and ACC than between the BF and VC across behavioral conditions (two-way ANOVA... Additionally, for both cortical areas, coherence with the BF was elevated in the home cage compared with the arena (two-way ANOVA

    Results, Gamma Oscillations in BF Cortical Projection Targets, paragraph 1; Figure 6B

    What the paper reports

    • BF-ACC against BF-VC: two-way ANOVA, p < 0.01 (n = four animals)
    • home cage against arena: two-way ANOVA, p < 0.01 (n = four animals)

    Needs simultaneous ACC and VC recordings, not in the data set.

  • BlockedResults, Gamma Oscillations in BF Cortical Projection Targets, paragraph 2; Figure 6C· Data missing from the dataset

    During BF gamma bursts, gamma-band Granger causality was stronger from the BF to the cortex than in reverse, stronger to the ACC than to the VC, and stronger in the home cage than in the arena.

    directional interactions were stronger in the corticopetal than in the corticofugal direction for both the ACC and VC (two-way ANOVAs, main effects of direction... However, directional interactions to the ACC were significantly larger than to the VC (two-way ANOVA, main effect of pathway... as well as being more pronounced in the home cage than in the arena (two-way ANOVAs, main effect of location

    Results, Gamma Oscillations in BF Cortical Projection Targets, paragraph 2; Figure 6C

    What the paper reports

    • corticopetal against corticofugal: two-way ANOVAs, main effect of direction, p < 0.01 (n = seven animals (bivariate))
    • to ACC against to VC: two-way ANOVA, main effect of pathway, p < 0.05 (n = seven animals (bivariate))
    • home cage against arena: two-way ANOVAs, main effect of location, p < 0.016 (n = seven animals (bivariate))

    Needs simultaneous ACC and VC recordings, not in the data set.

  • BlockedResults, Gamma Oscillations in BF Cortical Projection Targets, paragraph 2; Figure 6D· Data missing from the dataset

    Trivariate Granger causality analyses in rats with BF, VC and ACC electrodes showed BF-to-cortex directionality, stronger to the ACC than to the VC and in the home cage than in the arena.

    These findings illustrate BF→cortex directionality of interactions and the specificities in terms of cortical region, i.e., ACC over VC, as well as behavioral state, i.e., home cage over arena.

    Results, Gamma Oscillations in BF Cortical Projection Targets, paragraph 2; Figure 6D

    Needs simultaneous ACC and VC recordings, not in the data set.

  • BlockedSI, Low-Frequency Power Modulations in Home Cage and Arena, paragraph 2; Fig. S2· Data missing from the dataset

    In the ACC, gamma, beta and delta power were higher in the home cage and theta did not differ; in the VC the strongest effect was higher theta in the arena, and the only other difference was higher high gamma (above 60 Hz) in the arena.

    A similar pattern is observed in ACC, where gamma, beta, and delta power are enhanced in the home cage but theta power is not significantly different in the two environments. In the VC the strongest effect is related to enhanced theta power in the arena; the only other significant difference is in the high gamma band (above 60 Hz)

    SI, Low-Frequency Power Modulations in Home Cage and Arena, paragraph 2; Fig. S2

    What the paper reports

    • paired t test, p < 0.05

    No ACC or VC recordings in the data set.

  • BlockedSI, Locomotion During Arena and Object Exploration, paragraph 1; Fig. S6· Data missing from the dataset

    Quasi-stationary behavior (0 to 2 cm/s) was more frequent in object exploration than in empty-arena exploration.

    We found that quasi-stationary behavior (0–2 cm/s) was seen significantly more frequently in the object-exploration than in the arena-exploration condition (paired t test; P < 0.05)

    SI, Locomotion During Arena and Object Exploration, paragraph 1; Fig. S6

    What the paper reports

    • paired t test, p < 0.05 (n = four rats)

    Needs video tracking of object sessions; neither is in the data set.

Findings about the data

What attempts found about the dataset itself, for its owner and the archive.

  • Metadata errorRat_3_Type_HCage_Session_2.mat is not a separate recording. 287 of its 291 segments are segments of Rat_3_Type_HCage_Session_1.mat with the same LFP and movement values, 100 s later on that file's clock (they cover 106 to 750 s of it). The data set presents it as a second home-cage session.
  • Data missingThe data set holds only the BF LFP of six rats in home cage and arena. The ACC and VC recordings, single units, object sessions, video and behaviour scoring of the paper are not in it, and the paper names no other deposit; 16 of the 28 claims need data that are not in it.
  • Description missingThe sessions carry no day and no time of recording, and each file has its own clock starting at 0, so the paper's day factor, the order of home-cage and arena sessions and the transfer between them cannot be reconstructed. Which electrodes were bipolar is not stated.
  • Description missingThe LFP has no stated unit (its range is consistent with microvolts), and the movement value is dimensionless; its scale in rats 4 and 5 is about a quarter of that in the other rats, which is not explained.
  • Selection not documentedArtifact segments were removed without a stated rule. Removed segments make up 2.6% to 23.5% of each file's span, more than the 1-4% the SI reports for its rule, and the SI's rule applied to the delivered segments removes a further 16.8%.
  • Metadata errorThe descriptor names the home-cage condition 'Hcage' while the files use 'HCage', and describes basal_forebrain_lfp.tar.gz as a file of .mat files without saying it is a gzipped tar.
  • OtherIn 13 of 24 files the movement value of a segment correlates best with the 100-200 Hz LFP power of the next segment, and in 10 with the same segment, so the movement stream may lead the LFP by up to one 2-s segment. Rat 2's home-cage session 1 has a line at 50 Hz, 26 times its neighbours, inside the gamma band.
  • Methods not availableQuestion for the paper's authors. What were the observations of the one-way ANOVAs over movement quartiles (Fig. 3B), per-hemisphere quartile means or epochs, and was gamma normalized per animal? On this data set per-rat means give p = 0.82 for the home-cage rise and p = 0.07 for the movement-matched comparison, while repeated-measures and paired tests give p < 0.01.
  • Methods not availableQuestion for the paper's authors. How was the 35% reduction of gamma power computed (spectral estimate, scaling, averaging)? A periodogram mean over 30-80 Hz gives 48% on this data set, under every epoch, artifact and averaging reading.
  • Description missingThe descriptor calls sessions 1 and 2 two separate examples of each session type and does not say whether they are the first and second arena trials of one day, the paper's two daily 10-min trials (Fig. 3C). Here session 2 has 15.9% lower gamma than session 1, where the paper reports 5.62% higher in the second trial, so the order matters and cannot be recovered.
  • Methods not availableQuestion for the paper's authors. For the excursions of Figs. S4 and S5, what was the power scale (the threshold of 2.6), how were histogram bins set, and was there a minimum excursion length? Without one, the readings tried give 10.7 to 14.5 excursions per 20 min lasting 5 s on average, against 8 lasting 8 to 44 s.
  • Methods not availableQuestion for the paper's authors. What was correlated with time in Fig. 3D (r = 0.72, n = 22), binned group means, per-session correlations or epochs, at what bin width, and from arena entry or back from the transfer? The readings give r = 0.86 (1-min bins), 0.74 (30-s bins), 0.13 (per recording) and 0.045 (pooled epochs).

Questions

Where the author or a verifier believed the claims file misread the paper, they asked, citing the paper, and a reader who had not seen the data answered from the paper alone, amending the claims file where it was wrong. The author then ran the claim as answered. Attempts before protocol pilot-11 also asked here for method details the claims file did not give.

  • The criterion judges the home-cage rise on a one-way ANOVA over quartiles whose observations are the per-rat quartile means, without normalization. Does the paper support that reading, or should the epoch-level test (which the criterion shows as a variant for the arena claim) or a test on per-animal normalized values be a reading that can decide the outcome? The same choice decides fig3b-matched-movement and, for the absence, fig3b-arena-gamma-unrelated-to-movement.

    Passage. BF gamma activity increased with locomotor behavior in the home cage (one-way ANOVA...), and gamma suppression during exploration remained highly significant when LFP epochs matched for movement were analyzed (e.g., the fourth and third movement quartiles for home cage and arena, respectively; one-way ANOVA (Results, BF Gamma Deactivation During Exploration, paragraph 2; Figure 3B). The SI Materials and Methods say the quartile means were "averaged across animals".

    Why it matters. With six rats whose home-cage gamma ranges from 36 to 145, the per-rat one-way ANOVA puts the between-rat spread in the error term: the home-cage rise gives p = 0.82 (eta squared 0.045) although gamma rises from Q1 to Q4 in 6 of 6 rats, and the matched comparison gives p = 0.070 although the home cage is higher in 6 of 6 rats. The ANOVA over epochs gives p = 3.9e-46 for the rise, the one-way ANOVA on values divided by each rat's mean p = 1.6e-09 for the rise and 7.5e-08 for the matched comparison, and a repeated-measures ANOVA p = 2.0e-05. Both claims would be reproduced under any of these; the arena absence holds under all of them (p > 0.1). Raised by the round-1 verifier.

    No reader has answered it yet.

Notebooks

Every registered entry that uses this dataset. An entry can hold several notebooks, and can use more than one dataset.

Reproduction Basal forebrain gamma in home cage and arena (Nair et al. 2018)

Tests the findings of Nair, Klaassen, Arato, Vyssotski, Harvey and Rainer (2018) on CRCNS data set bf-1, which holds basal forebrain LFP from six rats in two home-cage and two arena sessions each, with a movement-sensor value per 2-s segment. It measures the reduction of BF gamma power in the arena, its relation to movement and to time in the arena, the low-frequency bands, the unimodality of theta and gamma power, and excursions of gamma during exploration. The ACC, VC, single-unit, object and behaviour data of the paper are not in the data set. All files

Verification

  • Round 1
    2026-11-06
    Agreed with 27 of 28 outcomes. Independent agent run by CatalystNeuro (same harness, separate context, did not write the notebook). Reviewed: The handover of the first run, the executed notebook with the conclusions and summary removed, the helper module and the claims file. The verifier also read the paper and the data descriptor under paper/, listed the bucket's filelist.txt and S3 listing, and tested helper functions on synthetic inputs.
    • fig3c-home-cage-above-both-sessions: the verifier’s outcome was “Partially reproduced”. Home cage exceeds both arena files with Bonferroni-corrected paired t p = 0.038 / 0.035, but Tukey gives p = 0.30 / 0.19. Arena 2 is 15.9% below arena 1 (p = 0.02), but the data descriptor calls sessions 1 and 2 two separate examples, so nothing shows they are the first and second daily sessions; the session-order part should be blocked (metadata_insufficient). Rat 3's HCage session 2 being a 100-s-shifted excerpt of session 1 also suggests the files are chosen excerpts, so the reversed -15.9% is not evidence against the paper's +5.62% (problem 2). Tukey treats the 18 rat-level values as independent groups and ignores pairing within rat (problem 4, not affecting a conclusion).
  • Round 2
    2026-11-06
    Agreed with 28 of 28 outcomes. Independent agent run by CatalystNeuro (same harness, separate context, did not write the notebook). Reviewed: Round 2. The full executed notebook with the conclusions and the summary, the README, the attempt record and the claims file, with the paper. The verifier agrees with all 28 outcomes. Outside the claims, it found that the summary's count of data_missing claims read as 17, that the data_missing finding listed bipolar recordings, which are a metadata_insufficient matter, and that the README's run time had no printed support. The summary now says 15 claims besides fig3d-rapid-switch-to-home-cage, bipolar recordings are taken out of the data_missing finding, and the README no longer states a run time.

Method differences

How the tests differed from the paper’s method or data, and the claims each applies to.

Provenance

Attempt record
crcns-bf-1-nair-2018-01
Paper
10.1073/pnas.1712431115
Date
2026-11-06
Made by
An agent, run by CatalystNeuro
Dataset
CRCNS:bf-1
Version
unversioned (doi:10.6080/K0MK6B2Q)
Run on
GitHub Actions
Harness
Claude Code
Model
claude-opus-5-5
Protocol
pilot-13

Transcripts of the agent runs

Each run’s prompt, messages and tool calls, with long output cut and the text of the paper left out, and its final report.