Datasets / DANDI:000248

DANDI:000248

Not yet verified

Allen Institute Openscope - Illusion project

electrophysiological optogenetic House mouse 186 GB 78 files
  • 14 reproduced
  • 3 not reproduced
  • 23 blocked

Tested on dataset version 0.240502.2344

View on DANDI Paper JSON How to read outcomes

Claims

From the paper 10.1038/s41593-025-02055-5

Reproducing Shin et al. (2025) from dandiset 000248 13

Notebook reproduce_shin_2025.ipynb

Reproduced9

  • ReproducedResults, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 4verifier disagreed at first

    The Neuropixels sessions hold 150 +/- 20 V1 RS units and 597 +/- 46 higher visual area RS units per session (mean +/- s.e.m., 12 sessions).

    12 sessions from 12 mice; mean ± s.e.m. = 150 ± 20 V1 RS units and 597 ± 46 higher visual area RS units across sessions

    Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 4

    V1 holds 150.3 +/- 19.8 RS units per session (1,804 in all) and the five higher visual areas 582.8 +/- 43.3 (mean +/- s.e.m., 12 sessions), within 150 +/- 20 and 597 +/- 46. Dropping the units labelled noise gives 131.4 and 509.9 (variant).

  • ReproducedMethods, Definition of functional subsets of neurons, paragraph 2verifier disagreed at first

    Across the ICwcfg0 and ICwcfg1 blocks, 159 of 1,804 V1 RS units are IC-encoders.

    Across ICwcfg0 and ICwcfg1, 159 of 1,804 V1 RS units were identified as IC-encoders in the Neuropixels dataset

    Methods, Definition of functional subsets of neurons, paragraph 2

    159 of 1,804 V1 RS units are IC-encoders in at least one of ICwcfg1 and ICwcfg0 (reading a), the paper's number; the sum of the two blocks' counts (reading b) is 163, also within 159 +/- 15.9.

  • ReproducedExtended Data Fig. 6b legendverifier disagreed at firstrests on an assumption

    The Neuropixels data hold 87 V1 IC-encoders and 636 V1 segment responders (the sets whose layer distribution Extended Data Fig. 6b shows).

    For the Neuropixels dataset, proportion of V1 IC-encoders (left, n = 87) and V1 segment responders (right, n = 636) in each layer

    Extended Data Fig. 6b legend

    Reading (b1), all V1 units in the files in ICwcfg1, gives 87 IC-encoders and 636 segment responders, the paper's numbers exactly. Dropping the units whose quality label is noise (b2) gives 79 and 566 (566 outside 636 +/- 63.6). Reading (a) gives 79 and 526 (the Fig. 2d counts) and reading (c) 159 and 684; neither puts both counts within tolerance. The layer proportions are shown (IC-encoders 35.6% in layer 2/3, segment responders 28.1%).

    How the test differed from the paper’s method

    • Assumption. Reading (b), "all units not classified as noise", is taken as every unit in the files, because the Methods say "all units not classified as noise were packaged into Neurodata Without Borders" files. The files also carry a quality column with 322 V1 units labelled noise; dropping them (b2) does not reproduce the segment responder count. The exact match of both counts under (b1) supports the assumption. Asked of the authors under findings (methods_unavailable).
  • ReproducedResults, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 1; Extended Data Fig. 6c and 6d legendsverifier disagreed at first

    IC-encoders are found in every visual area, in the Neuropixels and in the calcium imaging data.

    Using the same approach as above for V1, we could identify IC-encoders throughout these visual areas both in the electrophysiology and in the calcium imaging datasets

    Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 1; Extended Data Fig. 6c and 6d legends

    Neuropixels part. All six areas hold IC-encoders in ICwcfg1: 79 (V1), 48 (LM), 73 (RL), 64 (AL), 59 (PM) and 49 (AM), in 8 to 12 sessions per area, 3.4% to 5.0% of RS units on average. The calcium imaging part of the statement is not in the dandiset and is not tested.

  • ReproducedExtended Data Fig. 2b to 2e legends; Results, Mouse V1 neurons respond to ICs despite the absence of contrast within their receptive fields, paragraph 3verifier disagreed at firstrests on an assumption

    Limiting the Neuropixels analysis to fixed-gaze trials (pupil within 8 degrees of its modal position) leaves 11 exclusively center-responsive V1 RS units, and their responses to ICs and orientation match do not change the conclusion.

    When analyzing only fixed-gaze trials, there were n = 11 exclusively center-responsive V1 RS units; 10 sessions had eye tracking data and of these, 9 sessions had a valid receptive field mapping block where the fixed-gaze constraint left at least one trial in each position

    Extended Data Fig. 2b to 2e legends; Results, Mouse V1 neurons respond to ICs despite the absence of contrast within their receptive fields, paragraph 3

    Ten sessions have eye tracking, as in the paper. Under rule (r), any fixed-gaze RF trial counts for the coverage of the 9 positions, 9 sessions are valid, the paper's number; under rule (s), standard trials only, 8 are (session 630506 has no fixed-gaze standard trial at one position). Under rule (r) and fig1e reading (a), 10 exclusively center-responsive V1 RS units remain (within 11 +/- 1.1, in two sessions), and the orientation match (71.4% to 100% across tests and blocks, 7 to 9 IRE-responsive units) is above the shuffle 95th percentile (50.0% to 77.8%) in every combination. Under fig1e reading (b), 41 units remain. The units under rule (s) are the same 10, so the unit count rests on the session rule only through the session count. The fixed-gaze selection rests on the fig1e selection, which gives 44 units with all trials against the paper's 18, so the match of the fixed-gaze count may be partly coincidental.

    How the test differed from the paper’s method

    • The 8 degree threshold of the Methods cannot be applied, as the files give pupil position in camera pixels with no conversion; the code's 20 pixels (criterion reading b) is used.
    • Assumption. The criterion and the Extended Data Fig. 2 legend require that fixed-gaze RF trials cover all 9 positions ("at least one trial in each position") without saying whether inverse trials count. Rule (r), any RF trial, is adopted, as neither text restricts the trials to standard patches; it gives the paper's 9 sessions, where standard trials only give 8. A valid session with no fixed-gaze standard trial at a position gets p = 1 there. Asked of the authors under findings (methods_unavailable).
    • The shuffle 95th percentile of 1,000 permutations is the criterion's standard choice for the null of the match.
  • ReproducedExtended Data Fig. 2f legendverifier disagreed at first

    Receptive field positions mapped with fixed-gaze trials match those mapped with all trials for 81% of the 398 V1 RS units with significant receptive fields.

    Match proportion is 0.81 among 398 V1 RS units with significant receptive fields (p < 0.05 Kruskal-Wallis test across responses to 9 positions in the receptive field mapping block)

    Extended Data Fig. 2f legend

    On the 8 sessions of rule (s), reading (b) gives n = 414 with a match of 0.812 and reading (c) n = 374 with 0.832; on the 9 sessions of rule (r) of ed2b, (b) gives n = 434 with 0.804 and (c) n = 392 with 0.821. All are within 0.81 +/- 0.081 and 398 +/- 39.8. Reading (a) gives n = 602 (rule s) or 640 (rule r), outside tolerance.

  • ReproducedExtended Data Fig. 2g legendverifier disagreed at first

    Pupil area during the presentation does not differ across the images of the IC block.

    Pupil area, z-scored across each recording session, during visual presentation of various images in the IC block (n = 10 sessions with eye tracking data; p = 0.7220 Friedman test)

    Extended Data Fig. 2g legend

    What the paper reports

    • Friedman test, p = 0.722 (n = 10 sessions with eye tracking data)

    Friedman test across the 10 sessions with eye tracking: p = 0.356 for IC1, LC1, LC2 and IC2 (reading a) and p = 0.898 for all 22 images (reading b), both >= 0.05 (paper p = 0.722). The range of image means is 0.011 and 0.045 s.d. The end and maximum variants give p from 0.063 to 0.948; trials whose eye frames are all NaN now give NaN for the maximum, not -inf.

  • ReproducedExtended Data Fig. 2a legend; Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 3verifier disagreed at first

    Eye gaze is confined to a small region that fits within the illusory gap, with no systematic difference in pupil position among IC1, LC1, LC2 and IC2 presentations.

    Mouse eye gaze is confined to a small region that fits within the illusory gap region. There are no systematic differences in pupil position among I C1 vs. L C1 vs. L C2 vs. I C2 presentations

    Extended Data Fig. 2a legend; Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 3

    Friedman test of the per-session image means of the pupil center: p = 0.472 for x and 0.374 for y; the largest difference between image means in a session is 2.2 pixels. Per-session Kruskal-Wallis variant, p < 0.05 in 1 of 20 tests (smallest 0.026). Whether the gaze region fits within the illusory gap cannot be judged: the extent of the 0.01 density isoline is 24 to 124 camera pixels by session, and the files give no conversion to degrees.

    How the test differed from the paper’s method

    • The paper names no test for the absence of systematic differences; the criterion's Friedman test is a reader's choice.
  • ReproducedExtended Data Fig. 6e and 6f legendsverifier disagreed at first

    In the Neuropixels data, IC images do not evoke larger population average responses than LC images in any area, averaged over all units or over visually responsive units.

    I C images do not evoke greater responses than L C images (*p < 0.05 one-tailed Wilcoxon signed-rank test for testing I C > L C ; note that none of the visual areas showed significance)

    Extended Data Fig. 6e and 6f legends

    What the paper reports

    • all units, V1: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.9614
    • all units, LM: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.9805
    • all units, RL: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.7676
    • all units, AL: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.7217
    • all units, PM: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.9895
    • all units, AM: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.8398
    • visually responsive units, V1: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.9788
    • visually responsive units, LM: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.9805
    • visually responsive units, RL: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.7114
    • visually responsive units, AL: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.7842
    • visually responsive units, PM: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.9866
    • visually responsive units, AM: one-tailed Wilcoxon signed-rank test, IC > LC, p = 0.6499

    No area gives p < 0.05 in either panel: the one-tailed signed-rank p for IC > LC ranges from 0.72 to 0.99 over all RS units (e) and from 0.65 to 0.99 over visually responsive units (f). Eleven of the 12 p-values equal the paper's to four decimals; AM in panel (e) gives 0.8608 against 0.8398. The mean IC minus LC difference is between -0.078 and 0.005 spikes/s.

Not reproduced3

  • Not reproducedMethods, Definition of functional subsets of neurons, paragraph 1; Figure 1e legendverifier disagreed at first

    In the Neuropixels data, 18 of 1,804 V1 RS units respond exclusively to the grating patch at the center position (the illusory gap region) of the receptive field mapping block.

    In the Neuropixels data, there were n = 18 exclusively center-responsive neurons of 1,804 V1 RS units

    Methods, Definition of functional subsets of neurons, paragraph 1; Figure 1e legend

    The V1 RS count is 1,804, as in the paper, but 44 units are exclusively center-responsive under reading (a) and 52 under reading (b), against 18 +/- 1.8. Before the exclusivity rule, 474 units have the center as best position; under (a), 383 of them have at least one position passing the code's Holm step, 68 have exactly one position passing, and for 44 that position is the center; under (b), 602 units have the center passing Holm with a mean above the spontaneous windows and 52 of them have no other position passing. Units in both readings 5; reading (a) without the units labelled noise 37. The analyzeRFCI.m code could not be compared line by line in this run, so a difference in the selection procedure is possible.

  • Not reproducedFigure 1f legend; Results, Mouse V1 neurons respond to ICs despite the absence of contrast within their receptive fields, paragraph 2verifier disagreed at first

    Of the exclusively center-responsive V1 RS units, 66.7% respond substantially to the IC image and 77.8% to the real-edge (IRE) image of their preferred IRE orientation, although the IC image has no contrast in their receptive field.

    Bottom, individual neurons with substantially I C -responsive (left; 66.7%) and I RE -responsive (right; 77.8%) neurons marked in magenta on the y axis

    Figure 1f legend; Results, Mouse V1 neurons respond to ICs despite the absence of contrast within their receptive fields, paragraph 2

    No combination of fig1e reading, test and block puts both fractions within tolerance. The IC-responsive fraction ranges from 38.5% to 56.8% (below 66.7 +/- 6.67 in every combination); the IRE-responsive fraction is within 77.8 +/- 7.78 only with both blocks under fig1e reading (a) (77.3% and 79.5%), where the IC fraction is 38.6% and 54.5%. Measured values are for fig1e reading (a), block ICwcfg1, test (a). The units are those of fig1e, which did not reproduce.

  • Not reproducedFigure 1g legend; Results, Mouse V1 neurons respond to ICs despite the absence of contrast within their receptive fields, paragraph 2verifier disagreed at first

    For IRE-responsive exclusively center-responsive V1 RS units, the preferred orientation of the illusory bar matches that of the real bar in 78.6% of units.

    Comparison of the preferred orientation between illusory bars (I C stimuli) and real bars (I RE stimuli) for I RE -responsive and exclusively center-responsive V1 RS units, showing a 78.6% match

    Figure 1g legend; Results, Mouse V1 neurons respond to ICs despite the absence of contrast within their receptive fields, paragraph 2

    The criterion judges the match under the reading that reproduces fig1f, and none does. The match ranges from 60.0% to 93.3%; only fig1e reading (a) with block ICwcfg1 gives a value within 78.6 +/- 7.86 (75.0%, 28 IRE-responsive units). Every reading is above its shuffle 95th percentile (37.1% to 67.9%).

Blocked1

  • BlockedFigure 2d legend; Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 4· Methods underspecifiedverifier disagreed at first

    V1 IC-encoders (n = 79) are more likely than V1 segment responders (n = 526) to receive putative excitatory connections from higher visual areas, by cross-correlogram analysis.

    V1 IC-encoders ( n = 79) are substantially more likely than V1 segment responders ( n = 526) to receive putative excitatory connections from higher visual areas (LM, RL, AL, PM and AM)

    Figure 2d legend; Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 4

    What the paper reports

    • Wilcoxon rank-sum test, p = 7 × 10⁻⁶ (n = 79 V1 IC-encoders and 526 V1 segment responders, 12 sessions from 12 mice)

    The groups hold 79 V1 IC-encoders and 526 V1 segment responders, the paper's numbers. In all 8 combinations of smoothing (boxcar, Gaussian), flank (raw, corrected) and measure (fraction, number of connected HVA units), IC-encoders have the larger mean and P(IC-encoder > segment responder) from 0.62 to 0.64, with a tie-corrected two-sided rank-sum p from 1.0e-05 to 3.9e-04 (paper 7.0e-06). The medians are higher for IC-encoders in 7 combinations; for the number of connections with boxcar smoothing and the raw flank they are equal (1 and 1, p = 9.8e-05). The criterion requires a higher median and p < 0.05 under every combination; 7 of 8 meet it, so the readings differ and the criterion sends the claim to blocked (methods_underspecified). The effect the claim describes is present under every combination.

    How the test differed from the paper’s method

    • The per-pair normalisation by the square root of the spike counts is left out; it does not change the comparison of a pair's peak with its own flank.

Decoding the illusory contour images and their inference (Shin et al. 2025) 5

Notebook decoding_shin_2025.ipynb

Reproduced5

  • ReproducedFigure 3a; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 3verifier disagreed at first

    A linear SVM decodes the four images IC1, LC1, LC2 and IC2 from V1 activity in the Neuropixels data with tenfold cross-validation accuracy above the chance of 0.25.

    The tenfold cross-validation performance was substantially above chance, indicating that neural activity patterns evoked by these four images were highly distinct at the multivariate level

    Figure 3a; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 3

    V1 accuracy 0.697 +/- 0.052 under reading (a) and 0.719 +/- 0.056 under reading (b), against the chance of 0.25, signed-rank p = 0.00049 under both, 12 of 12 sessions above 0.25 (range 0.268 to 0.887 under reading a). The other areas range from 0.48 (AM) to 0.709 (LM) under reading (a).

  • ReproducedFigure 3c; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 4verifier disagreed at first

    In Neuropixels V1, TRE trials are decoded as the matching IC image more often than as the matching LC image (0.51 against 0.22), so IC inference is represented in V1.

    Applying inference decoding to Neuropixels V1 recordings revealed that T RE was substantially more likely to be decoded as I C than as L C (Fig. 3c ; decoding probability for I C vs. L C was 0.51 vs. 0.22, P < 0.05 Wilcoxon signed-rank test)

    Figure 3c; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 4

    What the paper reports

    • Wilcoxon signed-rank test, p < 0.05 (n = 12 sessions from 12 mice)

    Under reading (b), P(TRE -> IC) = 0.518 and P(TRE -> LC) = 0.210, both within tolerance, IC above LC in 10 of 12 sessions, signed-rank p = 0.0024. Under reading (a), 0.516 and 0.197, the LC value 0.0014 below the lower bound 0.198, same p. With two further cross-validation seeds, both values are within tolerance under both readings, reading (a) IC 0.513 and 0.511, LC 0.198 and 0.199, p = 0.0024 (decoding_checks_shin_2025.ipynb), reading (b) IC 0.519 and 0.514, LC 0.209 and 0.215, p = 0.0015 and 0.0068 (decoding_seed1_shin_2025.ipynb, decoding_seed2_shin_2025.ipynb), so the outcome does not depend on the seed.

    How the test differed from the paper’s method

    • The decoder is scikit-learn's libsvm SVM, not MATLAB's fitcecoc; reading (b) searches C from 10^-3 to 1 with one-vs-one coding in place of the code's Bayesian search. On the first outer fold of the V1 sessions, C above 1 gave a lower best inner accuracy in all 12 (by 0.005 to 0.064), from fits that partly did not converge (12 to 17 of 36 per C value), and the one-vs-all coding changed the best inner accuracy by -0.012 to 0.024 (decoding_checks_shin_2025.ipynb).
  • ReproducedFigure 3d legend; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 5verifier disagreed at firstrests on an assumption

    In the Neuropixels data almost every visual area decodes TRE as IC more than as LC, significantly in V1, LM, RL, AL and PM and not in AM, with V1, LM and AL the strongest.

    In the Neuropixels dataset, almost every visual area was substantially biased toward decoding T RE as I C than L C , with V1, LM and AL showing the strongest representations of the IC

    Figure 3d legend; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 5

    What the paper reports

    • V1, 12 sessions: Wilcoxon signed-rank test, p = 0.0132
    • LM, 8 sessions: Wilcoxon signed-rank test, p = 0.0156
    • RL, 11 sessions: Wilcoxon signed-rank test, p = 0.0244
    • AL, 10 sessions: Wilcoxon signed-rank test, p = 0.0039
    • PM, 12 sessions: Wilcoxon signed-rank test, p = 0.0342
    • AM, 11 sessions: Wilcoxon signed-rank test, p = 0.1748

    Under reading (b), adopted, the first seed gives four areas that decode TRE as IC significantly more than as LC (V1 p = 0.0024, LM 0.0156, RL 0.0049, AL 0.0020; PM 0.077, AM 0.083), with LM, V1 and AL the three largest mean scores (0.346, 0.308, 0.285). The two further seeds give five significant areas each, V1, LM, RL, AL and PM (PM p = 0.0425, AM p = 0.083) and V1, LM, RL, AL and AM (AM p = 0.0186, PM p = 0.052), with LM, V1 and AL the three largest. Under reading (a), five areas are significant with all three seeds (V1, LM, RL, AL and AM; PM p = 0.092 with the first seed) and V1, LM and AL are the three largest. The criterion is met in five of six runs. V1, LM, RL and AL are significant and LM, V1 and AL the three largest in all six; only the fifth area changes, and PM p runs from 0.0425 to 0.092 and AM p from 0.0020 to 0.083. The statement names PM as significant and AM as not; that set appears only with reading (b) and seed +100000, and the criterion counts areas without naming them. Sessions per area 12, 8, 11, 10, 12, 11, as in the paper.

    How the test differed from the paper’s method

    • Assumption. The Methods do not say how the SVM hyperparameters were set; the paper's code chooses them with OptimizeHyperparameters. Reading (b), C chosen by an inner cross-validation, is adopted as the reading closer to the code. It searches C from 10^-3 to 1 with one-vs-one coding. On the first outer fold of each session of V1, PM and AM, C above 1 gave a higher best inner accuracy in 1 of 35 sessions (PM, by 0.001), from fits that mostly did not converge (PM 28 to 30 and AM 30 of 33 or 36 per C value), and the one-vs-all coding changed the best inner accuracy by -0.026 to 0.027, which could change the chosen coding in some sessions; its effect on the inference scores was not computed (decoding_checks_shin_2025.ipynb). Asked of the authors under findings (methods_unavailable).
    • Assumption. The cross-validation partition is random, and reading (b) meets the criterion with two of three seeds (the first seed gives four significant areas). The outcome follows the majority of the seeds, a rule chosen after the first seed's result and not stated in the criterion. A rule requiring every seed would give partially reproduced; averaging the per-session scores over the seeds was not computed.
    • The decoder is scikit-learn's libsvm SVM, not MATLAB's fitcecoc.
  • ReproducedExtended Data Fig. 7b legend; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 7verifier disagreed at first

    Decoders trained on the XRE real-bar images classify IC1 and IC2 trials as the XRE image whose real bar matches the illusory bar, above chance in all six Neuropixels areas.

    As with T RE inference decoding (Fig. 2 ), layer 2/3 of V1 and LM consistently show high inference scores (*p < 0.05, Wilcoxon signed-rank test compared to chance of 0.5

    Extended Data Fig. 7b legend; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 7

    What the paper reports

    • V1, 12 sessions: Wilcoxon signed-rank test against 0.5, p = 5 × 10⁻⁴
    • LM, 8 sessions: Wilcoxon signed-rank test against 0.5, p = 0.0078
    • RL, 11 sessions: Wilcoxon signed-rank test against 0.5, p = 0.0049
    • AL, 10 sessions: Wilcoxon signed-rank test against 0.5, p = 0.002
    • PM, 12 sessions: Wilcoxon signed-rank test against 0.5, p = 5 × 10⁻⁴
    • AM, 11 sessions: Wilcoxon signed-rank test against 0.5, p = 0.0137

    The XRE inference score is above 0.5 in all six areas under both readings, with signed-rank p from 0.0005 (V1) to 0.0137 (AM), equal or close to the paper's values (0.0005 to 0.0137). Mean scores 0.576 (AM) to 0.718 (V1) under reading (a) and 0.585 to 0.762 under reading (b); the chance of the two-class decoder is 0.5.

  • ReproducedResults, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 9; Extended Data Fig. 7a and 7c legendsverifier disagreed at first

    No higher visual area shows a substantially larger inference performance than V1, although decoding accuracy and inference scores differ across areas.

    Notably, none of the higher visual areas showed a substantially larger inference performance compared to V1 (Extended Data Fig. 7a,c )

    Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 9; Extended Data Fig. 7a and 7c legends

    What the paper reports

    • cross-validation accuracy across the six areas, Neuropixels (Extended Data Fig. 7a): Kruskal-Wallis test, p = 0.0019
    • TRE inference score across the six areas, Neuropixels (Extended Data Fig. 7a): Kruskal-Wallis test, p = 0.0249
    • cross-validation accuracy across areas, XRE decoders (Extended Data Fig. 7c): Kruskal-Wallis test, p = 5 × 10⁻⁴
    • XRE inference score across areas (Extended Data Fig. 7c): Kruskal-Wallis test, p = 0.0022

    No higher visual area has a significantly larger TRE or XRE inference score than V1 under either pairwise test (signed-rank, Tukey-Kramer) or either decoder reading; every significant difference has the HVA below V1. These are PM and AM in several measures, RL in XRE accuracy (both readings) and XRE score (reading b, signed-rank p = 0.0244 and Tukey-Kramer), and LM in XRE accuracy under reading (b) (signed-rank p = 0.0234). The Kruskal-Wallis tests across the six areas are significant, as in the paper: reading (a) p = 0.0006, 0.0071, 0.0005 and 0.0077 for accuracy, inference score, XRE accuracy and XRE score (paper 0.0019, 0.0249, 0.0005, 0.0022); reading (b) 0.0017, 0.0156, 0.0002 and 0.0015.

    How the test differed from the paper’s method

    • Extended Data Fig. 7c pools Neuropixels and 2p areas; its Kruskal-Wallis values are compared on the six Neuropixels areas only (criterion).

Seeds, C search and other decoder types for the decoding claims (Shin et al. 2025) 1

Notebook decoding_checks_shin_2025.ipynb

Blocked1

  • BlockedResults, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 8; Supplementary Fig. 3 (not read); Methods, Decoding analysis, paragraph 3· Too large to analyse

    Decoders of other kinds (quadratic and radial basis function SVMs, a fully connected neural network) give results highly consistent with the linear SVM.

    In addition, different types of decoders yielded highly consistent results (Supplementary Fig. 3 )

    Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 8; Supplementary Fig. 3 (not read); Methods, Decoding analysis, paragraph 3

    The quadratic and RBF SVMs were run (reading a, C = 1, one further seed): the TRE inference score is positive and significant in V1, LM and AL for both, as for the linear SVM on the same seed (p from 0.0015 to 0.0156 for the three kernels; mean scores 0.257 to 0.335). The network of the Methods (two hidden layers of 100 units, 50,000 full-batch epochs, tenfold) takes 4.38 ms per epoch on 89 units in this run, about 3.7 minutes per fit and about 18 hours on one core for the 300 fits of V1, LM and AL (the timing varies between runs; the run the verifier reviewed printed 3.60 ms and 15 hours), far beyond the notebook limit of 30 minutes. The criterion needs each decoder type, so the claim is not decided; the part that ran agrees with it.

    How the test differed from the paper’s method

    • The quadratic kernel is (gamma <x, y> + 1)^2 and the RBF kernel uses scikit-learn's gamma "scale"; the paper gives no kernel parameters (assumption, stated in the helper).
    • Supplementary Fig. 3 was not read; the test on the Neuropixels areas V1, LM and AL is the criterion's reading.

Not tested in a notebook 21

21 data missing from the dataset

Blocked21

  • BlockedFigure 1i to 1k legend; Methods, Definition of functional subsets of neurons, paragraph 1· Data missing from the dataset

    In the 2p data, 310 of 18,576 V1L2/3 neurons are exclusively center-responsive; 21.3% of them respond to the IC and 43.2% to the IRE image, and preferred IC and IRE orientations match in 54.5%.

    Bottom, individual neurons with substantially I C -responsive (left; 21.3%) and I RE -responsive (right; 43.2%) neurons marked in magenta on the y axis. There was a 54.5% match

    Figure 1i to 1k legend; Methods, Definition of functional subsets of neurons, paragraph 1

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 3; Methods, Definition of functional subsets of neurons, paragraph 2· Data missing from the dataset

    About 4.3% of V1L2/3 neurons are IC-encoders (selective for one of the two IC images with no substantial response to either LC image), 8.5% over both white-circle configurations.

    Using these stimuli, we identified approximately 4.3% of neurons in V1L2/3 with selectivity for one of the two I C images, and no substantial responses to either L C image

    Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 3; Methods, Definition of functional subsets of neurons, paragraph 2

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedFigure 2c legend; Extended Data Fig. 5b legend· Data missing from the dataset

    V1L2/3 IC-encoders are tuned to the orientation of the illusory bar of their IC image, measured with single long bars, for white-circle and black-circle blocks alike.

    Indeed, IC-encoders in V1L2/3 were tuned to the orientation of the illusory bar in the I C image (I C1 -encoders were tuned to 135°, and I C2 -encoders were tuned to 45°)

    Figure 2c legend; Extended Data Fig. 5b legend

    What the paper reports

    • illusory bar against orthogonal orientation, Fig. 2c: Wilcoxon signed-rank test, p = 1.8 × 10⁻⁵ (n = 11 sessions from five mice)
    • white-circles block, Extended Data Fig. 5b: Wilcoxon signed-rank test, p = 0.0017 (n = 93 IC1-encoders and 159 IC2-encoders)
    • black-circles block, Extended Data Fig. 5b: Wilcoxon signed-rank test, p = 2.6 × 10⁻⁸ (n = 409 IC1-encoders and 482 IC2-encoders)

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedExtended Data Fig. 4c legend; Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 6· Data missing from the dataset

    IC-encoders' receptive fields are not biased toward the illusory gap region, while segment responders' receptive fields are biased toward the segments that define them.

    IC-encoders’ receptive fields are not biased toward the illusory gap region (n = 367/386 I C1 /I C2 -encoders in 24 sessions from 4 mice). On the contrary, segment responders’ receptive fields are biased toward the image segments that are used to define them

    Extended Data Fig. 4c legend; Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 6

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 6; Extended Data Fig. 5c and 5d legends· Data missing from the dataset

    IC-encoders do not have larger receptive fields than other V1L2/3 neurons, by size tuning and by the number of grating patches they respond to.

    Furthermore, IC-encoders did not have substantially larger receptive fields compared to other neurons in V1L2/3

    Results, A subpopulation of V1 neurons respond to ICs but not to its inducing segments, paragraph 6; Extended Data Fig. 5c and 5d legends

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 4; Figure 3e legend· Data missing from the dataset

    Inference decoding is significant in V1L2/3 and not in V1L4, so V1L2/3 is the lowest region of the visual hierarchy where IC inference is represented.

    Whereas V1L2/3 showed substantial inference decoding performance, V1L4 did not (Fig. 3e )

    Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 4; Figure 3e legend

    What the paper reports

    • V1L4, 8 sessions: Wilcoxon signed-rank test, p = 0.3125
    • V1L2/3, 11 sessions: Wilcoxon signed-rank test, p = 0.0049

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 5; Figure 3e legend· Data missing from the dataset

    In the 2p mesoscope data, V1 and LM show significant IC inference, and RL, AL, PM and AM do not.

    Similarly, L2/3 of V1 and LM showed the strongest IC representation in the 2p mesoscope dataset (Fig. 3e )

    Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 5; Figure 3e legend

    What the paper reports

    • mesoscope V1, 19 sessions: Wilcoxon signed-rank test, p = 0.0196
    • LM, 8 sessions: Wilcoxon signed-rank test, p = 0.0391
    • RL, 15 sessions: Wilcoxon signed-rank test, p = 0.2293
    • AL, 2 sessions: Wilcoxon signed-rank test, p = 1
    • PM, 6 sessions: Wilcoxon signed-rank test, p = 0.4375
    • AM, 1 session: Wilcoxon signed-rank test, p = 1

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedExtended Data Fig. 7b legend; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 7· Data missing from the dataset

    XRE inference decoding gives results consistent with TRE inference decoding in the 2p data, significant in V1L2/3, mesoscope V1, LM and RL and not in V1L4, AL, PM or AM.

    When applying X RE inference decoding to different visual areas, we found consistent results as T RE inference decoding

    Extended Data Fig. 7b legend; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 7

    What the paper reports

    • V1L4: Wilcoxon signed-rank test against 0.5, p = 0.4609
    • V1L2/3: Wilcoxon signed-rank test against 0.5, p = 0.002
    • mesoscope V1: Wilcoxon signed-rank test against 0.5, p = 7 × 10⁻⁴
    • LM: Wilcoxon signed-rank test against 0.5, p = 0.0078
    • RL: Wilcoxon signed-rank test against 0.5, p = 0.0054
    • AL, 2 sessions: Wilcoxon signed-rank test against 0.5, p = 0.5
    • PM, 6 sessions: Wilcoxon signed-rank test against 0.5, p = 0.4375
    • AM, 1 session: Wilcoxon signed-rank test against 0.5, p = 1

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedExtended Data Fig. 5e legend; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 8· Data missing from the dataset

    Inference decoding indicates IC inference in V1L2/3 for white-circle and for black-circle (inverted) blocks alike.

    We found that inference decoding indicated the representation of IC inference in V1L2/3 regardless of black–white inversion (Extended Data Fig. 5e )

    Extended Data Fig. 5e legend; Results, Representation of IC inference across the mouse visual cortical hierarchy, paragraph 8

    What the paper reports

    • white-circles blocks: Wilcoxon signed-rank test, p = 0.002 (n = 11 sessions)
    • black-circles blocks: Wilcoxon signed-rank test, p = 0.0273 (n = 9 sessions)

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedExtended Data Fig. 4h and 4i legend· Data missing from the dataset

    With IC block images scaled up 1.5 times, decoding accuracy is above chance and the TRE inference score above zero in V1L2/3.

    Decoder performance for images scaled up by 1.5× (n = 10 sessions from 5 mice)

    Extended Data Fig. 4h and 4i legend

    What the paper reports

    • cross-validation accuracy against 0.25: Wilcoxon signed-rank test, p = 0.002
    • TRE inference score against 0: Wilcoxon signed-rank test, p = 0.002

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, Mouse V1 neurons respond to ICs despite the absence of contrast within their receptive fields, paragraph 3; Extended Data Fig. 3 legend· Data missing from the dataset

    V1L2/3 neurons with receptive fields in the gap respond to illusory bars with the orientation selectivity of real bars also with larger gaps, dense receptive field mapping and contrast bars.

    We further verified the illusory bar responsiveness and orientation selectivity for exclusively center-responsive V1 neurons using larger illusory gap sizes (Extended Data Fig. 3a–d ), denser receptive field mappings (Extended Data Fig. 3e–h ) and contrast bars instead of outline bars

    Results, Mouse V1 neurons respond to ICs despite the absence of contrast within their receptive fields, paragraph 3; Extended Data Fig. 3 legend

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedFigure 4a legend; Results, Neurons that respond emergently to ICs mediate the representation of inference in V1, paragraphs 2 and 4· Data missing from the dataset

    Zeroing out IC-encoders in the input of a trained V1L2/3 decoder abolishes the TRE inference performance, while zeroing out segment responders does not.

    Indeed, this abolished the IC inference performance; T RE -responses were no longer biased toward being classified as I C compared to L C (Fig. 4a , right)

    Figure 4a legend; Results, Neurons that respond emergently to ICs mediate the representation of inference in V1, paragraphs 2 and 4

    What the paper reports

    • cross-validation accuracy across subsets: Friedman test, p = 1.1 × 10⁻⁵ (n = 24 sessions from four mice)
    • TRE inference performance across subsets: Friedman test, p = 0.0019 (n = 24 sessions from four mice)
    • TRE inference, first subset of the figure: Wilcoxon signed-rank test, p = 0.0177
    • TRE inference, second subset of the figure: Wilcoxon signed-rank test, p = 0.1228
    • TRE inference, third subset of the figure: Wilcoxon signed-rank test, p = 0.0089

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedFigure 4b legend; Results, Neurons that respond emergently to ICs mediate the representation of inference in V1, paragraphs 3 and 4· Data missing from the dataset

    A decoder trained only on IC-encoders (30 +/- 4 per session) shows high TRE inference performance, while one trained only on segment responders (69 +/- 8) does not, though both discriminate IC from LC images.

    Despite training this decoder on the activity of drastically fewer cells, it showed high levels of IC inference performance (Fig. 4b , right)

    Figure 4b legend; Results, Neurons that respond emergently to ICs mediate the representation of inference in V1, paragraphs 3 and 4

    What the paper reports

    • cross-validation accuracy across subsets: Friedman test, p = 0.0025
    • cross-validation accuracy against 0.25, first subset of the figure: Wilcoxon signed-rank test, p = 1.8 × 10⁻⁵
    • cross-validation accuracy against 0.25, second subset of the figure: Wilcoxon signed-rank test, p = 1.8 × 10⁻⁵
    • cross-validation accuracy against 0.25, third subset of the figure: Wilcoxon signed-rank test, p = 5.6 × 10⁻⁵
    • TRE inference score across subsets: Friedman test, p = 0.0208
    • TRE inference, first subset of the figure: Wilcoxon signed-rank test, p = 0.0177
    • TRE inference, second subset of the figure: Wilcoxon signed-rank test, p = 4 × 10⁻⁴
    • TRE inference, third subset of the figure: Wilcoxon signed-rank test, p = 0.2472

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 4; Figure 5c; Extended Data Fig. 8b legend· Data missing from the dataset

    Photoactivating IC-encoders evokes larger activity in nonphotoactivated IC-responsive neurons than in non-IC-responsive neurons, while photoactivating segment responders does not.

    Despite this heterogeneity, targeting IC-encoders evoked substantially larger activity in I C -responsive neurons compared to non-I C -responsive neurons during the photoactivation window

    Results, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 4; Figure 5c; Extended Data Fig. 8b legend

    What the paper reports

    • IC-encoder ensembles: one-tailed Wilcoxon signed-rank test, p = 0.0023 (n = 32 holographic ensembles)
    • segment responder ensembles: one-tailed Wilcoxon signed-rank test, p = 0.966 (n = 37 holographic ensembles)

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 4; Figure 5c· Data missing from the dataset

    Photoactivating a sparse ensemble of V1L2/3 excitatory neurons leads on average to a prolonged suppression of the nonphotoactivated population.

    Consistent with prior reports, photoactivating a sparse ensemble of excitatory neurons in V1L2/3 led to a prolonged suppression of the nonphotoactivated population on average

    Results, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 4; Figure 5c

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedFigure 5d legend; Results, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 6· Data missing from the dataset

    Holographic activation of IC-encoders is decoded as the corresponding IC image, both from all neurons and from nonphotoactivated neurons only (median 0.372), in the absence of any visual stimulus.

    Indeed, the decoder constructed with nonphotoactivated neurons was able to classify IC-encoder photoactivation trials as the corresponding I C image

    Figure 5d legend; Results, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 6

    What the paper reports

    • all imaged neurons: one-tailed Wilcoxon signed-rank test against chance, p = 7.9 × 10⁻⁷ (n = 32 IC-encoder ensembles)
    • nonphotoactivated neurons: one-tailed Wilcoxon signed-rank test against chance, p = 4.3 × 10⁻⁵ (n = 32 IC-encoder ensembles)

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedFigure 5e legend; Results, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 6· Data missing from the dataset

    Holographic activation of segment responders is decoded as the corresponding IC image from all neurons, but not from nonphotoactivated neurons (median 0.228).

    In contrast, photoactivating a similar number of segment responders did not evoke decodable activity patterns (Fig. 5e , right, and Extended Data Fig. 9c,d,g,h )

    Figure 5e legend; Results, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 6

    What the paper reports

    • all imaged neurons: one-tailed Wilcoxon signed-rank test against chance, p = 0.0029 (n = 37 segment responder ensembles)
    • nonphotoactivated neurons: one-tailed Wilcoxon signed-rank test against chance, p = 0.3254 (n = 37 segment responder ensembles)

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, Neurons that encode IC inference drive neural pattern completion within V1, paragraphs 6 and 7; Extended Data Fig. 9b· Data missing from the dataset

    Decoding IC-encoder holography trials with a decoder trained on visual trials approaches the cross-validation accuracy on held-out visual trials (0.4029 against 0.4818), and the effect correlates with the number of targets.

    mean ± s.e.m. performance for decoding holography trials as visual image labels was 0.4029 ± 0.0296, whereas cross-validation accuracy was 0.4818 ± 0.0165

    Results, Neurons that encode IC inference drive neural pattern completion within V1, paragraphs 6 and 7; Extended Data Fig. 9b

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedResults, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 8; Extended Data Fig. 10e and 10g legends· Data missing from the dataset

    LC-encoders are less potent than IC-encoders at driving pattern completion, even when matched in visual information.

    LC-encoders were substantially less potent at driving pattern completion of L C representations compared to IC-encoders

    Results, Neurons that encode IC inference drive neural pattern completion within V1, paragraph 8; Extended Data Fig. 10e and 10g legends

    What the paper reports

    • nonphotoactivated decoding across LC-encoder, IC-encoder and segment responder ensembles: Kruskal-Wallis test, then Bonferroni-Holm corrected Wilcoxon rank-sum tests, p = 0.0012 (n = 35, 32 and 37 ensembles)
    • same, bootstrapped groups matched in visual information: Kruskal-Wallis test, then Bonferroni-Holm corrected Wilcoxon rank-sum tests, p = 0.0022 (n = 48 ensembles per group)

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedFigure 6d legend; Results, IC encoding is mediated by a looped circuit in the visual cortical hierarchy, paragraph 4· Data missing from the dataset

    On the 2p holographic mesoscope, photoactivating V1 IC-encoders is decoded as the corresponding image from all neurons, but not from nonphotoactivated neurons in higher visual areas.

    In stark contrast to pattern completion effects within V1L2/3 (Fig. 5d,e , right), V1 segment responders, but not V1 IC-encoders, drove IC representation in higher visual areas

    Figure 6d legend; Results, IC encoding is mediated by a looped circuit in the visual cortical hierarchy, paragraph 4

    What the paper reports

    • all neurons: one-tailed Wilcoxon signed-rank test against chance, p = 0.001 (n = 11 IC-encoder ensembles)
    • nonphotoactivated neurons in higher visual areas: one-tailed Wilcoxon signed-rank test against chance, p = 0.3501 (n = 11 IC-encoder ensembles)

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

  • BlockedFigure 6e legend; Results, IC encoding is mediated by a looped circuit in the visual cortical hierarchy, paragraph 4· Data missing from the dataset

    On the 2p holographic mesoscope, photoactivating V1 segment responders drives IC representations in nonphotoactivated neurons of higher visual areas.

    These data demonstrate that V1 segment responders drive feedforward communication of the bottom-up sensory information to higher visual areas

    Figure 6e legend; Results, IC encoding is mediated by a looped circuit in the visual cortical hierarchy, paragraph 4

    What the paper reports

    • all neurons: one-tailed Wilcoxon signed-rank test against chance, p = 0.0047 (n = 22 segment responder ensembles)
    • nonphotoactivated neurons in higher visual areas: one-tailed Wilcoxon signed-rank test against chance, p = 0.0457 (n = 22 segment responder ensembles)

    The 2p imaging, 2p mesoscope and 2p holography recordings are not in this dandiset, which holds only the 12 Neuropixels sessions (78 files, no imaging). The paper's Data availability names only dandiset 000248 for the Neuropixels data and additional postprocessed data in Code Ocean (10.24433/CO.6659254.v2), without saying what they are; the capsule answered HTTP 403 from this run. No public copy of the 2p recordings was found.

Findings about the data

What attempts found about the dataset itself, for its owner and the archive.

  • Data missingThe dandiset holds the 12 Neuropixels sessions only. The 2p imaging (V1L2/3, V1L4, mesoscope) and 2p holographic optogenetics recordings behind Figures 1h to 1k, 2b, 2c, 3e and 4 to 6 and several Extended Data figures are not in it, and the paper names no public archive for them; 21 of the paper's findings cannot be tested.
  • Metadata errorThe units tables hold units whose quality is labelled noise (539 of 3,026 units in sub-633229, 322 of the V1 units across sessions), while the Methods state that all units not classified as noise were packaged into the NWB files.
  • Paper inconsistentThe Methods' Animals list 14 Neuropixels mice (Sst-IRES-Cre;Ai32 n = 10, PV-IRES-Cre;Ai32 n = 4); the files hold 12 sessions from 12 mice (9 Sst, 3 Pvalb), as the Results and legends state.
  • Metadata errorThe eye tracking pupil position (pupil_tracking/data) is stated in meters; its values (pupil center near 300 to 400, pupil half-width near 20) are camera pixels, and no conversion to visual degrees is given, so the Methods' 8 degree fixed-gaze criterion cannot be applied from the files.
  • Paper inconsistentThe Methods say eye video was acquired at 30 Hz; the eye tracking timestamps in the files are 16.7 ms apart (60 Hz), which is what the paper's code assumes.
  • Description missingThe IC block tables give each image only as a frame index (0 to 21) with no image names; the names come from the paper's code, and the image templates stored in the files allow them to be checked by eye.
  • OtherThe last eye tracking timestamp of each session with eye tracking is NaN.
  • Methods not availableFor the authors. The Methods do not say how the SVM hyperparameters were set; the code calls fitcecoc with OptimizeHyperparameters auto. Which coding, box constraint and kernel scale were chosen per session and area? The significance of PM and AM in Fig. 3d depends on it here (four areas significant with C chosen by inner cross-validation, five with C = 1), and with C chosen by inner cross-validation it also depends on the cross-validation partition (five areas with each of two further seeds, PM significant with one and AM with the other).
  • Methods not availableFor the authors. Extended Data Fig. 2 counts sessions whose fixed-gaze RF trials left at least one trial in each position. Do inverse-patch trials count towards that coverage? Counting them gives the paper's 9 sessions; counting standard trials only gives 8.
  • Methods not availableFor the authors. Extended Data Fig. 6b counts 87 V1 IC-encoders and 636 segment responders. Are these all units in the NWB files, including those whose quality column says noise? All units give exactly 87 and 636; dropping the units labelled noise gives 79 and 566.

Notebooks

Every registered entry that uses this dataset. An entry can hold several notebooks, and can use more than one dataset.

Reproduction Illusory contour responses in mouse visual cortex, Neuropixels (Shin et al. 2025)

Tests the Neuropixels findings of Shin, Ogando, Abdeladim and colleagues (2025) on dandiset 000248, which holds 12 Neuropixels sessions with six probes in V1, LM, RL, AL, PM and AM while mice viewed illusory contour images. It counts the units and the IC-encoders and segment responders, selects exclusively center-responsive V1 units, repeats the analyses on fixed-gaze trials, computes cross-correlograms between V1 and higher visual areas, and decodes the images and the inference of the illusory contour from each area. The 2p imaging and holography data of the paper are not in the dandiset. All files

  • Reproducing Shin et al. (2025) from dandiset 000248
    reproduce_shin_2025.ipynb
    Executed, with outputs · Source
  • Decoding the illusory contour images and their inference (Shin et al. 2025)
    decoding_shin_2025.ipynb
    Executed, with outputs · Source
  • Seeds, C search and other decoder types for the decoding claims (Shin et al. 2025)
    decoding_checks_shin_2025.ipynb
    Executed, with outputs · Source
  • Decoder reading (b) with a further cross-validation seed, first of two (Shin et al. 2025)
    decoding_seed1_shin_2025.ipynb
    Source
  • Decoder reading (b) with a further cross-validation seed, second of two (Shin et al. 2025)
    decoding_seed2_shin_2025.ipynb
    Source

Verification

  • Round 1
    2026-10-28
    Agreed with 22 of 40 outcomes. Independent agent run by CatalystNeuro (same harness, separate context, did not write the notebook). Reviewed: Round 1. The executed notebook with the conclusion cells and the summary removed, the helper module and the claims file, with the paper. The record then had all 18 Neuropixels claims and supp3 blocked (too_large) because the author's run ended before the notebook was executed. The verifier gave its own outcome for each claim from the outputs; agreement is against that record, so it disagrees on every tested Neuropixels claim. It queried the DANDI API for the blocked 2p claims and tested the helpers on synthetic inputs.
    • results-npx-units-per-session: the verifier’s outcome was “Reproduced”. V1 has 150.3 +/- 19.8 RS units per session (1,804 in total); higher visual areas have 582.8 +/- 43.3, within 597 +/- 46.
    • methods-npx-ic-encoder-count: the verifier’s outcome was “Reproduced”. 159 units are IC-encoders in at least one block (reading a), exactly the paper's 159; reading b gives 163.
    • ed6b-npx-v1-group-counts: the verifier’s outcome was “Reproduced”. Reading b1 (all V1 units in the files, ICwcfg1) gives exactly 87 IC-encoders and 636 segment responders. Dropping units labelled noise gives 79 and 566 (problem 6). The literal filter (b2) would fail the claim; the exact 87 and 636 under b1 strongly support the notebook's reading.
    • ed6cd-npx-ic-encoders-all-areas: the verifier’s outcome was “Reproduced”. All six areas hold IC-encoders: between 48 and 79 per area, and in 8 to 12 sessions per area.
    • fig1e-npx-exclusive-center: the verifier’s outcome was “Not reproduced”. 44 exclusively center-responsive units under reading a and 52 under reading b, against 18 +/- 1.8. The V1 RS count of 1,804 matches. It asked for a count of fig1e units before the exclusivity step, to locate where 44 or 52 diverge from 18.
    • fig1f-npx-ic-ire-responsive: the verifier’s outcome was “Not reproduced”. No combination puts both fractions within tolerance. IC-responsive ranges from 38.5% to 56.8% against 66.7 +/- 6.67; IRE-responsive is within tolerance only under block (ii) (77.3% and 79.5%). This rests on the unit set of fig1e, which did not reproduce.
    • fig1g-npx-orientation-match: the verifier’s outcome was “Not reproduced”. The criterion ties the result to a reading that reproduces fig1f, and none does. The match ranges from 60.0% to 93.3%; only fig1e (a), block (i) gives 75.0%, within 78.6 +/- 7.86. Every reading is above its shuffle 95th percentile.
    • ed2b-npx-fixed-gaze: the verifier’s outcome was “Partially reproduced”. 10 sessions have eye tracking. Only 8 sessions are valid, against the paper's 9, and the criterion requires an exact match. Under fig1e reading a, 10 units remain (within 11 +/- 1.1) and the match is above the shuffle 95th percentile. A session counts as valid only if its fixed-gaze standard RF trials cover all 9 positions, while the legend says "at least one trial in each position"; session 630506 covers 8 positions with standard trials only, and counting inverse trials was not tried (problem 4).
    • ed2f-npx-rf-match: the verifier’s outcome was “Reproduced”. Reading b gives n = 414 with a match of 0.812; reading c gives n = 374 with 0.832. Both are within 398 +/- 39.8 and 0.81 +/- 0.081.
    • ed2g-npx-pupil-area: the verifier’s outcome was “Reproduced”. Friedman p = 0.356 for reading a and 0.898 for reading b, both >= 0.05. For trials whose eye frames are all NaN, the area_max variant becomes -inf, so its range prints as NaN or inf (problem 9).
    • ed2a-npx-gaze-confined: the verifier’s outcome was “Reproduced”. Friedman p = 0.47 for x and 0.37 for y. The confinement extent is reported only in camera pixels (24 to 124 px), so "fits within the gap" cannot be judged.
    • fig2d-npx-ccg-hva-input: the verifier’s outcome was “Blocked”. Group sizes are exactly 79 and 526, and all 8 combinations give IC-encoders the higher mean with rank-sum p <= 5e-4. But under boxcar, raw flank, number of connections, the medians tie at 1 and 1. The criterion requires a higher median under every combination, otherwise blocked (methods_underspecified). The rule is brittle on a tie of integer medians (problem 5); stats.ranksums has no tie correction (problem 10).
    • fig3a-npx-v1-decoding: the verifier’s outcome was “Reproduced”. V1 accuracy is 0.697 (decoder reading a) and 0.719 (reading b), with signed-rank p = 0.00049 against the chance of 0.25 under both.
    • fig3c-npx-v1-inference: the verifier’s outcome was “Reproduced”. Under decoder reading b, TRE is decoded as IC 0.518 and as LC 0.210, both within tolerance, with p = 0.0024. Under reading a, LC is 0.1966, just below the tolerance bound of 0.198. The grid search of reading b covers only C from 1e-3 to 1 and its fits hit max_iter; with a single cross-validation seed the outcome is fragile (problem 3).
    • fig3d-npx-areas-inference: the verifier’s outcome was “Reproduced”. Reproduced per the criterion: five areas are significant and the three largest mean scores are V1, LM and AL. But the significant set is V1, LM, RL, AL and AM; PM is not (p = 0.092), while AM is (p = 0.0029), the reverse of the paper. Decoder reading a only; reading b could change it (problem 2). The criterion counts significant areas without naming them (problem 8).
    • ed7b-npx-xre-inference: the verifier’s outcome was “Reproduced”. All 6 areas are above 0.5, with p from 0.0005 to 0.0137, close to the paper's values. The chance level of 0.5 matches.
    • ed7a-npx-no-area-above-v1: the verifier’s outcome was “Reproduced”. Under both readings, every significant V1-versus-HVA difference has the HVA lower. Kruskal-Wallis p-values are 0.0006, 0.0071, 0.0005 and 0.0077, all significant like the paper's.
    • ed6ef-npx-ic-not-greater: the verifier’s outcome was “Reproduced”. No area gives p < 0.05 in either panel. Eleven of the 12 p-values equal the paper's to 4 decimals.
  • Round 2
    2026-10-28
    Agreed with 39 of 40 outcomes. Independent agent run by CatalystNeuro (same harness, separate context, did not write the notebook). Reviewed: Round 2. The full executed notebooks with the conclusions and summaries, the helper module, the claims file, the paper and this record, after the round-1 revision.
    • fig2d-npx-ccg-hva-input: the verifier’s outcome was “Blocked”. The criterion requires a higher median "under every combination". With boxcar smoothing, raw flank and number of connections, the medians are 1 and 1, so that combination fails the rule. The direction of the rank-sum test is not a median comparison. The protocol rule cited for the tie-break was not available to the verifier. The substance supports the claim (P = 0.63, p = 9.8e-05, 68% against 50% of units with any connection). The outcome rests on that tie-break, but the record does not mark it assumed; it is only listed as a deviation. Still judged blocked (methods_underspecified).
  • Round 3
    2026-10-28
    Agreed with 2 of 2 outcomes. Independent agent run by CatalystNeuro (same harness, separate context, did not write the notebook). Reviewed: Round 3. The two proposed changes of outcome (fig2d to blocked, fig3d to reproduced) and the analysis behind them in the executed notebooks after the round-2 revision (reproduce cells 51 and 53, decoding cells 14 and 15, checks cell 8, seed1 and seed2 cell 8), with the claims file and the paper. Nothing else was reviewed. Report in transcripts/000248/verifier-3-report.md.

Method differences

How the tests differed from the paper’s method or data, and the claims each applies to.

  • Assumption. Reading (b), "all units not classified as noise", is taken as every unit in the files, because the Methods say "all units not classified as noise were packaged into Neurodata Without Borders" files. The files also carry a quality column with 322 V1 units labelled noise; dropping them (b2) does not reproduce the segment responder count. The exact match of both counts under (b1) supports the assumption. Asked of the authors under findings (methods_unavailable).ed6b-npx-v1-group-counts
  • The 8 degree threshold of the Methods cannot be applied, as the files give pupil position in camera pixels with no conversion; the code's 20 pixels (criterion reading b) is used.ed2b-npx-fixed-gaze
  • Assumption. The criterion and the Extended Data Fig. 2 legend require that fixed-gaze RF trials cover all 9 positions ("at least one trial in each position") without saying whether inverse trials count. Rule (r), any RF trial, is adopted, as neither text restricts the trials to standard patches; it gives the paper's 9 sessions, where standard trials only give 8. A valid session with no fixed-gaze standard trial at a position gets p = 1 there. Asked of the authors under findings (methods_unavailable).ed2b-npx-fixed-gaze
  • The shuffle 95th percentile of 1,000 permutations is the criterion's standard choice for the null of the match.ed2b-npx-fixed-gaze
  • The paper names no test for the absence of systematic differences; the criterion's Friedman test is a reader's choice.ed2a-npx-gaze-confined
  • The per-pair normalisation by the square root of the spike counts is left out; it does not change the comparison of a pair's peak with its own flank.fig2d-npx-ccg-hva-input
  • The decoder is scikit-learn's libsvm SVM, not MATLAB's fitcecoc; reading (b) searches C from 10^-3 to 1 with one-vs-one coding in place of the code's Bayesian search. On the first outer fold of the V1 sessions, C above 1 gave a lower best inner accuracy in all 12 (by 0.005 to 0.064), from fits that partly did not converge (12 to 17 of 36 per C value), and the one-vs-all coding changed the best inner accuracy by -0.012 to 0.024 (decoding_checks_shin_2025.ipynb).fig3c-npx-v1-inference
  • Assumption. The Methods do not say how the SVM hyperparameters were set; the paper's code chooses them with OptimizeHyperparameters. Reading (b), C chosen by an inner cross-validation, is adopted as the reading closer to the code. It searches C from 10^-3 to 1 with one-vs-one coding. On the first outer fold of each session of V1, PM and AM, C above 1 gave a higher best inner accuracy in 1 of 35 sessions (PM, by 0.001), from fits that mostly did not converge (PM 28 to 30 and AM 30 of 33 or 36 per C value), and the one-vs-all coding changed the best inner accuracy by -0.026 to 0.027, which could change the chosen coding in some sessions; its effect on the inference scores was not computed (decoding_checks_shin_2025.ipynb). Asked of the authors under findings (methods_unavailable).fig3d-npx-areas-inference
  • Assumption. The cross-validation partition is random, and reading (b) meets the criterion with two of three seeds (the first seed gives four significant areas). The outcome follows the majority of the seeds, a rule chosen after the first seed's result and not stated in the criterion. A rule requiring every seed would give partially reproduced; averaging the per-session scores over the seeds was not computed.fig3d-npx-areas-inference
  • The decoder is scikit-learn's libsvm SVM, not MATLAB's fitcecoc.fig3d-npx-areas-inference
  • Extended Data Fig. 7c pools Neuropixels and 2p areas; its Kruskal-Wallis values are compared on the six Neuropixels areas only (criterion).ed7a-npx-no-area-above-v1
  • The quadratic kernel is (gamma <x, y> + 1)^2 and the RBF kernel uses scikit-learn's gamma "scale"; the paper gives no kernel parameters (assumption, stated in the helper).supp3-decoder-types
  • Supplementary Fig. 3 was not read; the test on the Neuropixels areas V1, LM and AL is the criterion's reading.supp3-decoder-types

Provenance

Attempt record
000248-shin-2025-01
Paper
10.1038/s41593-025-02055-5
Date
2026-10-28
Made by
An agent, run by CatalystNeuro
Dataset
DANDI:000248
Version
0.240502.2344 (doi:10.48324/dandi.000248/0.240502.2344)
Run on
GitHub Actions
Harness
Claude Code
Model
claude-opus-5-5
Protocol
pilot-12

Transcripts of the agent runs

Each run’s prompt, messages and tool calls, with long output cut and the text of the paper left out, and its final report.