The BIDS Toolbox: A web service to manage brain imaging datasets
Pith reviewed 2026-05-25 16:46 UTC · model grok-4.3
The pith
The BIDS Toolbox is a web service for creating and modifying BIDS-compliant MRI datasets via web interface and REST endpoints.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The BIDS Toolbox allows the creation and modification of BIDS-compliant datasets based on MRI data. It provides both a web interface and REST endpoints for its use, unlike other tools.
What carries the argument
The BIDS Toolbox web service, which manages brain imaging datasets in BIDS format through creation and modification features.
If this is right
- Users can create BIDS-compliant datasets from MRI data more straightforwardly.
- The service supports both interactive web use and programmatic access via REST.
- Early prototype is available with public source code.
- BIDS datasets can be managed in a way that promotes data sharing.
Where Pith is reading between the lines
- Integration with existing MRI analysis pipelines could further boost usability.
- Wider adoption might improve reproducibility across studies if the tool proves effective.
- Future versions could extend support to other imaging modalities beyond MRI.
Load-bearing premise
Low adoption of BIDS stems mainly from the absence of a primary tool for creating and managing such datasets.
What would settle it
A survey or usage analysis showing that BIDS adoption remains low even after the release and promotion of the BIDS Toolbox would challenge the premise.
Figures
read the original abstract
Data sharing is a key factor for ensuring reproducibility and transparency of scientific experiments, and neuroimaging is no exception. The vast heterogeneity of data formats and imaging modalities utilised in the field makes it a very challenging problem. In this context, the Brain Imaging Data Structure (BIDS) appears as a solution for organising and describing neuroimaging datasets. Since its publication in 2015, BIDS has gained widespread attention in the field, as it provides a common way to arrange and share multimodal brain images. Although the evident benefits it presents, BIDS has not been widely adopted in the field of MRI yet and we believe that this is due to the lack of a go-to tool to create and managed BIDS datasets. Motivated by this, we present the BIDS Toolbox, a web service to manage brain imaging datasets in BIDS format. Different from other tools, the BIDS Toolbox allows the creation and modification of BIDS-compliant datasets based on MRI data. It provides both a web interface and REST endpoints for its use. In this paper we describe its design and early prototype, and provide a link to the public source code repository.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript describes the BIDS Toolbox, a web service for creating and modifying BIDS-compliant MRI datasets. It provides both a web interface and REST endpoints, positions itself as addressing a gap in BIDS adoption tools, and reports the design of an early prototype along with a link to the public source code repository.
Significance. If the described functionality is accurate, the tool could lower barriers to BIDS dataset management in neuroimaging. The public availability of the source code is a clear strength for a software-description paper, as it permits direct inspection, reuse, and community validation of the implementation.
major comments (2)
- [Abstract] Abstract: the claim that the BIDS Toolbox 'differs from other tools' by enabling creation and modification of BIDS datasets is stated without any reference to or comparison against existing BIDS-related software, leaving the distinctiveness of the contribution unsupported.
- [Abstract] Abstract and manuscript body: no evaluation, usage examples, error-handling details, or BIDS-compliance verification steps are described for the early prototype, which weakens assessment of the central claim that the service is usable for dataset management.
minor comments (1)
- [Abstract] Abstract: grammatical issues include 'Although the evident benefits it presents' (should read 'Despite the evident benefits' or similar) and 'create and managed' (should be 'create and manage').
Simulated Author's Rebuttal
We thank the referee for the positive summary and recommendation for minor revision. We address each major comment below and indicate where revisions will be made to the manuscript.
read point-by-point responses
-
Referee: [Abstract] Abstract: the claim that the BIDS Toolbox 'differs from other tools' by enabling creation and modification of BIDS datasets is stated without any reference to or comparison against existing BIDS-related software, leaving the distinctiveness of the contribution unsupported.
Authors: We agree that the distinctiveness claim in the abstract would be strengthened by explicit references to existing BIDS tools. In the revised manuscript we will add a short comparison (with citations) to tools such as dcm2bids, BIDScoin, and the official BIDS validator, clarifying that the BIDS Toolbox is distinguished by its focus on web-based creation and in-place modification via both a GUI and REST API. This addition will be limited to the abstract and a brief paragraph in the introduction. revision: yes
-
Referee: [Abstract] Abstract and manuscript body: no evaluation, usage examples, error-handling details, or BIDS-compliance verification steps are described for the early prototype, which weakens assessment of the central claim that the service is usable for dataset management.
Authors: The manuscript is explicitly framed as describing the design and an early prototype; therefore a full user evaluation was not performed. We will nevertheless add a new subsection with concrete usage examples (including sample API calls and web-interface workflows) and a description of the current error-handling approach and BIDS-compliance checks implemented in the prototype. Because the source code is already public, readers can inspect and test these aspects directly. A comprehensive usability study remains outside the scope of this software-description paper. revision: partial
Circularity Check
No significant circularity
full rationale
This manuscript is a software description paper presenting the design of the BIDS Toolbox prototype and a link to its public source code. It contains no derivations, equations, fitted parameters, predictions, or first-principles results of any kind. The central claim (that the tool enables creation and modification of BIDS-compliant MRI datasets via web and REST interfaces) is supported directly by the prototype implementation itself, with no load-bearing steps that reduce to self-citation chains, ansatzes, or renamings. The motivational premise about BIDS adoption is not required for the functionality claim and does not participate in any derivation. The work is therefore self-contained against external benchmarks such as shipped code.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
The wu-minn human connectome project: An overview,
D. V . Essen, S. Smith, D. Barch et al., “The wu-minn human connectome project: An overview,” NeuroImage, vol. 80, pp. 62–79, 2013
work page 2013
-
[2]
The uk biobank resource with deep phenotyping and genomic data,
C. Bycroft, C. Freeman, D. Petkova et al. , “The uk biobank resource with deep phenotyping and genomic data,” Nature, vol. 562, pp. 203– 209, 2018
work page 2018
-
[3]
Multi-scale and multi-modal assessment of coupling in the healthy and diseased brain,
Cardiff University Brain Research Imaging Centre (CUBRIC), “Multi-scale and multi-modal assessment of coupling in the healthy and diseased brain,” 2019. [Online]. Available: https://www.cardiff.ac. uk/cardiff-university-brain-research-imaging-centre/research/projects/ multi-scale-and-multi-modal-assessment-of-coupling-in-the-healthy-and-diseased-brain
work page 2019
-
[4]
K. J. Gorgolewski, T. Auer, V . D. Calhoun, R. C. Craddock, S. Das, E. P. Duff, G. Flandin, S. S. Ghosh, T. Glatard, Y . O. Halchenko et al., “The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments,” Scientific Data, vol. 3, p. 160044, 2016
work page 2016
-
[5]
Meg-bids, the brain imaging data structure extended to magnetoencephalography,
G. Niso, K. Gorgolewski, E. Bock et al., “Meg-bids, the brain imaging data structure extended to magnetoencephalography,” Scientific Data , vol. 5, p. 180110, 2018
work page 2018
-
[6]
C. Pernet, S. Appelhoff, G. Flandin et al. , “Bids-eeg: an extension to the brain imaging data structure (bids) specification for electroencephalography,” PsyArxiv, 2019. [Online]. Available: https://psyarxiv.com/63a4y/
work page 2019
-
[7]
The first step for neuroimaging data analysis: Dicom to nifti conversion,
X. Li, P. S. Morgan, J. Ashburner, J. Smith, and C. Rorden, “The first step for neuroimaging data analysis: Dicom to nifti conversion,” Journal of Neuroscience Methods , vol. 264, pp. 47 – 56, 2016
work page 2016
-
[8]
J. Samper-Gonz ´alez, N. Burgos, S. Bottani, S. Fontanella, P. Lu, A. Mar- coux, A. Routier, J. Guillon, M. Bacci, J. Wen, A. Bertrand, H. Bertin, M.-O. Habert, S. Durrleman, T. Evgeniou, and O. Colliot, “Reproducible evaluation of classification methods in alzheimer’s disease: Framework and application to mri and pet data,” NeuroImage, vol. 183, pp. 504 –...
work page 2018
-
[9]
D. S. Marcus, T. R. Olsen, M. Ramaratnam, and R. L. Buckner, “The extensible neuroimaging archive toolkit: an informatics platform for managing, exploring, and sharing neuroimaging data,”Neuroinformatics, vol. 5, no. 1, pp. 11 – 33, Mar 2007. [Online]. Available: https://doi.org/10.1385/NI:5:1:11
-
[10]
S. Das, A. Zijdenbos, D. Vins, J. Harlap, and A. Evans, “LORIS: a web-based data management system for multi-center studies,” Frontiers in Neuroinformatics, vol. 5, p. 37, 2012. [Online]. Available: https://www.frontiersin.org/article/10.3389/fninf.2011.00037
-
[11]
Data from lgg-1p19qdeletion. The Cancer Imaging Archive
B. Erickson, Z. Akkus, J. Sedlarand, and P. Korfiatis, “Data from lgg-1p19qdeletion. The Cancer Imaging Archive.”
-
[12]
Available: https://wiki.cancerimagingarchive.net/display/ Public/LGG-1p19qDeletion
[Online]. Available: https://wiki.cancerimagingarchive.net/display/ Public/LGG-1p19qDeletion
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.