Method Article

Machine Learning-assisted Raman Spectral Analysis of Serotonin-responsive ssDNA-SWCNT Nanosensor for Improved Selectivity against Dopamine

DOI:

10.3791/69925

May 15th, 2026

In This Article

Summary

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The protocol describes Raman spectral analysis of ssDNA-wrapped SWCNT nanosensor, enabling the improved selective measurement of serotonin against dopamine with the assistance of a machine learning model.

Abstract

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Serotonin (5-hydroxytryptamine, 5-HT) plays critical roles in neuromodulation, yet current detection methods struggle to provide real-time sensing of 5-HT with high sensitivity and selectivity. We previously developed a near-infrared serotonin nanosensor (nIRHT), which consists of ssDNA-wrapped single-walled carbon nanotube that sensitively detects 5-HT. However, nIRHT’s fluorescence response cannot discriminate between 5HT and dopamine (DA), limiting its practical applications. In this study, Raman spectroscopy combined with machine learning overcomes this selectivity challenge. G-band spectral features revealed distinct signatures for 5HT versus DA binding to nIRHT, with DA causing greater G-band suppression. We employed differential Raman (ΔRaman) to isolate analyte-specific spectral changes and trained three machine learning models for classification. The random forest model with ΔRaman achieved optimal performance with 95.8% accuracy, significantly outperforming models using raw Raman spectra. This approach showed improved specificity, with negligible responses to acetylcholine, GABA, and glutamate, and achieved a detection limit of 0.1 µM suitable for physiological applications. This Raman-based approach transforms the non-selective nIRHT fluorescence sensor into a platform capable of robust neurotransmitter discrimination, overcoming selectivity issues in single-walled carbon nanotube (SWCNT)-based molecular sensing.

Introduction

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Serotonin (5-hydroxytryptamine, 5-HT) is a critical neurotransmitter regulating mood, cognition, sleep, and appetite, with dysfunction implicated in depression, anxiety, and other neuropsychiatric disorders1. Real-time monitoring of serotonin dynamics in biological systems remains challenging due to the millisecond timescale of synaptic transmission and the complex chemical environment of neural tissue2. Despite significant advances in neurotransmitter detection technologies, achieving both high sensitivity and molecular selectivity for serotonin continues to pose substantial analytical challenges.

Current serotonin detection methods span from traditional analytical techniques to emerging nanosensor platforms. High-performance liquid chromatography with electrochemical detection (HPLC-ED) remains the gold standard, achieving detection limits of 0.056 nM with excellent reproducibility3. However, HPLC requires extensive sample preparation and 15-30 min analysis times, precluding real-time monitoring4. Fast-scan cyclic voltammetry (FSCV) enables subsecond temporal resolution at carbon fiber microelectrodes but suffers from electrode fouling and limited selectivity between structurally similar neurotransmitters5,6. Recent developments in genetically encoded fluorescent sensors, including iSeroSnFR7 and GRAB-5HT8, achieve remarkable sensitivity and dynamic range but require genetic modification of target tissues, thereby limiting clinical translation.

Single-walled carbon nanotube (SWCNT) optical sensors have emerged as promising platforms for label-free neurotransmitter detection9. DNA-functionalized SWCNTs exhibit near-infrared (nIR) fluorescence modulation upon analyte binding, enabling detection in the tissue-transparent window (900-1400 nm)10,11. Landry's group developed the nIRHT sensor through systematic evolution of ligands by exponential enrichment (SELEC), screening ~1010 unique ssDNA sequences to identify serotonin-responsive constructs12. This sensor achieves micromolar sensitivity with 200% fluorescence enhancement upon serotonin binding, operating independently of dopamine or serotonin oxidation. To rule out oxidative interference, our previous study confirmed the stability of these neurotransmitter solutions; UV-Vis and NMR analyses revealed no oxidative changes or new peak formations compared to pure 5HT12. Furthermore, the short incubation time and neutral pH conditions used in the system are designed to prevent significant quinone formation. Similarly, the Strano group pioneered corona phase molecular recognition (CoPhMoRe), demonstrating that (GT)₁₅-wrapped SWCNTs detect dopamine at 11 nM concentrations13. Our group recently advanced this field through machine learning-guided optimization, achieving 2.5-fold sensitivity improvements using high-throughput screening of systematically mutated sequences14.

Despite these advances, a fundamental limitation persists in the insufficient selectivity between serotonin and dopamine. Both neurotransmitters contain aromatic rings and ethylamine chains, differing by only a single hydroxyl group15. Current fluorescence-based SWCNT sensors typically achieve selectivity ratios below 5:1, inadequate for distinguishing co-released neurotransmitters in synaptic environments16. This selectivity challenge is particularly critical given that serotonin and dopamine often colocalize in brain regions governing reward and motivation17.

Raman spectroscopy offers complementary chemical information through vibrational mode analysis of the SWCNT-analyte complex18. The G-band (~1580 cm⁻1) of SWCNTs splits into G⁺ and G⁻ components, with frequencies sensitive to molecular adsorption and electronic doping19. A previous study demonstrated that non-covalent surfactants on SWCNT induce distinct Raman spectral changes in the G-band region20.

In this work, we demonstrate machine learning-assisted Raman spectral analysis of the nIRHT sensor to achieve enhanced selectivity between serotonin and dopamine. We systematically characterized concentration-dependent Raman responses from 0.01 to 100 µM, revealing distinct spectral fingerprints for each neurotransmitter. Three machine learning models—convolutional neural network (CNN), support vector machine (SVM), and random forest (RF) were trained on spectral datasets to classify analyte identity. Critically, we introduce differential Raman processing, which removes baseline signals to isolate analyte-specific features. The optimized RF model with DR processing achieves 95.8% classification accuracy, representing a significant advance in molecular discrimination. This multimodal approach combining nIR fluorescence sensitivity with Raman chemical specificity provides a pathway toward real-time, selective serotonin monitoring in complex biological environments.

Access restricted. Please log in or start a trial to view this content.

Protocol

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

1. ssDNA-functionalized SWCNT nIRHT nanosensor fabrication

  1. Combine 1 mg of single-walled carbon nanotubes (SWCNTs), 100 µL of 1 mM E6#9 ssDNA, and 900 µL of 1x phosphate-buffered saline (PBS) in a 1.5 mL tube.
    CAUTION: Dry SWCNT powder is a potential inhalation hazard. Handle the powder inside a certified chemical fume hood and wear appropriate personal protective equipment, including a mask and gloves.
  2. Disperse the mixture using a bath sonicator for 5 min. Sonicate the mixture using a tip sonicator equipped with a 3 mm probe at 50% amplitude for 30 min in an ice bath.
  3. Centrifuge the sonicated solution at 21,500 x g for 1 h to precipitate non-dispersed SWCNTs. Carefully collect 850 µL of the supernatant and transfer it to a new tube.
  4. Measure the absorbance of the collected SWCNT suspension at a wavelength of 632 nm. Calculate the concentration using the SWCNT extinction coefficient of 0.036 (mg/L)⁻1 cm⁻1. Store the final nIRHT sensor solution at 4 °C until further use.

2. Raman spectra measurement

  1. Load 90 µL of the 10 mg/L nIRHT dispersion into a 96-well plate. Measure the Raman spectrum of the sensor in a PBS buffer using a 532 nm laser excitation source. Set this recorded spectrum as the baseline.
    CAUTION: It is crucial to strictly maintain the laser power at 10 mW and wavelength at 532nm when investigating live biological samples. Higher laser powers can induce severe phototoxicity and compromise cell viability. The 532 nm laser at 10 mW utilized in this protocol has been well-established as safe and non-destructive for live-cell analysis, preserving sensitive organelles21 and the electrophysiological activity of primary neurons22 while ensuring robust Raman signal acquisition.
  2. Spike each 90 µL sensor solution (10mg/L) with 10 µL of the analyte solution to reach final concentrations of 0.01, 0.1, 1, 5, 10, 50, and 100 µM. Wait for 5 min after the analyte addition to allow for sufficient incubation.
  3. Measure the Raman spectra of the incubated samples. Prepare samples in triplicate for each concentration and repeat steps 2.1 to 2.2 to ensure reproducibility.

3. Machine learning-based data analysis

  1. Construct the dataset from a total of 208 Raman spectra, comprising 77 dopamine (DA) responses, 76 serotonin (5HT) responses, and 47 control (PBS) group responses.
  2. Perform background subtraction on the G-band region of the spectral data. Normalize the background-subtracted data based on the G+ band peak.
  3. Apply a median filter to reduce noise in the normalized spectra. Isolate spectral changes (ΔRaman) by subtracting the normalized control spectrum from each analyte-treated spectrum.
  4. Develop a Convolutional Neural Network (CNN), a Random Forest (RF), and a Support Vector Machine (SVM) model for the ternary classification of 5HT, DA, or the control.
  5. Split the entire dataset into training, validation, and test sets using a 6:2:2 ratio.
  6. Configure the CNN architecture with three 1D convolution layers utilizing a ReLU activation function and a max pooling size of 2, followed by two fully connected layers.
  7. Configure the SVM using a Radial Basis Function (RBF) kernel for non-linear classification.
  8. Configure the RF model using default hyperparameters.
  9. Train the constructed models using 5-fold cross-validation. Calculate the average performance metrics across all 5 folds to ensure statistical robustness.
  10. Select the model that yields the highest accuracy on the validation data for the final analysis.
  11. Evaluate the selected model on the test set to verify its generalization capability.
  12. Determine the indirect limit of detection (LOD) by sequentially excluding data from the training set that falls below a concentration threshold of 0.1 µM.
  13. Test the trained model on the entire concentration range, including concentrations below the criteria, to establish the final LOD.

Access restricted. Please log in or start a trial to view this content.

Results

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The E6#9 ssDNA-functionalized SWCNT nanosensor (nIRHT), previously developed through SELEC methodology, demonstrates reversible nIR fluorescence enhancement upon 5HT binding, enabling real-time 5HT imaging in vitro and ex vivo12. The E6#9 sequence (5'-CCCCCCAGCACCAGACAGCACACTCCCCCC-3') wraps around SWCNTs to create binding sites for 5HT. However, this sensor lacks specificity: both 5-HT and DA result in comparable intensity increase (Figure 1B), limi...

Access restricted. Please log in or start a trial to view this content.

Discussion

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Raman spectroscopic analysis provided a significant enhancement in the specificity of the nIRHT sensor, a capability not achievable with its conventional fluorescence response. We observed that DA induced a more pronounced suppression of the G⁻ band (1570 cm-1) compared to 5HT. These differential signatures likely arise from varying molecular orientations and binding geometries on the SWCNT surface. Specifically, DA's catechol moiety likely forms stronger π-π interactions with the SWCNT sur...

Access restricted. Please log in or start a trial to view this content.

Disclosures

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The authors have nothing to disclose.

Acknowledgements

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This work was supported by a 2-Year Research Grant from Pusan National University.

Access restricted. Please log in or start a trial to view this content.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
HiPCo raw Nanointegris
iDus1.7 InGaAsANDORDU490A-1,9
RamantouchNano Photon
Vibra Cell 130SONICS

References

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,
  1. Berger, M., Gray, J. A., Roth, B. L. The expanded biology of serotonin. Annu Rev Med. 60, 355-366 (2009).
  2. Dankoski, E. C., Wightman, R. M. Monitoring serotonin signaling on a subsecond time scale. Front Integr Neurosci. 7, 44(2013).
  3. Zhang, X., et al. Highly sensitive assay for serotonin in microdialysates using capillary HPLC with electrochemical detection. J Chromatogr B. 844, 112-118 (2006).
  4. Huang, F., et al. Simultaneous quantification of seven hippocampal neurotransmitters in depression mice by LC–MS/MS. J Neurosci Meth. 229, 8-14 (2014).
  5. Saylor, A., et al. In vivo hippocampal serotonin dynamics in male and female mice: Determining effects of acute escitalopram using fast scan cyclic voltammetry. Front Neurosci. 13, 362(2019).
  6. Mendoza, A., Asrat, T., Liu, F., Wonnenberg, P., Zestos, A. G. Carbon Nanotube Farm Microelectrodes Promote High Temporal Measurements of Serotonin Using Fast Scan Cyclic Voltammetry. Sensors. 20, 1173(2020).
  7. Unger, E. K., et al. Directed evolution of a selective and sensitive serotonin sensor via machine learning. Cell. 183, 1986-2002 (2020).
  8. Wan, J., et al. A genetically encoded sensor for measuring serotonin dynamics. Nat Neurosci. 24, 746-752 (2021).
  9. Kruss, S., et al. Neurotransmitter detection using corona phase molecular recognition on fluorescent single-walled carbon nanotube sensors. J Am Chem Soc. 136, 713-724 (2014).
  10. Gong, H., Peng, R., Liu, Z. Carbon nanotubes for biomedical imaging: The recent advances. Adv Drug Deliv Rev. 65, 1951-1963 (2013).
  11. Yaari, Z., et al. Carbon Nanotubes in Biomedicine: Properties, Methods, and Instrumentation. Handbook Carbon Nanomater. 11, 1-62 (2024).
  12. Jeong, S., et al. High-throughput evolution of near-infrared serotonin nanosensors. Sci Adv. 5, eaay3771(2019).
  13. Zhang, J., et al. Molecular recognition using corona phase complexes made of synthetic polymers adsorbed on carbon nanotubes. Nat Nanotechnol. 8, 959-968 (2013).
  14. Lee, D., et al. Systematic selection of high-affinity ssDNA sequences to carbon nanotubes. Adv Sci. 11, 2308915(2024).
  15. Manciu, F. S., et al. Simultaneous Detection of Dopamine and Serotonin—A Comparative Experimental and Theoretical Study of Neurotransmitter Interactions. Biosensors. 9, 3(2019).
  16. An, S., et al. Directed Evolution of Near-Infrared Serotonin Nanosensors with Machine Learning-Based Screening. Nanomaterials. 14 (3), 247(2024).
  17. Boi, L., et al. Serotonergic and dopaminergic neurons in the dorsal raphe are differentially altered in a mouse model for parkinsonism. eLife. 12, RP90278(2024).
  18. Dresselhaus, M. S., et al. Raman spectroscopy of carbon nanotubes. Phys Rep. 409, 47-99 (2005).
  19. Jorio, A., et al. G-band resonant Raman study of 62 isolated single-wall carbon nanotubes. Phys Rev B. 65, 155412(2002).
  20. Moore, V. C., et al. Individually suspended single-walled carbon nanotubes in various surfactants. Nano Lett. 3, 1379-1382 (2003).
  21. Pieczara, A., Arellano Reyes, R. A., Keyes, T. E., Dawiec, P., Baranska, M. New highly sensitive and specific Raman probe for live cell imaging of mitochondrial function. ACS Sens. 9 (2), 995-1003 (2024).
  22. Tentellino, C., et al. Electrode- and label-free assessment of electrophysiological firing rates through cytochrome c monitoring via Raman spectroscopy. ACS Sens. 10 (2), 1228-1236 (2025).
  23. Jorio, A., et al. Raman spectroscopy of carbon nanotubes. Phys Rep. 409, 47-87 (2005).
  24. Gravely, M., et al. Aggregation Reduces Subcellular Localization and Cytotoxicity of Single-Walled Carbon Nanotubes. ACS Appl Mater Interfaces. 14, 19168-19177 (2022).
  25. Miyaura, K., et al. Extended-conjugation ?-electron systems in carbon nanotubes. Sci Rep. 8, 8098(2018).
  26. Krasley, A. T., Chakraborty, S., Vuković, L., Beyene, A. G. Molecular Determinants of Optical Modulation in ssDNA–Carbon Nanotube Biosensors. ACS Nano. 19 (8), 7804-7820 (2025).
  27. Chakraborty, S., Krasley, A. T., Smith, C. H., Beyene, A. G., Vuković, L. Machine Learning Prediction of Analyte-Induced Fluorescence Perturbations in DNA-Functionalized Carbon Nanotubes. Nano Lett. 26 (2), 787-794 (2026).
  28. Gianni, M., Pasqualetti, M. Wiring and volume transmission: An overview of the dual modality for serotonin neurotransmission. ACS Chem Neurosci. 14 (23), 4030-4040 (2023).
  29. Mayer, S., Saxena, P., Crayen, M. A., Treue, S. Establishing in vivo brain microdialysis for comparing concentrations of a variety of cortical neurotransmitters in the awake rhesus macaque between different cognitive states. J Neurosci Meth. 415, 110361(2025).
  30. Bunin, M. A., Wightman, R. M. Quantitative Evaluation of 5-Hydroxytryptamine (Serotonin) Neuronal Release and Uptake: An Investigation of Extrasynaptic Transmission. J Neurosci. 18, 4854-4860 (1998).

Access restricted. Please log in or start a trial to view this content.

Reprints and Permissions

Request permission to reuse the text or figures of this JoVE article

Request Permission

Tags

Raman Spectral AnalysisMachine LearningSerotonin NanosensorDopamine SelectivitySingle Walled Carbon NanotubessDNA SWCNTNeurotransmitter DiscriminationRandom Forest ModelG Band SpectroscopyMolecular Sensing

Related Articles