Name: Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack (Video) | JoVE Journal
Uploaded: 2020-05-15T12:30:00.000+00:00
Duration: 7 min 31 s
Description: Learn to implement a real-time psychosis risk detection system using CogStack and electronic health records. This computational method enables automatic risk identification and clinical alerting to improve patient outcomes.

ai_agent_IP

ai_agent

maintenance

instantTrialDurationMinutes

isBiopharma

enableNewMyJoveSectionDesign

educationFeatures

seoMetaApi

ai_copilot_institution_blacklist

ai_chat_institution_blacklist

freeAccessWindow

ssoRoleCapture

scheduledMaintenanceBanner

joveLabsFeatures

disable_autoplay_for_bots

extended_trial_duration

5 minutes

This study is funded by and is a direct output of the King&#39;s College London Confidence in Concept award from the Medical Research Council (MRC) (MC_PC_16048) to PFP. RD and AR were supported by: (a) the Maudsley Charity; (b) the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King&#39;s College London; (c) Health Data Research UK, which is funded by the UK Medical Research Council, Engineering and Physical Sciences Research Council, Economic and Social Research Council, Department of Health and Social Care (England), Chief Scientist Office of the Scottish Government Health and Social Care Directorates, Health and Social Care Research and Development Division (Welsh Government), Public Health Agency (Northern Ireland), British Heart Foundation and Wellcome Trust; (d) The BigData@Heart Consortium, funded by the Innovative Medicines Initiative-2 Joint Undertaking under grant agreement No. 116074. This Joint Undertaking receives support from the European Union&#39;s Horizon 2020 research and innovation programme and EFPIA; it is chaired, by DE Grobbee and SD Anker, partnering with 20 academic and industry partners and ESC; and (e) The National Institute for Health Research University College London Hospitals Biomedical Research Centre. These funding bodies had no role in the design of the study, collection and analyses. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.

This study was approved by East of England - Cambridgeshire and Hertfordshire Research Ethics Committee (Reference number: 18/EE/0066).
NOTE: We have developed this protocol based on the CogStack platform and the Python programming language. This system requires Docker (more specifically, Docker Compose <a href="https://docs.docker.com/compose/" target="_blank">https://docs.docker.com/compose/</a>), Anaconda Python (<a href="https://www.anaconda.com/distribution/" target="_blank">https://www.anaconda.com/distribution/</a>) and Git (<a href="https://git-scm.com/downloads" target="_blank">https://git-scm.com/downloads</a>) pre-installed on a device. The commands provided in this protocol are based on the Linux environment. In the following, we provide the details of preparing source data from an EHR database, ingesting the data to CogStack platform, and setting up a real-time risk calculation and alerting system for psychosis based on the CogStack platform. Moreover, an online version of the risk calculator was developed to facilitate numeric calculation of the probability of an individual developing psychosis in secondary mental health care on <a href="http://www.psychosis-risk.net/" target="_blank">http://www.psychosis-risk.net</a>.
1. Source data preparation
NOTE: In most use cases, CogStack ingests source data from a specified database view that can combine data from one or more source database tables, where a view is a searchable object in a database that contains the result set of a stored query on the data. The setup of the ingesting view is tailored by the specific use cases and deployment settings of a health record database system. This protocol is developed based on a psychosis risk calculator developed and externally validated twice by Fusar-Poli et al.14,21 and as part of a pilot implementation feasibility study6. The protocol is based on an EHR database deployed with Microsoft SQL Server 2014.
<ol>
	<li>Create a view object (called &#34;vwPsychosisBase&#34; in this protocol) in an existing EHR database system to join necessary information of patients for psychosis risk calculation and alerting. Make sure that this view includes all patients receiving a first primary diagnosis of non-organic and non-psychotic mental disorder (recorded by the International Statistical Classification of Diseases and Related Health Problems, Tenth Revision [ICD-10]), as defined in the original model14,21.</li>
	<li>Ensure that each record in the view involves three types of patient information: 1) the first primary diagnosis of a patient in the EHR system, including ICD-10 diagnosis index (diagnoses were clustered together into the following ten clusters: acute and transient psychotic disorders, anxiety disorders, bipolar mood disorders, childhood and adolescent onset disorders, developmental disorders, nonbipolar mood disorders, mental retardation, personality disorders, physiological syndromes, substance use disorders) and diagnosis date; 2) a patient&#39;s demographic data, including gender, ethnicity and date of birth; and 3) the most recent contact information of care team for a patient, such as details of general practice (GP), consultants and care coordinators. The first two types of information are vital for the psychosis risk calculator14,21, and the third type of information is to enable timely risk alerting.</li>
	<li>Make sure that each record in the view has a unique identifier (e.g., &#34;patient_id&#34; used in this protocol).</li>
	<li>Select the last update timestamps of all source information related to a record in the view (e.g., the last update times of a patient&#39;s demographic information and the patient&#39;s first primary diagnosis information), and choose the latest timestamp as the last update date and time for the record in the view (denoted as &#34;etl_updated_dttm&#34; in this protocol). The last update date and time of a record allows CogStack to synchronize updates in the database, such as new and updated records.</li>
</ol>
2. Data ingestion
<ol>
	<li>Download or clone the code repository from Github (<a href="https://github.com/cogstack-slam/psychosis" target="_blank">https://github.com/cogstack-slam/psychosis</a>) or by typing &#34;git clone <a href="https://github.com/cogstack-slam/psychosis.git" target="_blank">https://github.com/cogstack-slam/psychosis.git</a>&#34; in a terminal window. The downloaded folder contains the code for psychosis risk calculation and configuration files for deploying a CogStack instance.</li>
	<li>Go to the &#34;cogstack_deploy/cogstack/&#34; directory and modify &#34;psychosis.properties&#34; to configure CogStack Pipeline for data ingestion. Modify the settings of section &#34;SOURCE: DB CONFIGURATIONS&#34; based on the EHR database setup, including specifying the IP address of the database server, database name, database username and password. Modify the view name (i.e. &#34;vwPsychosisBase&#34;) and field names (e.g., &#34;patient_id&#34; and &#34;etl_updated_dttm&#34;) if necessary. In case of error in configuring this file, follow the instructions at <a href="https://cogstack.atlassian.net/wiki/spaces/COGDOC/pages/38043684/Quickstart" target="_blank">https://cogstack.atlassian.net/wiki/spaces/COGDOC/pages/38043684/Quickstart</a>.</li>
	<li>Go to the &#34;cogstack_deploy/common/elasticsearch/config/&#34; directory and modify the section &#34;xpack.notification.email.account&#34; in the &#34;elasticsearch.yml&#34; file to configure an Email address for sending alerts. A detailed instruction for Email configuration can be found on <a href="https://www.elastic.co/guide/en/kibana/6.4/watcher-create-threshold-alert.html" target="_blank">https://www.elastic.co/guide/en/kibana/6.4/watcher-create-threshold-alert.html</a>.</li>
	<li>Go to the &#34;cogstack_deploy/&#34; directory and type &#34;docker-compose up&#34; to run the CogStack platform. Execute this command with root access. If the process is completed successfully, there will be printed status logs of the currently running services, including CogStack Pipeline, Elasticsearch and Kibana, in the terminal. As a result, all data and updates in the source database view will be timely ingested to an Elasticsearch index called &#34;psychosis_base&#34; in the CogStack platform.</li>
	<li>Open a web browser and access Kibana user interface by typing &#34;http://localhost:5601/&#34; (or replacing &#34;localhost&#34; with a specific IP address of the server running the CogStack platform). For the first time accessing Kibana, click the Management tab and Index Patterns tab to specify an Elasticsearch index that one wants to access with Kinaba. Type &#34;psychosis_base&#34; in the &#34;Index pattern&#34; field and click Next step. Select &#34;etl_updated_dttm&#34; for the &#34;Time Filter&#34; field name and click Create index pattern to add the &#34;psychosis_base&#34; index pattern for Kinana.</li>
	<li>Once Kibana is connected to the Elasticsearch index (i.e., &#34;psychosis_base&#34;), search and browse the source data interactively through the &#34;Discover&#34; page. Kibana allows non-technical users to search for both structured metadata and free text. Detailed instructions of using &#34;Discover&#34; are available on <a href="https://www.elastic.co/guide/en/kibana/6.4/discover.html" target="_blank">https://www.elastic.co/guide/en/kibana/6.4/discover.html</a>.</li>
</ol>
3. Risk calculation
<ol>
	<li>Open a new terminal window and go to the &#34;psychosis/&#34; directory. Install all required Python packages (including &#34;elasticsearch&#34;, &#34;elasticsearch_dsl&#34;, &#34;pandas&#34; and &#34;numpy&#34;) used in the risk calculator by typing &#34;conda install package-name&#34; or &#34;pip install package-name&#34; in the terminal.</li>
	<li>Type &#34;python risk_calculator.py&#34; to run the psychosis risk calculator. If the process is completed successfully, logs of the risk calculation will be printed in the terminal and the risk results will be stored in a new Elasticsearch index called &#34;psychosis_risk&#34; within the CogStack platform.</li>
	<li>Check the risk results by using the Kibana interface. Similar to Steps 2.5 and 2.6, add a new index pattern &#34;psychosis_risk&#34; to connect Kinbana with the &#34;psychosis_risk&#34; index, and explore the risk results through the &#34;Discover&#34; page. To facilitate identifying new patients at-risk, use &#34;first_primary_diagnosis_date&#34; as the &#34;Time Filter&#34; field in building the &#34;psychosis_risk&#34; index. When exploring data in the &#34;Discover&#34; page, make sure that the index pattern &#34;psychosis_risk&#34; is selected.</li>
</ol>
4. Data visualization
<ol>
	<li>In addition to searching and accessing individual-level information via the &#34;Discover&#34; page in Kibana, one can build visualizations and dashboards to obtain an overview of characteristics for the whole population of at-risk patients. To do this, click on Visualize in the side navigation of Kibana. Then, click the Create new visualization button and choose a visualization type (e.g., pie and line charts). Select &#34;psychosis_risk&#34; as the index that one wants to visualize through Kibana. By default, visualizations will include all records/patients in the &#34;psychosis_risk&#34; index. Detailed instructions of building Kibana visualizations are available on <a href="https://www.elastic.co/guide/en/kibana/6.4/visualize.html" target="_blank">https://www.elastic.co/guide/en/kibana/6.4/visualize.html</a>.</li>
	<li>To select a specific subset of data for visualization, add a &#34;filter&#34;. For example, selecting a filter filed as &#34;h_2_year&#34;, choosing an operator as &#34;is not between&#34; and setting values from &#34;0.0&#34; to &#34;0.05&#34; will only include patients whose risk of psychosis in 2 years are higher than 0.05.</li>
	<li>Once individual visualizations are built, click on Dashboard in the side navigation of Kibana to create a dashboard that displays a set of related visualizations together. Click Create new dashboard and the Add button to create a new dashboard panel. Click visualizations that one wants to show within the new dashboard panel. Click Save and type a title to save the panel. Instructions on building Kibana dashboards are available at <a href="https://www.elastic.co/guide/en/kibana/6.4/dashboard.html" target="_blank">https://www.elastic.co/guide/en/kibana/6.4/dashboard.html</a>.</li>
</ol>
5. Risk Alerting
<ol>
	<li>Click on Management in the side navigation of Kibana and then click Watcher under Elasticsearch to create alerting for clinicians when patients were at-risk of psychosis. If the Watcher button is not visible, click License Management and click Start trial or Update license.</li>
	<li>Click Create advanced watch to set up a new Watcher. Type an &#34;ID&#34; and &#34;Name&#34;. Delete the content of &#34;Watch JSON&#34; section and copy the content in the &#34;watcher.json&#34; file in the &#34;psychosis&#34; directory to the &#34;Watch JSON&#34; section. This watcher will send alerting Email to &#34;clinician@nhs.uk&#34; (which can be replaced with the Email address where one wants to send alerts) from &#34;username@nhs.uk&#34; (which was set in Step 2.3) if there are one or more patients whose risk of psychosis in 2 years are higher than 0.05 (a tentative threshold for feasibility testing) in every 24 hours.</li>
	<li>Before saving the Watcher, click Simulate to test the Watcher execution. If the Watcher is set successfully, one will see the simulation output printed. In case of error in the settings, follow the instructions on <a href="https://www.elastic.co/guide/en/elastic-stack-overview/6.4/watcher-getting-started.html" target="_blank">https://www.elastic.co/guide/en/elastic-stack-overview/6.4/watcher-getting-started.html</a>.</li>
	<li>To stop a Watcher, permanently delete it or temporarily deactivate it from the &#34;Status&#34; page of the Watcher.</li>
</ol>

<ol><li>Lieberman, J. A., First, M. B. <a target="_blank" href="https://www.ncbi.nlm.nih.gov/pubmed/30021088">Psychotic Disorders.</a> New England Journal of Medicine. 379 (3), 270-280 (2018).</li>
<li>Oh, H., Koyanagi, A., Kelleher, I., DeVylder, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Psychotic+experiences+and+disability%3A+findings+from+the+collaborative+psychiatric+epidemiology+surveys%5BTitle%5D)+AND+%22Schizophrenia+Research%22%5BJournal%5D)">Psychotic experiences and disability: findings from the collaborative psychiatric epidemiology surveys.</a> Schizophrenia Research. 193, 343-347 (2018).</li>
<li>Tsiachristas, A., Thomas, T., Leal, J., Lennox, B. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Economic+impact+of+early+intervention+in+psychosis+services%3A+results+from+a+longitudinal+retrospective+controlled+study+in+England%5BTitle%5D)+AND+%22BMJ+Open%22%5BJournal%5D)">Economic impact of early intervention in psychosis services: results from a longitudinal retrospective controlled study in England.</a> BMJ Open. 6 (10), e012611(2016).</li>
<li>Fusar-Poli, P., McGorry, P. D., Kane, J. M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Improving+outcomes+of+first-episode+psychosis%3A+an+overview%5BTitle%5D)+AND+%22World+Psychiatry%22%5BJournal%5D)">Improving outcomes of first-episode psychosis: an overview.</a> World Psychiatry. 16 (3), 251-265 (2017).</li>
<li>Fusar-Poli, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+clinical+high-risk+state+for+psychosis+%28CHR-P%29%2C+version+II%5BTitle%5D)+AND+%22Schizophrenia+Bulletin%22%5BJournal%5D)">The clinical high-risk state for psychosis (CHR-P), version II.</a> Schizophrenia Bulletin. 43 (1), 44-47 (2017).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Real-world+Implementation+of+a+Transdiagnostic+Risk+Calculator+for+the+Automatic+Detection+of+Individuals+at-risk+of+Psychosis+in+Clinical+Routine%3A+Study+Protocol%5BTitle%5D)+AND+%22Frontiers+in+Psychiatry%22%5BJournal%5D)">Real-world Implementation of a Transdiagnostic Risk Calculator for the Automatic Detection of Individuals at-risk of Psychosis in Clinical Routine: Study Protocol.</a> Frontiers in Psychiatry. 10, 109(2019).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Disorder%2C+not+just+state+of+risk%3A+meta-analysis+of+functioning+and+quality+of+life+in+people+at+high+risk+of+psychosis%5BTitle%5D)+AND+%22British+Journal+of+Psychiatry%22%5BJournal%5D)">Disorder, not just state of risk: meta-analysis of functioning and quality of life in people at high risk of psychosis.</a> British Journal of Psychiatry. 207 (3), 198-206 (2015).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Heterogeneity+of+psychosis+risk+within+individuals+at+clinical+high+risk%3A+a+meta-analytical+stratification%5BTitle%5D)+AND+%22JAMA+Psychiatry%22%5BJournal%5D)">Heterogeneity of psychosis risk within individuals at clinical high risk: a meta-analytical stratification.</a> JAMA Psychiatry. 73 (2), 113-120 (2016).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Diagnostic+and+prognostic+significance+of+brief+limited+intermittent+psychotic+symptoms+%28BLIPS%29+in+individuals+at+ultra+high+risk%5BTitle%5D)+AND+%22Schizophrenia+Bulletin%22%5BJournal%5D)">Diagnostic and prognostic significance of brief limited intermittent psychotic symptoms (BLIPS) in individuals at ultra high risk.</a> Schizophrenia Bulletin. 43 (1), 48-56 (2016).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Prognosis+of+brief+psychotic+episodes%3A+a+meta-analysis%5BTitle%5D)+AND+%22JAMA+Psychiatry%22%5BJournal%5D)">Prognosis of brief psychotic episodes: a meta-analysis.</a> JAMA Psychiatry. 73 (3), 211-220 (2016).</li>
<li>Fusar-Poli, P., Sullivan, S., Shah, J., Uhlhaas, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Improving+the+detection+of+individuals+at+clinical+risk+for+psychosis+in+the+community%2C+primary+and+secondary+care%3A+an+integrated+evidence-based+approach%5BTitle%5D)+AND+%22Frontiers+in+Psychiatry%22%5BJournal%5D)">Improving the detection of individuals at clinical risk for psychosis in the community, primary and secondary care: an integrated evidence-based approach.</a> Frontiers in Psychiatry. 10, 774(2019).</li>
<li>Fusar-Poli, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Extending+the+benefits+of+indicated+prevention+to+improve+outcomes+of+first-episode+psychosis%5BTitle%5D)+AND+%22JAMA+Psychiatry%22%5BJournal%5D)">Extending the benefits of indicated prevention to improve outcomes of first-episode psychosis.</a> JAMA Psychiatry. 74 (7), 667-668 (2017).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Transdiagnostic+psychiatry%3A+a+systematic+review%5BTitle%5D)+AND+%22World+Psychiatry%22%5BJournal%5D)">Transdiagnostic psychiatry: a systematic review.</a> World Psychiatry. 18 (2), 192-207 (2019).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Development+and+validation+of+a+clinically+based+risk+calculator+for+the+transdiagnostic+prediction+of+psychosis%5BTitle%5D)+AND+%22JAMA+Psychiatry%22%5BJournal%5D)">Development and validation of a clinically based risk calculator for the transdiagnostic prediction of psychosis.</a> JAMA Psychiatry. , (2017).</li>
<li>Fusar-Poli, P., Hijazi, Z., Stahl, D., Steyerberg, E. W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+science+of+prognosis+in+psychiatry%3A+a+review%5BTitle%5D)+AND+%22JAMA+Psychiatry%22%5BJournal%5D)">The science of prognosis in psychiatry: a review.</a> JAMA Psychiatry. 75 (12), 1289-1297 (2018).</li>
<li>Radua, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((What+causes+psychosis%3F+An+umbrella+review+of+risk+and+protective+factors%5BTitle%5D)+AND+%22World+Psychiatry%22%5BJournal%5D)">What causes psychosis? An umbrella review of risk and protective factors.</a> World Psychiatry. , (2018).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Deconstructing+vulnerability+for+psychosis%3A+Meta-analysis+of+environmental+risk+factors+for+psychosis+in+subjects+at+ultra+high-risk%5BTitle%5D)+AND+%22European+Psychiatry%22%5BJournal%5D)">Deconstructing vulnerability for psychosis: Meta-analysis of environmental risk factors for psychosis in subjects at ultra high-risk.</a> European Psychiatry. 40, 65-75 (2017).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Clinical-learning+versus+machine-learning+for+transdiagnostic+prediction+of+psychosis+onset+in+individuals+at-risk%5BTitle%5D)+AND+%22Translational+Psychiatry%22%5BJournal%5D)">Clinical-learning versus machine-learning for transdiagnostic prediction of psychosis onset in individuals at-risk.</a> Translational Psychiatry. 9 (1), 1-11 (2019).</li>
<li>Stewart, R., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+South+London+and+Maudsley+NHS+foundation+trust+biomedical+research+centre+%28SLAM+BRC%29+case+register%3A+development+and+descriptive+data%5BTitle%5D)+AND+%22BMC+Psychiatry%22%5BJournal%5D)">The South London and Maudsley NHS foundation trust biomedical research centre (SLAM BRC) case register: development and descriptive data.</a> BMC Psychiatry. 9 (1), 51(2009).</li>
<li>Jongsma, H. E., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Treated+incidence+of+psychotic+disorders+in+the+multinational+EU-GEI+study%5BTitle%5D)+AND+%22JAMA+Psychiatry%22%5BJournal%5D)">Treated incidence of psychotic disorders in the multinational EU-GEI study.</a> JAMA Psychiatry. 75 (1), 36-46 (2018).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Transdiagnostic+risk+calculator+for+the+automatic+detection+of+individuals+at-risk+and+the+prediction+of+psychosis%3A+Second+replication+in+an+independent+national+health+service+trust%5BTitle%5D)+AND+%22Schizophrenia+Bulletin%22%5BJournal%5D)">Transdiagnostic risk calculator for the automatic detection of individuals at-risk and the prediction of psychosis: Second replication in an independent national health service trust.</a> Schizophrenia Bulletin. , (2019).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Transdiagnostic+individualized+clinically+based+risk+calculator+for+the+detection+of+individuals+at-risk+and+the+prediction+of+psychosis%3A+Model+refinement+including+nonlinear+effects+of+age%5BTitle%5D)+AND+%22Frontiers+in+Psychiatry%22%5BJournal%5D)">Transdiagnostic individualized clinically based risk calculator for the detection of individuals at-risk and the prediction of psychosis: Model refinement including nonlinear effects of age.</a> Frontiers in Psychiatry. 10, 313(2019).</li>
<li>Colditz, G. A., Wei, E. K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Risk+prediction+models%3A+applications+in+cancer+prevention%5BTitle%5D)+AND+%22Current+Epidemiology+Reports%22%5BJournal%5D)">Risk prediction models: applications in cancer prevention.</a> Current Epidemiology Reports. 2 (4), 245-250 (2015).</li>
<li>Jackson, R., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((CogStack+-+Experiences+Of+Deploying+Integrated+Information+Retrieval+And+Extraction+Services+In+A+Large+National+Health+Service+Foundation+Trust+Hospital%5BTitle%5D)+AND+%22BMC+Medical+Informatics+and+Decision+Making%22%5BJournal%5D)">CogStack - Experiences Of Deploying Integrated Information Retrieval And Extraction Services In A Large National Health Service Foundation Trust Hospital.</a> BMC Medical Informatics and Decision Making. 18 (47), (2017).</li>
<li>McGorrian, C., Leong, T., D'Agostino, R., Graham, I. Risk estimation systems in clinical use: SCORE, Heart Score and the Framingham system. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aMcGorrian%2C+C+%22Hyperlipidaemia+%28Oxford+Cardiology+Library%29%22">Hyperlipidaemia (Oxford Cardiology Library)</a>. , Oxford University Press. (2012).</li>
<li>Studerus, E., Beck, K., Fusar-Poli, P., Riecher-Rössler, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Development+and+Validation+of+a+Dynamic+Risk+Prediction+Model+to+Forecast+Psychosis+Onset+in+Patients+at+Clinical+High+Risk%5BTitle%5D)+AND+%22Schizophrenia+Bulletin%22%5BJournal%5D)">Development and Validation of a Dynamic Risk Prediction Model to Forecast Psychosis Onset in Patients at Clinical High Risk.</a> Schizophrenia Bulletin. , (2019).</li>
<li>Damschroder, L. J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Fostering+implementation+of+health+services+research+findings+into+practice%3A+a+consolidated+framework+for+advancing+implementation+science%5BTitle%5D)+AND+%22Implementation+Science%22%5BJournal%5D)">Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science.</a> Implementation Science. 4, 50(2009).</li>
<li>Fusar-Poli, P., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Outreach+and+support+in+south+London+%28OASIS%29%2C+2001-2011%3A+ten+years+of+early+diagnosis+and+treatment+for+young+individuals+at+high+clinical+risk+for+psychosis%5BTitle%5D)+AND+%22European+Psychiatry%22%5BJournal%5D)">Outreach and support in south London (OASIS), 2001-2011: ten years of early diagnosis and treatment for young individuals at high clinical risk for psychosis.</a> European Psychiatry. 28 (5), 315-326 (2013).</li>
</ol>

The authors have nothing to disclose.

We have demonstrated the first EHR implementation of a real-time psychosis risk detection and alerting system based on CogStack, an open source information retrieval and extraction platform. Following this approach, one can transform and ingest a large set of clinical data in various formats, including structured and unstructured information, into a CogStack instance, so as to enable full-text search, interactive analyses and visualization of data, as well as real-time alerting to clinicians of patients that are at-risk of psychosis. Although the original psychosis risk calculator has been validated in pilot studies across several NHS Trusts, albeit using retrospective patient records6,14,21, this experimental design provides the first evidence base that this risk calculator can be replicated and deployed for use in real time. This approach allows the automatic delivery of prognostic results to clinicians through existing clinical notification channels, such as Email, in real time. This clearly demonstrates the technical feasibility for conducting a large-scale effectiveness trial to evaluate the ultimate clinical utility of this risk calculator in the real world.
This protocol is empirically innovative, as there does not exist a similar risk detection and alerting system for psychosis. Moreover, this protocol has high generalizability in clinical use, particularly because of the unique strengths of our approach. From a theoretical perspective, we used a risk prediction model that was developed based on a large retrospective de-identified cohort from the SLaM NHS Trust. SLaM provides secondary mental health care to a population of 1.36 million individuals in South London and has one of the highest recorded rates of psychosis in the world. This large cohort, which has high diversity in sociodemographic and diagnostic characteristics, allows us to develop a risk prediction model that is unlikely to be biased towards a population with specific characteristics. This is supported by evidence that the prognostic accuracy of this risk calculator has already been replicated twice in two different databases14,21, including one outside of SLaM. Another theoretical strength of this risk model is that basic demographic and clinical diagnosis information were used as predictors. Such information is ubiquitous in electronic clinical data and in fact missing data for these predictors have been shown to be relatively rare in our previous studies14,21. The high availability of information for building predictors makes it possible to run the risk calculator over a large number of patient samples across different secondary mental health care sectors. In addition, the risk calculator is a general algorithm which is suitable for all individuals at-risk of developing psychosis in secondary mental health care, regardless of individuals&#39; ages. That is, this calculator is not only suitable for the 15-35 age range of peak psychosis risk16, but also for those outside of this range, showing a high degree of generalizability.
From a practical perspective, both the risk calculator and the CogStack platform are light-weight and open-source services that do not involve resource-heavy techniques or costly infrastructure. Such a low-cost and easy-to-deploy platform can reduce the barriers to its adoption in real-world clinical settings. Also, our solution overcomes the main implementation barrier: risk estimation systems provide little value unless they are used by clinicians in day-to-day practice25. Specifically, our approach accesses data from the EHR, performs analyses independent of an electronic medical record system and can send analysis results back to clinicians through existing notification channels. This method does not require that the business logic in pre-existing systems be modified and can work as a standalone service to support and extend existing clinical decision support systems. Thus, the protocol has high compatibility with pre-existing clinical systems and can be easily integrated into routine clinical practice. Moreover, the protocol provides user-friendly interfaces for searching, analyzing and visualizing of clinical data, which make it easy for clinicians to interpret and explore the risk results.
This protocol also has its limitations. First, the effectiveness of this protocol has not been evaluated in routine clinical practice. This study focused on technical feasibility tests of implementing a real-time psychosis risk detection and alerting system in a local EHR. To further evaluate the effectiveness of this system in routine clinical practice, future large scale randomized controlled trials are needed6. A second limitation is that the predictions of risk scores in this protocol were made based on the first primary diagnoses, which are static data collected at a single snapshot. However, the CHR-P symptoms are intrinsically evolving over time. A dynamic version of psychosis risk calculator, in which prediction models can be dynamically updated to reflect the changes, has been developed recently26. Future work will focus on integrating this dynamic calculator in the current protocol.
The most critical step in this approach was identifying EHR data that were used for extract predictors in the risk calculator. This may also involve creating data element mappings, when an EHR system used a data model different from that used in this protocol, such as distinct coding systems for patients&#39; ethnic groups. We have open-sourced all the code and mapping definitions online (<a href="https://github.com/cogstack-slam/psychosis" target="_blank">https://github.com/cogstack-slam/psychosis</a>). Based on these materials, one would be able to replicate the deployment or adjust the calculator depending on one&#39;s own circumstance. Another critical step was creating a database view for data ingestion in CogStack. Since relational join operations (i.e., combining columns from one or more database tables) in Elasticsearch can lead to high computational cost, we conducted these join operations in the EHR database by creating a database view. This view combined all information that was needed to extract predictors in the risk calculator, and two vital fields that were used by CogStack pipelines for data partitioning in data ingestion. The first field is a unique primary key for each record in the view (&#34;patient_id&#34; used this protocol) and the second is a timestamp when a record was modified most recently. If these two fields were not set properly, CogStack might not synchronize data updates in an EHR database timely. Detailed instructions for troubleshooting issues on CogStack data ingestion are available on <a href="https://cogstack.atlassian.net/wiki/spaces/COGDOC/overview" target="_blank">https://cogstack.atlassian.net/wiki/spaces/COGDOC/overview</a> and <a href="https://github.com/CogStack/CogStack-Pipeline" target="_blank">https://github.com/CogStack/CogStack-Pipeline</a>.
This protocol is highly transportable and can be easily deployed in NHS Trusts that have a CRIS or CogStack platform. So far, the CRIS platform-including the consenting procedures-has been fully described elsewhere and is under expansion across 12 NHS Trusts in the UK, harnessing over 2 million deidentified patient records (<a href="https://crisnetwork.co/" target="_blank">https://crisnetwork.co/</a>). Similarly, the CogStack platform has been deployed not only in SLaM, but also other NHS Trusts across the UK such as University College London Hospitals (UCLH), King&#39;s College Hospital (KCH), Guy&#39;s and St Thomas&#39; (GSTT), and Mersey Care NHS Trusts. Those Trusts without such as platform can use an online version of risk calculator (<a href="http://psychosis-risk.net/" target="_blank">http://psychosis-risk.net</a>), or build this protocol from scratch based on this manuscript and our online documents. Although this protocol is developed for psychosis risk detection, the architectural design of this protocol is not tied-in to this specific use case. The protocol is flexible enough to allow for reconfiguration and repurposing of the real-time monitoring and alerting components for other risk measurement areas, such as adverse drug reactions, thereby allowing clinicians to timely take action to improve patient care, safety and experience.

Psychotic disorders are serious mental health illnesses that lead to difficulties in distinguishing between the internal experience of the mind and the external reality of the environment1, as well as a higher than average risk of self-harm and suicide2. Under standard care, these disorders result in major public health impact with a significant health and economic burden on individuals, families and societies worldwide3. Early interventions in psychosis can improve outcomes of this mental disorder4. In particular, detection, prognostic assessment and preventive treatment of individuals who are at clinical high risk for developing psychosis (CHR-P)5 provides a unique potential to alter the course of the disorder, thereby improving the quality of life for many people and their families3,6. CHR-P individuals are help-seeking young people presenting with attenuated symptoms and functional impairment7: their risk of developing psychosis is 20% at 2-years8 but it is higher in some specific subgroups9,10. Despite some substantial advancements, the impact of preventive approaches in routine clinical practice is limited by the ability to detect most individuals who are at-risk11. Current detection methods are based on help-seeking behaviors and referrals on suspicion of psychosis risk; these methods are highly inefficient in handling a large number of samples11. Thus, the scalability of current detection methods to the vast majority of the at-risk population is quite limited12. In fact, only 5% (standalone specialized early detection services) to 12% (youth mental health services) of individuals at-risk of developing a first psychotic disorder can be detected at the time of their at-risk stage by the current detection strategies6.
To extend the clinical benefits of the preventive approaches in a larger number of at-risk individuals, we developed an automated, lifespan-inclusive (i.e., across all ages), transdiagnostic (i.e., across different diagnoses)13, clinically-based individualized risk calculator, which can detect individuals at-risk of psychosis in secondary mental health care at scale, beyond those meeting CHR-P criteria14. This risk calculator used a Cox proportional hazard model to predict the risk of developing a psychotic disorder over six years from five routinely collected clinical variables selected a priori, in line with methodological guidelines15: age, gender, ethnicity, age-by-gender and primary index diagnosis. These clinical variables were selected based on a priori knowledge obtained from meta analyses16,17, as recommended by the state-of-the-art methodological guidelines15. The number of predictors is limited to preserve the Event Per Variable ratio and minimize overfitting biases; including too many variables without a priori filter leads to overfitting problems and poor prognostic accuracy18. The method used to develop this model provides similar prognostic accuracy to automatic machine learning methods18. Parameters of the Cox model were estimated based on a retrospective de-identified cohort from the South London and Maudsley National Health Service Foundation Trust (SLaM)19. SLaM is a National Health Service (NHS) mental health trust that provides secondary mental health care to a population of 1.36 million individuals in South London (Lambeth, Southwark, Lewisham and Croydon boroughs), and has one of the highest recorded rates of psychosis in the world20. All data used in the model development were extracted from the Clinical Record Interactive Search (CRIS) platform, a digital case register system, which provides researchers with retrospective access and analysis of anonymized clinical records19. The clinical information in CRIS is extracted from a bespoke Electronic Health Record (EHR) system, at SLaM, called electronic Patient Journey System (ePJS). SLaM is paper-free and ePJS represents the standard data collection platform for clinical routine. Thus, the transdiagnostic risk calculator leverages EHRs and has the potential to automatically screen large EHRs of patients accessing secondary mental healthcare, to detect those who may be at-risk of psychosis. The algorithm of this transdiagnostic risk calculator has been published previously6,14,21. The transdiagnostic risk calculator has been externally validated in two NHS Foundation Trusts14,21 and optimized22, demonstrating its adequate prognostic performance and generalizability across different populations.
According to methodological guidelines on the development of a risk prediction model15,23, the next step after model development and validation is to implement the prediction model in routine clinical practice. Implementation studies are usually preceded by pilot or feasibility studies that address potential pragmatic limitations associated with the use of risk algorithms in clinical practice. For example, required data for running a calculator, such as age, gender and ethnicity, may not be available at the date of diagnosis or updated later. Effective methods for handling missing data and synchronizing frequent updates in real-time data streams should be considered to obtain the most reliable prediction results in an implementation. Furthermore, since the initial development of the risk calculator was based on retrospective cohort data, it is not known whether it can be used in a real-time data stream that is typical of a real-world clinical setting. Another challenge is ensuring that relevant clinicians receive the recommendations generated by the risk calculator within an appropriate time frame and within a shared and accepted communication pathway.
To overcome these limitations, we have completed a feasibility implementation study employing the individualized transdiagnostic risk calculator. The study included two phases: an in vitro phase that was conducted using data from the local EHR, without contacting clinicians or patients, and an in vivo phase, which involved direct contact with clinicians. The in vitro phase had two manifold aims: (i) to address implementation barriers according to the Consolidated Framework for Implementation Research (CFIR)27 and (ii) to integrate the transdiagnostic risk calculator into the local EHR. Implementation barriers included the communication of risk outcomes to clinicians. In SLaM, all patients are invited to register for Consent for Contact (C4C), which indicates their willingness to be contacted for research, without affecting the quality of care. This reduces the ethical issues relating to contacting patients. Further to this, working groups with clinicians aided tailoring of how this information was communicated. During the in vivo phase (May 14th 2018 to April 29th 2019), all individuals (i) older than 14 years (ii) who were accessing any SLaM service (boroughs of Lambeth, Southwark, Lewisham, Croydon), (iii) receiving a first ICD-10 index primary diagnosis of any non-organic, non-psychotic mental disorder (with the exception of Acute and Transient Psychotic Disorders; ATPD), or a CHR-P designation and (iv) with existing contact details were deemed eligible. During the in vivo phase, new patients accessing SLaM each week were automatically screened for their psychosis risk, and those with having a risk greater than a certain threshold were detected. The research team then contacted the patients&#39; responsible clinicians to discuss further recommendations and eventually suggest a further face to face assessment6. If those assessed were considered to meet CHR-P criteria, they were referred to specialist CHR-P services, such as Outreach and Support in South London (OASIS)28. This would result in improved detection of individuals prior to the onset of a psychotic disorder and provide a significant opportunity for altering the course of the disorder. Crucially, this feasibility study involved the full integration of the calculator into the local EHR system, which is the topic of the current article. The full protocol of this feasibility study, including an overview of the plan for evaluating the proposed research, details on managing data security and ethical issues, has been presented in our previous work6. The current article, as a part of the feasibility study6, selectively focuses on presenting the technical implementation of a real-time psychosis risk detection and alerting system based on the local EHR data. More specifically, the aim of this study is to investigate the technical feasibility of this risk calculator in timely detecting at-risk patients as soon as they access a secondary mental healthcare service. The full results of the feasibility study, in terms of clinicians&#39; adherence to the recommendations made by the risk calculator, will be presented separately. A comprehensive evaluation of the effectiveness of the proposed research, which requires randomized designs, is outside the scope of the current research program. To our best knowledge, this is the first method describing the implementation of a risk calculator based on live EHR data for early detection of psychosis.
Our approach to psychosis risk detection and alerting takes advantage of the CogStack platform. The CogStack platform is a lightweight, distributed, and fault-tolerant information retrieval and text-extraction platform24. This platform consists of three key components: 1) the CogStack Pipeline that uses the Java Spring Batch framework to ingest and synchronize data from a pre-defined data source (both structured and unstructured EHR data in multiple formats such as Word, PDF files and images) to a predefined data sink in real time; 2) Elasticsearch, a search engine allowing for storage and querying of the full text of EHR data, as well as providing various application programming interfaces (APIs) to embed advanced analytics into the engine; and 3) Kibana, an interactive, web-based user interface that allows users to query data in Elasticsearch, build visualization dashboards and set alerting on anomalies or other patterns of interest from data. Moreover, CogStack incorporates the ability to alert clinicians to potential problems by Email and SMS (text), allowing clinicians to receive timely notifications about at-risk patients reported by the risk calculator.
We present a model of psychosis risk detection and alerting based on ePJS at SLaM, leveraging the CogStack platform. Compared with the CRIS platform that provides a mechanism for retrospective access to de-identified health records from ePJS on a weekly basis19, the CogStack platform at SLaM enables access to an identifiable EHR in real time, bringing the alerting closer to the point-of-care and the risk prediction in a prospective design, although both the CRIS and CogStack platforms use data sourced from ePJS in SLaM. In the section that follows, we provide details of the key steps in our approach, including preparing source data from the EHR, ingesting the source data into the CogStack platform to enable full-text search via Elasticsearch, running the psychosis risk calculator using a Python daemon thread, and setting interactive visualizations and real-time risk alerting via the Kibana user interface. Any researcher who aims to build a real-time risk detection and alerting system based on EHR data can follow the approach and its reference implementation. As we shall elaborate below, the proposed method exploits open-source, lightweight techniques with high flexibility and portability. This enables the risk calculator to be run in various locations and shows a high applicability to other risk estimation algorithms. Moreover, the method works as a straightforward approach to enhance the risk detection and alerting functionalities of an EHR embedded in a general healthcare system.

<table><tbody><tr><td>CogStack-Pipeline</td><td>King&#039;s College London</td><td></td><td>Open source software</td></tr><tr><td>Elasticsearch</td><td>Elastic NV</td><td></td><td>Open Source Search &amp;amp; Analytics</td></tr><tr><td>Kibana</td><td>Elastic NV</td><td></td><td>Open source data visualization plugin for Elasticsearch</td></tr><tr><td>Python packages (&quot;elasticsearch&quot;, &quot;elasticsearch_dsl&quot;, &quot;pandas&quot; and &quot;numpy&quot;)</td><td>Open source community</td><td></td><td>Open source packages</td></tr></tbody></table>

implementation of a real-time psychosis risk detection and alerting system based on electronic health records using cogstack

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Recent studies have shown that an automated, lifespan-inclusive, transdiagnostic, and clinically based, individualized risk calculator provides a powerful system for supporting the early detection of individuals at-risk of psychosis at a large scale, by leveraging electronic health records (EHRs). This risk calculator has been externally validated twice and is undergoing feasibility testing for clinical implementation. Integration of this risk calculator in clinical routine should be facilitated by prospective feasibility studies, which are required to address pragmatic challenges, such as missing data, and the usability of this risk calculator in a real-world and routine clinical setting. Here, we present an approach for a prospective implementation of a real-time psychosis risk detection and alerting service in a real-world EHR system. This method leverages the CogStack platform, which is an open-source, lightweight, and distributed information retrieval and text extraction system. The CogStack platform incorporates a set of services that allow for full-text search of clinical data, lifespan-inclusive, real-time calculation of psychosis risk, early risk-alerting to clinicians, and the visual monitoring of patients over time. Our method includes: 1) ingestion and synchronization of data from multiple sources into the CogStack platform, 2) implementation of a risk calculator, whose algorithm was previously developed and validated, for timely computation of a patient&#39;s risk of psychosis, 3) creation of interactive visualizations and dashboards to monitor patients&#39; health status over time, and 4) building automated alerting systems to ensure that clinicians are notified of patients at-risk, so that appropriate actions can be pursued. This is the first ever study that has developed and implemented a similar detection and alerting system in clinical routine for early detection of psychosis.

In this section, we present implementation results focusing in practicality in handling live clinical data streams elaborated through the risk calculator and facilitating timely delivery of prognostic results to clinicians. Evaluations of the clinical utility of the system, such as the adherence of clinicians to the recommendations made by the risk calculator, will be presented in a separate report when complete.
Ingestion of source data 
We deployed the psychosis risk calculation and alerting system based on a replica database of ePJS in SLaM. This replica database synchronizes the live data from ePJS every 10 minutes. A database view combining patients' information for psychosis risk calculation was built in this replica database, where each record contains information for a patient. All records in this view were ingested into the CogStack platform in real time (approximately 0.6 microsecond per record in a virtual machine with 8-core CPU and 16GB RAM). Until 13 July 2019 when this manuscript was prepared, all the records of 202,289 patients who received a first index diagnosis of non-organic and non-psychotic mental disorder in SLaM were ingested into CogStack for psychosis risk calculation, stored in the "psychosis_base" Elasticsearch index. Figure 1 shows the number of records ingested into CogStack over time, in chronological order based on the last update date of a record. By comparing the numbers and content of records in the database and the Elasticsearch index, no missing and discrepant data were found, which confirms the reliability of CogStack Pipeline in data ingestion and synchronization.
Validation of risk results 
To validate the implementation of the psychosis risk detector in this protocol, we compared at-risk patients detected by CogStack (called "CogStack version") with those detected by the original risk calculator based on CRIS (called "CRIS version"). Since there were no thresholds developed to screen an at-risk patient6,14,21, we here used a tentative threshold of 5% for the risk of psychosis in two years. Note that this tentative threshold is merely to test whether the system can pragmatically work in the NHS and is susceptible to change with future research. The actual threshold for an optimal detection of at-risk individuals will need to be identified in future large-scale studies. Specifically, we first retrieved all patients who had a risk for psychosis above the threshold in the CRIS version (the number of patients N=169). All these patients received a first index diagnosis of non-organic and non-psychotic mental disorder in SLaM from May 14th 2018 to April 29th 2019. By filtering patients who were diagnosed in the same time period, we then retrieved N=170 patients whose risk for psychosis in 2 years were higher than 0.05 in the CogStack version. Finally, we compared the difference between the two sets of patients, where the total number of unique patients in the two sets are N=173. We found that 161 patients (accounting for 93% of 173 patients) had the same scores in both versions. The high degree of agreement confirms the validity of this CogStack-based protocol in generating risk scores.
There were 12 patients having different risk scores in the two versions. By inspecting patients' EHRs, we found that this difference was because data for these patients were updated after the risk scores were calculated in the CRIS version. Specifically, although predictors used in the risk calculator, such as date of birth, gender and self-assigned ethnicity, were static variables, some patients' health records had a missing or default value for a variable (e.g., an unknown ethnicity) at an earlier stage and these variables were entered or updated at a later stage. This can lead to different risk scores at two different stages. Similarly, the first primary index diagnoses of some patients were invalidated after an initial risk score was calculated based on these diagnoses. In this case, the risk calculator will look for the next valid primary diagnosis for such patient and re-calculate a risk score. The updated risk score can also differ from the initial one. As the original risk calculator was developed based on retrospective data in CRIS for research use, the original calculator pipelines did not synchronize these updates in EHR data and refresh the risk scores in a timely manner. In contrast, a patient's risk score will be re-calculated in the CogStack version if any source data of the patient is updated, which allows this CogStack-based calculator to provide the most reliable and up-to-date risk scores for patients. These results strongly highlight the reliability of risk scores in this protocol.
Result visualization and risk alerting 
To demonstrate the capabilities of CogStack in data visualization, we built a dashboard for information about patients at-risk of psychosis. As used before for feasibility testing, we selected those who have a risk of psychosis in two years higher than 5% as at-risk patients. Figure 2 shows the visualizations of characteristics for patients at-risk of psychosis, including patients' ethnicities, genders, ages and categories of diagnoses. Apart from visualizing risk results via Web interfaces (e.g., Kibana), this protocol allows risk alerts to be sent to users or clinicians through other notification channels such as Email. Figure 3 shows the interface for setting a risk alerting service by using the Watch component in Kibana. Once this service is configured successfully, users can receive an Email notification if there were one or more patients whose risk of psychosis in two years are higher than 5%. Figure 4 shows an example of these Email notifications, which reports the numbers of patients at-risk and these patients' boroughs. Since more work is needed to tailor how the predicted psychosis risk scores are communicated, we have not sent risk notifications directly to clinicians. For testing the technological feasibility, all notifications in this study were sent from a technical researcher (T.W.) to a clinical researcher (D.O.) via the SLaM's email system within a secure network. Only an aggregated statistic of patient information was included in a notification; no any personally identifiable information was included.
<img alt="Web data analysis, graph in Kibana dashboard, visualizing log entries over time." class="xfigimg" src="/files/ftp_upload/60794/60794fig1.jpg" data-altupdatedat="1788250015000" data-alt="Figure 1"> 
Figure 1: Source data ingested into CogStack. There are 202,289 records in total ingested into the "psychosis_base" Elasticsearch index until 13 July 2019, and the histogram shows the numbers of records ingested over time, ordered by the last update data time of a record. One can also query both structured and unstructured information, and obtain search hits that match the query in this page. <a href="https://www.jove.com/files/ftp_upload/60794/60794fig1large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Kibana dashboard showing psychosis risk data analysis with charts on demographic distribution." class="xfigimg" src="/files/ftp_upload/60794/60794fig2.jpg" data-altupdatedat="1788250015000" data-alt="Figure 2"> 
Figure 2: Dashboard of characteristics of patients at-risk of psychosis (i.e., the risk of psychosis in 2 years higher than 0.05). (a) Distribution of ethnicities for patients at-risk, where outer pies are the subcategories of an ethnicity category in inner pies. (b) distribution of patients' gender, (c) distribution of patients' ages at diagnosis and (d) number of patients per diagnosis group. <a href="https://www.jove.com/files/ftp_upload/60794/60794fig2large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Kibana Watcher setup interface for configuring trigger actions and simulating match results." class="xfigimg" src="/files/ftp_upload/60794/60794fig3.jpg" data-altupdatedat="1788250015000" data-alt="Figure 3"> 
Figure 3: Setting and simulating Watch for risk alerting. <a href="https://www.jove.com/files/ftp_upload/60794/60794fig3large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
<img alt="Patient statistics analysis, list of CCGs and patient count, NHS data summary." class="xfigimg" src="/files/ftp_upload/60794/60794fig4.jpg" data-altupdatedat="1788250015000" data-alt="Figure 4"> 
Figure 4: An example of risk alerting Email. The numbers of patients at-risk of psychosis in each Clinical Commissioning Groups (CCG) are reported in parentheses. <a href="https://www.jove.com/files/ftp_upload/60794/60794fig4large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>

We demonstrate how to deploy a real-time psychosis risk calculation and alerting system based on CogStack, an information retrieval and extraction platform for electronic health records.

Recent studies have shown that an automated, lifespan-inclusive, transdiagnostic, and clinically based, individualized risk calculator provides a powerful ...

implementation-real-time-psychosis-risk-detection-alerting-system

Research

JoVE Journal

Behavior

We present a method for collecting electrocorticographic signals for research purposes from humans who are undergoing invasive epilepsy monitoring.  We show how to use the BCI2000 software platform for data collection, signal processing and stimulus presentation.  Specifically, we demonstrate SIGFRIED, a BCI2000-based tool for real-time functional brain mapping.

Recording Human Electrocorticographic (ECoG) Signals for Neuroscientific Research and Real-time Functional Cortical Mapping

Source: Sellers, K. K. et al. Closed-Loop Neurostimulation for Biomarker-Driven, Personalized Treatment of Major Depressive Disorder. J. Vis. Exp. (2023)This video demonstrates the procedure for system setup and data recording to support patient-specific biomarker detection and neurostimulation delivery for treating major depressive disorder.

Neurostimulation System Setup and Symptom Collection for Personalized Treatment of Depression

Unobtrusive sensors and pervasive computing technology incorporated into the daily home life of older adults enables meaningful health and activity changes to be recorded continuously for months to years, providing ecologically valid, high frequency, multi-domain data for research or clinical use.

Methodology for Establishing a Community-Wide Life Laboratory for Capturing Unobtrusive and Continuous Remote Activity and Health Data

We describe a protocol for the patient-directed registration of a three lead bipolar electrocardiogram by a smartwatch that functions identically to the Einthoven leads from standard electrocardiograms. This enables patients to record electrocardiograms on their own immediately after the onset of symptoms.

Patient Directed Recording of a Bipolar Three-Lead Electrocardiogram using a Smartwatch with ECG Function

This paper discusses how to build a brain-computer interface by relying on consumer-grade equipment and steady-state visually evoked potentials. For this, a single-channel electroencephalograph exploiting dry electrodes was integrated with augmented reality glasses for stimuli presentation and output data visualization. The final system was non-invasive, wearable, and portable.

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

Deep brain stimulation triggered by a patient-specific neural biomarker of a high-symptom state may better control symptoms of major depressive disorder compared to continuous, open-loop stimulation. This protocol provides a workflow for identifying a patient-specific neural biomarker and controlling the delivery of therapeutic stimulation based on the identified biomarker.

Closed-Loop Neurostimulation for Biomarker-Driven, Personalized Treatment of Major Depressive Disorder

The protocol shows a prototype of the at-home multi-modal data collection platform that supports research optimizing adaptive deep brain stimulation (aDBS) for people with neurological movement disorders. We also present key findings from deploying the platform for over a year to the home of an individual with Parkinson's disease.

Bringing the Clinic Home: An At-Home Multi-Modal Data Collection Ecosystem to Support Adaptive Deep Brain Stimulation

Handwriting analysis software significantly improves upon existing instruments measuring movement disorders. Individuals at risk for psychosis and healthy controls completed handwriting tasks to test for dyskinesia. Results suggest that youth at risk for psychosis exhibit dyskinesia and that handwriting analysis could significantly contribute to wider dissemination of early identification...

Handwriting Analysis Indicates Spontaneous Dyskinesias in Neuroleptic Na&#239;ve Adolescents at High Risk for Psychosis

This article presents a protocol for a contextual and cued fear conditioning test using a video analyzing system to assess fear learning and memory in mice.

Contextual and Cued Fear Conditioning Test Using a Video Analyzing System in Mice

A method to assess exercise endurance in laboratory mice without the use of a shock grid is demonstrated. This method is a humane refinement that can decrease the confounding effects of stress on experimental parameters.

Assessment of Murine Exercise Endurance Without the Use of a Shock Grid: An Alternative to Forced Exercise

Learn to implement a real-time psychosis risk detection system using CogStack and electronic health records. This computational method enables automatic risk identification and clinical alerting to improve patient outcomes.

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Explore More Videos