Loading…
Consistency checks to improve measurement with the Young Mania Rating Scale (YMRS)
Mitigating rating inconsistency can improve measurement fidelity and detection of treatment response. The International Society for CNS Clinical Trials and Methodology convened an expert Working Group that developed logical consistency (LC) checks for ratings of the Young Mania Rating Scale (YMRS),...
Saved in:
| Published in: | Journal of affective disorders 2024-01, Vol.345, p.24-31 |
|---|---|
| Main Authors: | , , , , , , , , , , , |
| Format: | Article |
| Language: | English |
| Subjects: | |
| Citations: | Items that this one cites Items that cite this one |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| cited_by | cdi_FETCH-LOGICAL-c373t-cf5e6dc00b2679ab7368d02aa12af396cf7a2bac6ece80611bddfd8207fe956b3 |
|---|---|
| cites | cdi_FETCH-LOGICAL-c373t-cf5e6dc00b2679ab7368d02aa12af396cf7a2bac6ece80611bddfd8207fe956b3 |
| container_end_page | 31 |
| container_issue | |
| container_start_page | 24 |
| container_title | Journal of affective disorders |
| container_volume | 345 |
| creator | Rabinowitz, Jonathan Young, Robert C. Yavorsky, Christian Williams, Janet B.W. Sedway, Jan Marino, Patricia Matteo, Christopher Mahableshwarkar, Atul Kott, Alan Hefting, Nanco Engler, Jenicka Brady, Chris |
| description | Mitigating rating inconsistency can improve measurement fidelity and detection of treatment response.
The International Society for CNS Clinical Trials and Methodology convened an expert Working Group that developed logical consistency (LC) checks for ratings of the Young Mania Rating Scale (YMRS), which is widely used in studies of mood and bipolar disorders. LC and statistical outlier-response pattern checks (SC) were applied to 63,228 YMRS administrations from 14 clinical trials evaluating treatments for bipolar disorder. Checks were also applied to Monte Carlo-simulated data as a proxy for their use under conditions of inconsistency.
42 LC flags were developed, and four SC flags were created from the data set (n = 14). Almost 20 % of the rating administrations had at least one LC flag, 6.7 % had two or more, 1.7 % had three or more; 17.3 % percent of the administrations had at least one SC flag and 4.6 % percent had two or more. Overall, 31 % of administrations had at least one flag of any type, 12.1 % had two or more and 5.3 % had three or more. In acute antimanic treatment trials (n = 10) there were more flags of any type compared to relapse prevention trials (n = 4).
Flagged ratings may represent less-common presentations assessed correctly.
Using established methods, we illustrate development and application of consistency flags for YMRS ratings. Applying flags and mitigation during trials may improve the value of YMRS data, help focus attention on rater training, and improve reliability and validity of trial data.
•A set of expert consensus and statistical flags to help identify possible errors in Young Mania Rating Scale (YMRS) ratings•Flags elaborated in paper can be applied.•Flags represent actual patterns of inconsistencies found.•Application of flags to ratings may improve reliability of ratings and validity of trials. |
| doi_str_mv | 10.1016/j.jad.2023.10.098 |
| format | article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2880096732</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0165032723012879</els_id><sourcerecordid>2880096732</sourcerecordid><originalsourceid>FETCH-LOGICAL-c373t-cf5e6dc00b2679ab7368d02aa12af396cf7a2bac6ece80611bddfd8207fe956b3</originalsourceid><addsrcrecordid>eNp9kEtPwzAQhC0EEqXwA7j5WA4pa1uxE3FCFS-pCKmFQ0-W42yoQx4ldov673FVzpxWs5pZ7XyEXDOYMmDytp7Wppxy4CLqKeTZCRmxVImEp0ydklH0pAkIrs7Jhfc1AMhcwYgsZn3nnQ_Y2T21a7RfnoaeunYz9DukLRq_HbDFLtAfF9Y0rJGu-m33SV9N5wxdmOCiWFrTIJ2sXhfLm0tyVpnG49XfHJOPx4f32XMyf3t6md3PEyuUCImtUpSlBSi4VLkplJBZCdwYxk0lcmkrZXhhrESLGUjGirKsyoyDqjBPZSHGZHK8G1_93qIPunXeYtOYDvut1zzLAHKpBI9WdrTaofd-wEpvBteaYa8Z6AM_XevITx_4HVaRX8zcHTMYO-wcDtpbFzFh6Qa0QZe9-yf9C6oEeK4</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2880096732</pqid></control><display><type>article</type><title>Consistency checks to improve measurement with the Young Mania Rating Scale (YMRS)</title><source>ScienceDirect Journals</source><creator>Rabinowitz, Jonathan ; Young, Robert C. ; Yavorsky, Christian ; Williams, Janet B.W. ; Sedway, Jan ; Marino, Patricia ; Matteo, Christopher ; Mahableshwarkar, Atul ; Kott, Alan ; Hefting, Nanco ; Engler, Jenicka ; Brady, Chris</creator><creatorcontrib>Rabinowitz, Jonathan ; Young, Robert C. ; Yavorsky, Christian ; Williams, Janet B.W. ; Sedway, Jan ; Marino, Patricia ; Matteo, Christopher ; Mahableshwarkar, Atul ; Kott, Alan ; Hefting, Nanco ; Engler, Jenicka ; Brady, Chris</creatorcontrib><description>Mitigating rating inconsistency can improve measurement fidelity and detection of treatment response.
The International Society for CNS Clinical Trials and Methodology convened an expert Working Group that developed logical consistency (LC) checks for ratings of the Young Mania Rating Scale (YMRS), which is widely used in studies of mood and bipolar disorders. LC and statistical outlier-response pattern checks (SC) were applied to 63,228 YMRS administrations from 14 clinical trials evaluating treatments for bipolar disorder. Checks were also applied to Monte Carlo-simulated data as a proxy for their use under conditions of inconsistency.
42 LC flags were developed, and four SC flags were created from the data set (n = 14). Almost 20 % of the rating administrations had at least one LC flag, 6.7 % had two or more, 1.7 % had three or more; 17.3 % percent of the administrations had at least one SC flag and 4.6 % percent had two or more. Overall, 31 % of administrations had at least one flag of any type, 12.1 % had two or more and 5.3 % had three or more. In acute antimanic treatment trials (n = 10) there were more flags of any type compared to relapse prevention trials (n = 4).
Flagged ratings may represent less-common presentations assessed correctly.
Using established methods, we illustrate development and application of consistency flags for YMRS ratings. Applying flags and mitigation during trials may improve the value of YMRS data, help focus attention on rater training, and improve reliability and validity of trial data.
•A set of expert consensus and statistical flags to help identify possible errors in Young Mania Rating Scale (YMRS) ratings•Flags elaborated in paper can be applied.•Flags represent actual patterns of inconsistencies found.•Application of flags to ratings may improve reliability of ratings and validity of trials.</description><identifier>ISSN: 0165-0327</identifier><identifier>EISSN: 1573-2517</identifier><identifier>DOI: 10.1016/j.jad.2023.10.098</identifier><language>eng</language><publisher>Elsevier B.V</publisher><subject>Careless ratings ; Consistency of measurement ; Inconsistent ratings ; YMRS ; Young Mania Rating Scale</subject><ispartof>Journal of affective disorders, 2024-01, Vol.345, p.24-31</ispartof><rights>2023 The Author(s)</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c373t-cf5e6dc00b2679ab7368d02aa12af396cf7a2bac6ece80611bddfd8207fe956b3</citedby><cites>FETCH-LOGICAL-c373t-cf5e6dc00b2679ab7368d02aa12af396cf7a2bac6ece80611bddfd8207fe956b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>315,786,790,27957,27958</link.rule.ids></links><search><creatorcontrib>Rabinowitz, Jonathan</creatorcontrib><creatorcontrib>Young, Robert C.</creatorcontrib><creatorcontrib>Yavorsky, Christian</creatorcontrib><creatorcontrib>Williams, Janet B.W.</creatorcontrib><creatorcontrib>Sedway, Jan</creatorcontrib><creatorcontrib>Marino, Patricia</creatorcontrib><creatorcontrib>Matteo, Christopher</creatorcontrib><creatorcontrib>Mahableshwarkar, Atul</creatorcontrib><creatorcontrib>Kott, Alan</creatorcontrib><creatorcontrib>Hefting, Nanco</creatorcontrib><creatorcontrib>Engler, Jenicka</creatorcontrib><creatorcontrib>Brady, Chris</creatorcontrib><title>Consistency checks to improve measurement with the Young Mania Rating Scale (YMRS)</title><title>Journal of affective disorders</title><description>Mitigating rating inconsistency can improve measurement fidelity and detection of treatment response.
The International Society for CNS Clinical Trials and Methodology convened an expert Working Group that developed logical consistency (LC) checks for ratings of the Young Mania Rating Scale (YMRS), which is widely used in studies of mood and bipolar disorders. LC and statistical outlier-response pattern checks (SC) were applied to 63,228 YMRS administrations from 14 clinical trials evaluating treatments for bipolar disorder. Checks were also applied to Monte Carlo-simulated data as a proxy for their use under conditions of inconsistency.
42 LC flags were developed, and four SC flags were created from the data set (n = 14). Almost 20 % of the rating administrations had at least one LC flag, 6.7 % had two or more, 1.7 % had three or more; 17.3 % percent of the administrations had at least one SC flag and 4.6 % percent had two or more. Overall, 31 % of administrations had at least one flag of any type, 12.1 % had two or more and 5.3 % had three or more. In acute antimanic treatment trials (n = 10) there were more flags of any type compared to relapse prevention trials (n = 4).
Flagged ratings may represent less-common presentations assessed correctly.
Using established methods, we illustrate development and application of consistency flags for YMRS ratings. Applying flags and mitigation during trials may improve the value of YMRS data, help focus attention on rater training, and improve reliability and validity of trial data.
•A set of expert consensus and statistical flags to help identify possible errors in Young Mania Rating Scale (YMRS) ratings•Flags elaborated in paper can be applied.•Flags represent actual patterns of inconsistencies found.•Application of flags to ratings may improve reliability of ratings and validity of trials.</description><subject>Careless ratings</subject><subject>Consistency of measurement</subject><subject>Inconsistent ratings</subject><subject>YMRS</subject><subject>Young Mania Rating Scale</subject><issn>0165-0327</issn><issn>1573-2517</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kEtPwzAQhC0EEqXwA7j5WA4pa1uxE3FCFS-pCKmFQ0-W42yoQx4ldov673FVzpxWs5pZ7XyEXDOYMmDytp7Wppxy4CLqKeTZCRmxVImEp0ydklH0pAkIrs7Jhfc1AMhcwYgsZn3nnQ_Y2T21a7RfnoaeunYz9DukLRq_HbDFLtAfF9Y0rJGu-m33SV9N5wxdmOCiWFrTIJ2sXhfLm0tyVpnG49XfHJOPx4f32XMyf3t6md3PEyuUCImtUpSlBSi4VLkplJBZCdwYxk0lcmkrZXhhrESLGUjGirKsyoyDqjBPZSHGZHK8G1_93qIPunXeYtOYDvut1zzLAHKpBI9WdrTaofd-wEpvBteaYa8Z6AM_XevITx_4HVaRX8zcHTMYO-wcDtpbFzFh6Qa0QZe9-yf9C6oEeK4</recordid><startdate>20240115</startdate><enddate>20240115</enddate><creator>Rabinowitz, Jonathan</creator><creator>Young, Robert C.</creator><creator>Yavorsky, Christian</creator><creator>Williams, Janet B.W.</creator><creator>Sedway, Jan</creator><creator>Marino, Patricia</creator><creator>Matteo, Christopher</creator><creator>Mahableshwarkar, Atul</creator><creator>Kott, Alan</creator><creator>Hefting, Nanco</creator><creator>Engler, Jenicka</creator><creator>Brady, Chris</creator><general>Elsevier B.V</general><scope>6I.</scope><scope>AAFTH</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>20240115</creationdate><title>Consistency checks to improve measurement with the Young Mania Rating Scale (YMRS)</title><author>Rabinowitz, Jonathan ; Young, Robert C. ; Yavorsky, Christian ; Williams, Janet B.W. ; Sedway, Jan ; Marino, Patricia ; Matteo, Christopher ; Mahableshwarkar, Atul ; Kott, Alan ; Hefting, Nanco ; Engler, Jenicka ; Brady, Chris</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c373t-cf5e6dc00b2679ab7368d02aa12af396cf7a2bac6ece80611bddfd8207fe956b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Careless ratings</topic><topic>Consistency of measurement</topic><topic>Inconsistent ratings</topic><topic>YMRS</topic><topic>Young Mania Rating Scale</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Rabinowitz, Jonathan</creatorcontrib><creatorcontrib>Young, Robert C.</creatorcontrib><creatorcontrib>Yavorsky, Christian</creatorcontrib><creatorcontrib>Williams, Janet B.W.</creatorcontrib><creatorcontrib>Sedway, Jan</creatorcontrib><creatorcontrib>Marino, Patricia</creatorcontrib><creatorcontrib>Matteo, Christopher</creatorcontrib><creatorcontrib>Mahableshwarkar, Atul</creatorcontrib><creatorcontrib>Kott, Alan</creatorcontrib><creatorcontrib>Hefting, Nanco</creatorcontrib><creatorcontrib>Engler, Jenicka</creatorcontrib><creatorcontrib>Brady, Chris</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of affective disorders</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Rabinowitz, Jonathan</au><au>Young, Robert C.</au><au>Yavorsky, Christian</au><au>Williams, Janet B.W.</au><au>Sedway, Jan</au><au>Marino, Patricia</au><au>Matteo, Christopher</au><au>Mahableshwarkar, Atul</au><au>Kott, Alan</au><au>Hefting, Nanco</au><au>Engler, Jenicka</au><au>Brady, Chris</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Consistency checks to improve measurement with the Young Mania Rating Scale (YMRS)</atitle><jtitle>Journal of affective disorders</jtitle><date>2024-01-15</date><risdate>2024</risdate><volume>345</volume><spage>24</spage><epage>31</epage><pages>24-31</pages><issn>0165-0327</issn><eissn>1573-2517</eissn><notes>ObjectType-Article-1</notes><notes>SourceType-Scholarly Journals-1</notes><notes>ObjectType-Feature-2</notes><notes>content type line 23</notes><abstract>Mitigating rating inconsistency can improve measurement fidelity and detection of treatment response.
The International Society for CNS Clinical Trials and Methodology convened an expert Working Group that developed logical consistency (LC) checks for ratings of the Young Mania Rating Scale (YMRS), which is widely used in studies of mood and bipolar disorders. LC and statistical outlier-response pattern checks (SC) were applied to 63,228 YMRS administrations from 14 clinical trials evaluating treatments for bipolar disorder. Checks were also applied to Monte Carlo-simulated data as a proxy for their use under conditions of inconsistency.
42 LC flags were developed, and four SC flags were created from the data set (n = 14). Almost 20 % of the rating administrations had at least one LC flag, 6.7 % had two or more, 1.7 % had three or more; 17.3 % percent of the administrations had at least one SC flag and 4.6 % percent had two or more. Overall, 31 % of administrations had at least one flag of any type, 12.1 % had two or more and 5.3 % had three or more. In acute antimanic treatment trials (n = 10) there were more flags of any type compared to relapse prevention trials (n = 4).
Flagged ratings may represent less-common presentations assessed correctly.
Using established methods, we illustrate development and application of consistency flags for YMRS ratings. Applying flags and mitigation during trials may improve the value of YMRS data, help focus attention on rater training, and improve reliability and validity of trial data.
•A set of expert consensus and statistical flags to help identify possible errors in Young Mania Rating Scale (YMRS) ratings•Flags elaborated in paper can be applied.•Flags represent actual patterns of inconsistencies found.•Application of flags to ratings may improve reliability of ratings and validity of trials.</abstract><pub>Elsevier B.V</pub><doi>10.1016/j.jad.2023.10.098</doi><tpages>8</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0165-0327 |
| ispartof | Journal of affective disorders, 2024-01, Vol.345, p.24-31 |
| issn | 0165-0327 1573-2517 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_2880096732 |
| source | ScienceDirect Journals |
| subjects | Careless ratings Consistency of measurement Inconsistent ratings YMRS Young Mania Rating Scale |
| title | Consistency checks to improve measurement with the Young Mania Rating Scale (YMRS) |
| url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-09-21T23%3A40%3A19IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Consistency%20checks%20to%20improve%20measurement%20with%20the%20Young%20Mania%20Rating%20Scale%20(YMRS)&rft.jtitle=Journal%20of%20affective%20disorders&rft.au=Rabinowitz,%20Jonathan&rft.date=2024-01-15&rft.volume=345&rft.spage=24&rft.epage=31&rft.pages=24-31&rft.issn=0165-0327&rft.eissn=1573-2517&rft_id=info:doi/10.1016/j.jad.2023.10.098&rft_dat=%3Cproquest_cross%3E2880096732%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c373t-cf5e6dc00b2679ab7368d02aa12af396cf7a2bac6ece80611bddfd8207fe956b3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2880096732&rft_id=info:pmid/&rfr_iscdi=true |