Loading…

How to carry out conceptual properties norming studies as parameter estimation studies: Lessons from ecology

Conceptual properties norming studies (CPNs) ask participants to produce properties that describe concepts. From that data, different metrics may be computed (e.g., semantic richness, similarity measures), which are then used in studying concepts and as a source of carefully controlled stimuli for e...

Full description

Saved in:

Bibliographic Details
Published in:	Behavior research methods 2021-02, Vol.53 (1), p.354-370
Main Authors:	Canessa, Enrique, Chaigneau, Sergio E., Lagos, Rodrigo, Medina, Felipe A.
Format:	Article
Language:	English
Subjects:	Behavioral Science and Psychology Cognitive Psychology Humans Parameter estimation Psychology Semantics
Citations:	Items that this one cites Items that cite this one
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

cited_by	cdi_FETCH-LOGICAL-c486t-d552cadc3a144cb14e9ccdc23cb70dadba7936349ec44af75d5883b7f208b9003
cites	cdi_FETCH-LOGICAL-c486t-d552cadc3a144cb14e9ccdc23cb70dadba7936349ec44af75d5883b7f208b9003
container_end_page	370
container_issue	1
container_start_page	354
container_title	Behavior research methods
container_volume	53
creator	Canessa, Enrique Chaigneau, Sergio E. Lagos, Rodrigo Medina, Felipe A.
description	Conceptual properties norming studies (CPNs) ask participants to produce properties that describe concepts. From that data, different metrics may be computed (e.g., semantic richness, similarity measures), which are then used in studying concepts and as a source of carefully controlled stimuli for experimentation. Notwithstanding those metrics’ demonstrated usefulness, researchers have customarily overlooked that they are only point estimates of the true unknown population values, and therefore, only rough approximations. Thus, though research based on CPN data may produce reliable results, those results are likely to be general and coarse-grained. In contrast, we suggest viewing CPNs as parameter estimation procedures, where researchers obtain only estimates of the unknown population parameters. Thus, more specific and fine-grained analyses must consider those parameters’ variability. To this end, we introduce a probabilistic model from the field of ecology. Its related statistical expressions can be applied to compute estimates of CPNs’ parameters and their corresponding variances. Furthermore, those expressions can be used to guide the sampling process. The traditional practice in CPN studies is to use the same number of participants across concepts, intuitively believing that practice will render the computed metrics comparable across concepts and CPNs. In contrast, the current work shows why an equal number of participants per concept is generally not desirable. Using CPN data, we show how to use the equations and discuss how they may allow more reasonable analyses and comparisons of parameter values among different concepts in a CPN, and across different CPNs.
doi_str_mv	10.3758/s13428-020-01439-8
format	article
fullrecord	<record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2427307648</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2489012943</sourcerecordid><originalsourceid>FETCH-LOGICAL-c486t-d552cadc3a144cb14e9ccdc23cb70dadba7936349ec44af75d5883b7f208b9003</originalsourceid><addsrcrecordid>eNp9kb1OwzAUhS0EolB4AQZkiYUl4N_EYUMVUKRKLDBbjuNUqRI72I5Q3x6XtoAYmGzrfj73nnsAuMDohhZc3AZMGREZIihDmNEyEwfgBHPOMsqJOPx1n4DTEFYIUUEwOwYTSgrE8xydgG7uPmB0UCvv19CNEWpntRniqDo4eDcYH1sToHW-b-0ShjjWm7cKcFBe9SYaD02Iba9i6-y-fgcXJgRnA2y866HRrnPL9Rk4alQXzPnunIK3x4fX2TxbvDw9z-4XmWYij1nNOdGq1lRhxnSFmSm1rjWhuipQrepKFSXNKSuNZkw1Ba-5ELQqGoJEVSaXU3C91U0G3sc0nezboE3XKWvcGCRhpKCoyJlI6NUfdOVGb9N0iRIlwqRkNFFkS2nvQvCmkYNPjv1aYiQ3WchtFjJlIb-ykBvpy530WPWm_v6yX34C6BYIqWSXxv_0_kf2ExjvloI</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2489012943</pqid></control><display><type>article</type><title>How to carry out conceptual properties norming studies as parameter estimation studies: Lessons from ecology</title><source>Springer Link</source><creator>Canessa, Enrique ; Chaigneau, Sergio E. ; Lagos, Rodrigo ; Medina, Felipe A.</creator><creatorcontrib>Canessa, Enrique ; Chaigneau, Sergio E. ; Lagos, Rodrigo ; Medina, Felipe A.</creatorcontrib><description>Conceptual properties norming studies (CPNs) ask participants to produce properties that describe concepts. From that data, different metrics may be computed (e.g., semantic richness, similarity measures), which are then used in studying concepts and as a source of carefully controlled stimuli for experimentation. Notwithstanding those metrics’ demonstrated usefulness, researchers have customarily overlooked that they are only point estimates of the true unknown population values, and therefore, only rough approximations. Thus, though research based on CPN data may produce reliable results, those results are likely to be general and coarse-grained. In contrast, we suggest viewing CPNs as parameter estimation procedures, where researchers obtain only estimates of the unknown population parameters. Thus, more specific and fine-grained analyses must consider those parameters’ variability. To this end, we introduce a probabilistic model from the field of ecology. Its related statistical expressions can be applied to compute estimates of CPNs’ parameters and their corresponding variances. Furthermore, those expressions can be used to guide the sampling process. The traditional practice in CPN studies is to use the same number of participants across concepts, intuitively believing that practice will render the computed metrics comparable across concepts and CPNs. In contrast, the current work shows why an equal number of participants per concept is generally not desirable. Using CPN data, we show how to use the equations and discuss how they may allow more reasonable analyses and comparisons of parameter values among different concepts in a CPN, and across different CPNs.</description><identifier>ISSN: 1554-3528</identifier><identifier>EISSN: 1554-3528</identifier><identifier>DOI: 10.3758/s13428-020-01439-8</identifier><identifier>PMID: 32705660</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Behavioral Science and Psychology ; Cognitive Psychology ; Humans ; Parameter estimation ; Psychology ; Semantics</subject><ispartof>Behavior research methods, 2021-02, Vol.53 (1), p.354-370</ispartof><rights>The Psychonomic Society, Inc. 2020</rights><rights>The Psychonomic Society, Inc. 2020.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c486t-d552cadc3a144cb14e9ccdc23cb70dadba7936349ec44af75d5883b7f208b9003</citedby><cites>FETCH-LOGICAL-c486t-d552cadc3a144cb14e9ccdc23cb70dadba7936349ec44af75d5883b7f208b9003</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>315,786,790,27957,27958</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/32705660$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Canessa, Enrique</creatorcontrib><creatorcontrib>Chaigneau, Sergio E.</creatorcontrib><creatorcontrib>Lagos, Rodrigo</creatorcontrib><creatorcontrib>Medina, Felipe A.</creatorcontrib><title>How to carry out conceptual properties norming studies as parameter estimation studies: Lessons from ecology</title><title>Behavior research methods</title><addtitle>Behav Res</addtitle><addtitle>Behav Res Methods</addtitle><description>Conceptual properties norming studies (CPNs) ask participants to produce properties that describe concepts. From that data, different metrics may be computed (e.g., semantic richness, similarity measures), which are then used in studying concepts and as a source of carefully controlled stimuli for experimentation. Notwithstanding those metrics’ demonstrated usefulness, researchers have customarily overlooked that they are only point estimates of the true unknown population values, and therefore, only rough approximations. Thus, though research based on CPN data may produce reliable results, those results are likely to be general and coarse-grained. In contrast, we suggest viewing CPNs as parameter estimation procedures, where researchers obtain only estimates of the unknown population parameters. Thus, more specific and fine-grained analyses must consider those parameters’ variability. To this end, we introduce a probabilistic model from the field of ecology. Its related statistical expressions can be applied to compute estimates of CPNs’ parameters and their corresponding variances. Furthermore, those expressions can be used to guide the sampling process. The traditional practice in CPN studies is to use the same number of participants across concepts, intuitively believing that practice will render the computed metrics comparable across concepts and CPNs. In contrast, the current work shows why an equal number of participants per concept is generally not desirable. Using CPN data, we show how to use the equations and discuss how they may allow more reasonable analyses and comparisons of parameter values among different concepts in a CPN, and across different CPNs.</description><subject>Behavioral Science and Psychology</subject><subject>Cognitive Psychology</subject><subject>Humans</subject><subject>Parameter estimation</subject><subject>Psychology</subject><subject>Semantics</subject><issn>1554-3528</issn><issn>1554-3528</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNp9kb1OwzAUhS0EolB4AQZkiYUl4N_EYUMVUKRKLDBbjuNUqRI72I5Q3x6XtoAYmGzrfj73nnsAuMDohhZc3AZMGREZIihDmNEyEwfgBHPOMsqJOPx1n4DTEFYIUUEwOwYTSgrE8xydgG7uPmB0UCvv19CNEWpntRniqDo4eDcYH1sToHW-b-0ShjjWm7cKcFBe9SYaD02Iba9i6-y-fgcXJgRnA2y866HRrnPL9Rk4alQXzPnunIK3x4fX2TxbvDw9z-4XmWYij1nNOdGq1lRhxnSFmSm1rjWhuipQrepKFSXNKSuNZkw1Ba-5ELQqGoJEVSaXU3C91U0G3sc0nezboE3XKWvcGCRhpKCoyJlI6NUfdOVGb9N0iRIlwqRkNFFkS2nvQvCmkYNPjv1aYiQ3WchtFjJlIb-ykBvpy530WPWm_v6yX34C6BYIqWSXxv_0_kf2ExjvloI</recordid><startdate>20210201</startdate><enddate>20210201</enddate><creator>Canessa, Enrique</creator><creator>Chaigneau, Sergio E.</creator><creator>Lagos, Rodrigo</creator><creator>Medina, Felipe A.</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>4T-</scope><scope>7TK</scope><scope>K9.</scope><scope>7X8</scope></search><sort><creationdate>20210201</creationdate><title>How to carry out conceptual properties norming studies as parameter estimation studies: Lessons from ecology</title><author>Canessa, Enrique ; Chaigneau, Sergio E. ; Lagos, Rodrigo ; Medina, Felipe A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c486t-d552cadc3a144cb14e9ccdc23cb70dadba7936349ec44af75d5883b7f208b9003</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Behavioral Science and Psychology</topic><topic>Cognitive Psychology</topic><topic>Humans</topic><topic>Parameter estimation</topic><topic>Psychology</topic><topic>Semantics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Canessa, Enrique</creatorcontrib><creatorcontrib>Chaigneau, Sergio E.</creatorcontrib><creatorcontrib>Lagos, Rodrigo</creatorcontrib><creatorcontrib>Medina, Felipe A.</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Docstoc</collection><collection>Neurosciences Abstracts</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>MEDLINE - Academic</collection><jtitle>Behavior research methods</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Canessa, Enrique</au><au>Chaigneau, Sergio E.</au><au>Lagos, Rodrigo</au><au>Medina, Felipe A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>How to carry out conceptual properties norming studies as parameter estimation studies: Lessons from ecology</atitle><jtitle>Behavior research methods</jtitle><stitle>Behav Res</stitle><addtitle>Behav Res Methods</addtitle><date>2021-02-01</date><risdate>2021</risdate><volume>53</volume><issue>1</issue><spage>354</spage><epage>370</epage><pages>354-370</pages><issn>1554-3528</issn><eissn>1554-3528</eissn><notes>ObjectType-Article-1</notes><notes>SourceType-Scholarly Journals-1</notes><notes>ObjectType-Feature-2</notes><notes>content type line 23</notes><abstract>Conceptual properties norming studies (CPNs) ask participants to produce properties that describe concepts. From that data, different metrics may be computed (e.g., semantic richness, similarity measures), which are then used in studying concepts and as a source of carefully controlled stimuli for experimentation. Notwithstanding those metrics’ demonstrated usefulness, researchers have customarily overlooked that they are only point estimates of the true unknown population values, and therefore, only rough approximations. Thus, though research based on CPN data may produce reliable results, those results are likely to be general and coarse-grained. In contrast, we suggest viewing CPNs as parameter estimation procedures, where researchers obtain only estimates of the unknown population parameters. Thus, more specific and fine-grained analyses must consider those parameters’ variability. To this end, we introduce a probabilistic model from the field of ecology. Its related statistical expressions can be applied to compute estimates of CPNs’ parameters and their corresponding variances. Furthermore, those expressions can be used to guide the sampling process. The traditional practice in CPN studies is to use the same number of participants across concepts, intuitively believing that practice will render the computed metrics comparable across concepts and CPNs. In contrast, the current work shows why an equal number of participants per concept is generally not desirable. Using CPN data, we show how to use the equations and discuss how they may allow more reasonable analyses and comparisons of parameter values among different concepts in a CPN, and across different CPNs.</abstract><cop>New York</cop><pub>Springer US</pub><pmid>32705660</pmid><doi>10.3758/s13428-020-01439-8</doi><tpages>17</tpages><oa>free_for_read</oa></addata></record>
fulltext	fulltext
identifier	ISSN: 1554-3528
ispartof	Behavior research methods, 2021-02, Vol.53 (1), p.354-370
issn	1554-3528 1554-3528
language	eng
recordid	cdi_proquest_miscellaneous_2427307648
source	Springer Link
subjects	Behavioral Science and Psychology Cognitive Psychology Humans Parameter estimation Psychology Semantics
title	How to carry out conceptual properties norming studies as parameter estimation studies: Lessons from ecology
url	http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-09-21T19%3A44%3A04IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=How%20to%20carry%20out%20conceptual%20properties%20norming%20studies%20as%20parameter%20estimation%20studies:%20Lessons%20from%20ecology&rft.jtitle=Behavior%20research%20methods&rft.au=Canessa,%20Enrique&rft.date=2021-02-01&rft.volume=53&rft.issue=1&rft.spage=354&rft.epage=370&rft.pages=354-370&rft.issn=1554-3528&rft.eissn=1554-3528&rft_id=info:doi/10.3758/s13428-020-01439-8&rft_dat=%3Cproquest_cross%3E2489012943%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c486t-d552cadc3a144cb14e9ccdc23cb70dadba7936349ec44af75d5883b7f208b9003%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2489012943&rft_id=info:pmid/32705660&rfr_iscdi=true