A sampling approach to estimate the log determinant used in spatial likelihood problems

Likelihood-based methods for modeling multivariate Gaussian spatial data have desirable statistical characteristics, but the practicality of these methods for massive georeferenced data sets is often questioned. A sampling algorithm is proposed that exploits a relationship involving log-pivots arisi...

Full description

Saved in:
Bibliographic Details
Published in:Journal of geographical systems 2009-09, Vol.11 (3), p.209-225
Main Authors: Pace, R. Kelley, LeSage, James P.
Format: Article
Language:English
Subjects:
Areal geology. Maps
Computer Appl. in Social and Behavioral Sciences
Datasets
Dependent variables
Distributed processing
Earth sciences
Earth, ocean, space
Econometrics
Economics
Economics and Finance
Eigenvalues
Estimates
Exact sciences and technology
Geographical Information Systems/Cartography
Geologic maps, cartography
Grants
Landscape/Regional and Urban Planning
Maximum likelihood method
Methods
Original Article
Regional/Spatial Science
Regression analysis
Spatial data
Statistical analysis
Studies
Urban Economics
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c451t-e38d40eae0fa113de895fab1dbbce61bac2619f7e501469b61447d2532099e6a3
cites cdi_FETCH-LOGICAL-c451t-e38d40eae0fa113de895fab1dbbce61bac2619f7e501469b61447d2532099e6a3
container_end_page 225
container_issue 3
container_start_page 209
container_title Journal of geographical systems
container_volume 11
creator Pace, R. Kelley
LeSage, James P.
description Likelihood-based methods for modeling multivariate Gaussian spatial data have desirable statistical characteristics, but the practicality of these methods for massive georeferenced data sets is often questioned. A sampling algorithm is proposed that exploits a relationship involving log-pivots arising from matrix decompositions used to compute the log determinant term that appears in the model likelihood. We demonstrate that the method can be used to successfully estimate log-determinants for large numbers of observations. Specifically, we produce an log-determinant estimate for a 3,954,400 by 3,954,400 matrix in less than two minutes on a desktop computer. The proposed method involves computations that are independent, making it amenable to out-of-core computation as well as to coarse-grained parallel or distributed processing. The proposed technique yields an estimated log-determinant and associated confidence interval.
doi_str_mv 10.1007/s10109-009-0087-7
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_743623911</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1827090361</sourcerecordid><originalsourceid>FETCH-LOGICAL-c451t-e38d40eae0fa113de895fab1dbbce61bac2619f7e501469b61447d2532099e6a3</originalsourceid><addsrcrecordid>eNp1kEtLxTAQhYMoqFd_gLsgiKtqpkmbZiniCwQ3isswbaf3RtOHSe_Cf2_0ioLgYpiBfOfkcBg7AnEGQujzCAKEycTXVDrTW2wPlCyywiiz_XNLscv2Y3wRAnQBeo89X_CI_eTdsOQ4TWHEZsXnkVOcXY8z8XlF3I9L3tJMoXcDDjNfR2q5G3iccHbouXev5N1qHFueHGpPfTxgOx36SIffe8Gerq8eL2-z-4ebu8uL-6xRBcwZyapVgpBEhwCypcoUHdbQ1nVDJdTY5CWYTlMhQJWmLkEp3eaFzIUxVKJcsNONb_r4bZ1S297FhrzHgcZ1tFrJMpcmeS_Y8R_yZVyHIYWzuRQApTFlgmADNWGMMVBnp5B6CO8WhP0s2m6KtuJrKm110px8G2Ns0HcBh8bFH2EOlVJJk7h8w8X0NCwp_Ab43_wDmRqNcQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>230116996</pqid></control><display><type>article</type><title>A sampling approach to estimate the log determinant used in spatial likelihood problems</title><source>Business Source Ultimate</source><source>EconLit with Full Text</source><source>ABI/INFORM Global</source><source>Springer Link</source><creator>Pace, R. Kelley ; LeSage, James P.</creator><creatorcontrib>Pace, R. Kelley ; LeSage, James P.</creatorcontrib><description>Likelihood-based methods for modeling multivariate Gaussian spatial data have desirable statistical characteristics, but the practicality of these methods for massive georeferenced data sets is often questioned. A sampling algorithm is proposed that exploits a relationship involving log-pivots arising from matrix decompositions used to compute the log determinant term that appears in the model likelihood. We demonstrate that the method can be used to successfully estimate log-determinants for large numbers of observations. Specifically, we produce an log-determinant estimate for a 3,954,400 by 3,954,400 matrix in less than two minutes on a desktop computer. The proposed method involves computations that are independent, making it amenable to out-of-core computation as well as to coarse-grained parallel or distributed processing. The proposed technique yields an estimated log-determinant and associated confidence interval.</description><identifier>ISSN: 1435-5930</identifier><identifier>EISSN: 1435-5949</identifier><identifier>DOI: 10.1007/s10109-009-0087-7</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer-Verlag</publisher><subject>Areal geology. Maps ; Computer Appl. in Social and Behavioral Sciences ; Datasets ; Dependent variables ; Distributed processing ; Earth sciences ; Earth, ocean, space ; Econometrics ; Economics ; Economics and Finance ; Eigenvalues ; Estimates ; Exact sciences and technology ; Geographical Information Systems/Cartography ; Geologic maps, cartography ; Grants ; Landscape/Regional and Urban Planning ; Maximum likelihood method ; Methods ; Original Article ; Regional/Spatial Science ; Regression analysis ; Spatial data ; Statistical analysis ; Studies ; Urban Economics</subject><ispartof>Journal of geographical systems, 2009-09, Vol.11 (3), p.209-225</ispartof><rights>Springer-Verlag 2009</rights><rights>2009 INIST-CNRS</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c451t-e38d40eae0fa113de895fab1dbbce61bac2619f7e501469b61447d2532099e6a3</citedby><cites>FETCH-LOGICAL-c451t-e38d40eae0fa113de895fab1dbbce61bac2619f7e501469b61447d2532099e6a3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/230116996/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/230116996?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>315,786,790,11715,27957,27958,36095,36096,44398,75252</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=21844010$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><creatorcontrib>Pace, R. Kelley</creatorcontrib><creatorcontrib>LeSage, James P.</creatorcontrib><title>A sampling approach to estimate the log determinant used in spatial likelihood problems</title><title>Journal of geographical systems</title><addtitle>J Geogr Syst</addtitle><description>Likelihood-based methods for modeling multivariate Gaussian spatial data have desirable statistical characteristics, but the practicality of these methods for massive georeferenced data sets is often questioned. A sampling algorithm is proposed that exploits a relationship involving log-pivots arising from matrix decompositions used to compute the log determinant term that appears in the model likelihood. We demonstrate that the method can be used to successfully estimate log-determinants for large numbers of observations. Specifically, we produce an log-determinant estimate for a 3,954,400 by 3,954,400 matrix in less than two minutes on a desktop computer. The proposed method involves computations that are independent, making it amenable to out-of-core computation as well as to coarse-grained parallel or distributed processing. The proposed technique yields an estimated log-determinant and associated confidence interval.</description><subject>Areal geology. Maps</subject><subject>Computer Appl. in Social and Behavioral Sciences</subject><subject>Datasets</subject><subject>Dependent variables</subject><subject>Distributed processing</subject><subject>Earth sciences</subject><subject>Earth, ocean, space</subject><subject>Econometrics</subject><subject>Economics</subject><subject>Economics and Finance</subject><subject>Eigenvalues</subject><subject>Estimates</subject><subject>Exact sciences and technology</subject><subject>Geographical Information Systems/Cartography</subject><subject>Geologic maps, cartography</subject><subject>Grants</subject><subject>Landscape/Regional and Urban Planning</subject><subject>Maximum likelihood method</subject><subject>Methods</subject><subject>Original Article</subject><subject>Regional/Spatial Science</subject><subject>Regression analysis</subject><subject>Spatial data</subject><subject>Statistical analysis</subject><subject>Studies</subject><subject>Urban Economics</subject><issn>1435-5930</issn><issn>1435-5949</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2009</creationdate><recordtype>article</recordtype><sourceid>M0C</sourceid><recordid>eNp1kEtLxTAQhYMoqFd_gLsgiKtqpkmbZiniCwQ3isswbaf3RtOHSe_Cf2_0ioLgYpiBfOfkcBg7AnEGQujzCAKEycTXVDrTW2wPlCyywiiz_XNLscv2Y3wRAnQBeo89X_CI_eTdsOQ4TWHEZsXnkVOcXY8z8XlF3I9L3tJMoXcDDjNfR2q5G3iccHbouXev5N1qHFueHGpPfTxgOx36SIffe8Gerq8eL2-z-4ebu8uL-6xRBcwZyapVgpBEhwCypcoUHdbQ1nVDJdTY5CWYTlMhQJWmLkEp3eaFzIUxVKJcsNONb_r4bZ1S297FhrzHgcZ1tFrJMpcmeS_Y8R_yZVyHIYWzuRQApTFlgmADNWGMMVBnp5B6CO8WhP0s2m6KtuJrKm110px8G2Ns0HcBh8bFH2EOlVJJk7h8w8X0NCwp_Ab43_wDmRqNcQ</recordid><startdate>20090901</startdate><enddate>20090901</enddate><creator>Pace, R. Kelley</creator><creator>LeSage, James P.</creator><general>Springer-Verlag</general><general>Springer</general><general>Springer Nature B.V</general><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0U~</scope><scope>1-H</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>88I</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>BKSAR</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>KR7</scope><scope>L.-</scope><scope>L.0</scope><scope>L6V</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M2O</scope><scope>M2P</scope><scope>M7S</scope><scope>MBDVC</scope><scope>PADUT</scope><scope>PATMY</scope><scope>PCBAR</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>PYYUZ</scope><scope>Q9U</scope></search><sort><creationdate>20090901</creationdate><title>A sampling approach to estimate the log determinant used in spatial likelihood problems</title><author>Pace, R. Kelley ; LeSage, James P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c451t-e38d40eae0fa113de895fab1dbbce61bac2619f7e501469b61447d2532099e6a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2009</creationdate><topic>Areal geology. Maps</topic><topic>Computer Appl. in Social and Behavioral Sciences</topic><topic>Datasets</topic><topic>Dependent variables</topic><topic>Distributed processing</topic><topic>Earth sciences</topic><topic>Earth, ocean, space</topic><topic>Econometrics</topic><topic>Economics</topic><topic>Economics and Finance</topic><topic>Eigenvalues</topic><topic>Estimates</topic><topic>Exact sciences and technology</topic><topic>Geographical Information Systems/Cartography</topic><topic>Geologic maps, cartography</topic><topic>Grants</topic><topic>Landscape/Regional and Urban Planning</topic><topic>Maximum likelihood method</topic><topic>Methods</topic><topic>Original Article</topic><topic>Regional/Spatial Science</topic><topic>Regression analysis</topic><topic>Spatial data</topic><topic>Statistical analysis</topic><topic>Studies</topic><topic>Urban Economics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Pace, R. Kelley</creatorcontrib><creatorcontrib>LeSage, James P.</creatorcontrib><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Global News &amp; ABI/Inform Professional</collection><collection>Trade PRO</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection</collection><collection>Science Database (Alumni Edition)</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Agricultural &amp; Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Databases</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Earth, Atmospheric &amp; Aquatic Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Civil Engineering Abstracts</collection><collection>ABI/INFORM Professional Advanced</collection><collection>ABI/INFORM Professional Standard</collection><collection>ProQuest Engineering Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>ProQuest Research Library</collection><collection>ProQuest Science Journals</collection><collection>Engineering Database</collection><collection>Research Library (Corporate)</collection><collection>Research Library China</collection><collection>Environmental Science Database</collection><collection>Earth, Atmospheric &amp; Aquatic Science Database</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>Environmental Science Collection</collection><collection>ABI/INFORM Collection China</collection><collection>ProQuest Central Basic</collection><jtitle>Journal of geographical systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pace, R. Kelley</au><au>LeSage, James P.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A sampling approach to estimate the log determinant used in spatial likelihood problems</atitle><jtitle>Journal of geographical systems</jtitle><stitle>J Geogr Syst</stitle><date>2009-09-01</date><risdate>2009</risdate><volume>11</volume><issue>3</issue><spage>209</spage><epage>225</epage><pages>209-225</pages><issn>1435-5930</issn><eissn>1435-5949</eissn><notes>ObjectType-Article-2</notes><notes>SourceType-Scholarly Journals-1</notes><notes>ObjectType-Feature-1</notes><notes>content type line 23</notes><abstract>Likelihood-based methods for modeling multivariate Gaussian spatial data have desirable statistical characteristics, but the practicality of these methods for massive georeferenced data sets is often questioned. A sampling algorithm is proposed that exploits a relationship involving log-pivots arising from matrix decompositions used to compute the log determinant term that appears in the model likelihood. We demonstrate that the method can be used to successfully estimate log-determinants for large numbers of observations. Specifically, we produce an log-determinant estimate for a 3,954,400 by 3,954,400 matrix in less than two minutes on a desktop computer. The proposed method involves computations that are independent, making it amenable to out-of-core computation as well as to coarse-grained parallel or distributed processing. The proposed technique yields an estimated log-determinant and associated confidence interval.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer-Verlag</pub><doi>10.1007/s10109-009-0087-7</doi><tpages>17</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1435-5930
ispartof Journal of geographical systems, 2009-09, Vol.11 (3), p.209-225
issn 1435-5930
1435-5949
language eng
recordid cdi_proquest_miscellaneous_743623911
source Business Source Ultimate; EconLit with Full Text; ABI/INFORM Global; Springer Link
subjects Areal geology. Maps
Computer Appl. in Social and Behavioral Sciences
Datasets
Dependent variables
Distributed processing
Earth sciences
Earth, ocean, space
Econometrics
Economics
Economics and Finance
Eigenvalues
Estimates
Exact sciences and technology
Geographical Information Systems/Cartography
Geologic maps, cartography
Grants
Landscape/Regional and Urban Planning
Maximum likelihood method
Methods
Original Article
Regional/Spatial Science
Regression analysis
Spatial data
Statistical analysis
Studies
Urban Economics
title A sampling approach to estimate the log determinant used in spatial likelihood problems
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-09-22T21%3A27%3A07IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20sampling%20approach%20to%20estimate%20the%20log%20determinant%20used%20in%20spatial%20likelihood%20problems&rft.jtitle=Journal%20of%20geographical%20systems&rft.au=Pace,%20R.%20Kelley&rft.date=2009-09-01&rft.volume=11&rft.issue=3&rft.spage=209&rft.epage=225&rft.pages=209-225&rft.issn=1435-5930&rft.eissn=1435-5949&rft_id=info:doi/10.1007/s10109-009-0087-7&rft_dat=%3Cproquest_cross%3E1827090361%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c451t-e38d40eae0fa113de895fab1dbbce61bac2619f7e501469b61447d2532099e6a3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=230116996&rft_id=info:pmid/&rfr_iscdi=true