Dataset Open Access

2019 EMDataResource Model Metrics Challenge Dataset

Lawson, Catherine L; Kryshtafovych, Andriy; Adams, Paul D; Afonine, Pavel V; Baker, Matthew L; Barad, Benjamin A; Bond, Paul; Burnley, Tom; Cao, Renzhi; Cheng, Jianlin; Chojnowski, Grzegorz; Cowtan, Kevin; Dill, Ken; DiMaio, Frank; Farrell, Daniel P; Fraser, James S; Herzik, Mark A Jr; Hoh, Soon Wen; Hou, Jie; Hung, Li-Wei; Igaev, Maxim; Joseph, Agnel P; Kihara, Daisuke; Kumar, Dilip; Mittal, Sumit; Monastryrskyy, Bohdan; Olek, Mateusz; Palmer, Colin M; Patwardhan, Ardan; Perez, Alberto; Pfab, Jonas; Pintilie, Greg D; Richardson, Jane S; Sarkar, Daipayan; Schäfer, Luisa U; Schmid, Michael F; Schröder, Gunnar F; Shekhar, Mrinal; Si, Dong; Singharoy, Abishek; Terashi, Genki; Terwilliger, Thomas C; Vaiana, Andrea; Wang, Liguo; Wankowicz, Stephanie A; Williams, Christopher J; Winn, Martyn; Wu, Tianqi; Yu, Xiaodi; Zhang, Kaiming; Berman, Helen M; Chiu, Wah


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nmm##2200000uu#4500</leader>
  <datafield tag="041" ind1=" " ind2=" ">
    <subfield code="a">eng</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">cryo-EM</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">model validation</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">3D structure</subfield>
  </datafield>
  <controlfield tag="005">20201104122711.0</controlfield>
  <datafield tag="500" ind1=" " ind2=" ">
    <subfield code="a">EMDataResource is supported by the US National Institutes of Health (NIH)/National Institute of General Medical Science, R01GM079429.
The following additional grants are acknowledged for participant support. 
JSR and CW: NIH/ R35GM131883.
PDA, PVA, L-WH, JSR, TCT and CW: NIH/P01GM063210.
AS: National Science Foundation (NSF)/MCB-1942763 (CAREER), NIH/R01GM095583. The Singharoy team used supercomputing resources of the OLCF at the Oak Ridge National Laboratory, which is supported by the Office of Science at DOE under Contract No. DE-AC05-00OR22725.
DKihara: NIH/R01GM123055, NIH/R01GM133840, NSF/DMS1614777, NSF/CMMI1825941, NSF/MCB1925643, NSF/DBI2003635, Purdue Institute of Drug Discovery.
JSF: NIH/R01GM123159.
MI: Max Planck Society German Research Foundation/IG 109/1-1.
ACV: Max Planck Society German Research Foundation /FOR-1805.
DKumar: NIH/R37AI36040 and Welch Foundation/Q1279 (PI: BVV Prasad).
DS: NSF/DBI2030381.
TB, CMP, MW: Medical Research Council MR/N009614/1.
APJ, MW: Wellcome Trust 208398/Z/17/Z.
KC: Biotechnology and Biological Sciences Research Council BB/P000517/1.
MW: Biotechnology and Biological Sciences Research Council BB/P000975/1.</subfield>
  </datafield>
  <controlfield tag="001">4148789</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of California Davis</subfield>
    <subfield code="0">(orcid)0000-0001-5066-7178</subfield>
    <subfield code="a">Kryshtafovych, Andriy</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Lawrence Berkeley Laboratory</subfield>
    <subfield code="0">(orcid)0000-0001-9333-8219</subfield>
    <subfield code="a">Adams, Paul D</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Lawrence Berkeley Laboratory</subfield>
    <subfield code="0">(orcid)0000-0002-5052-991X</subfield>
    <subfield code="a">Afonine, Pavel V</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Texas Health Science Center</subfield>
    <subfield code="0">(orcid)0000-0001-9039-8523</subfield>
    <subfield code="a">Baker, Matthew L</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Scripps Research Institute, La Jolla</subfield>
    <subfield code="0">(orcid)0000-0002-1016-862X</subfield>
    <subfield code="a">Barad, Benjamin A</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of York</subfield>
    <subfield code="0">(orcid)0000-0002-8465-4823</subfield>
    <subfield code="a">Bond, Paul</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">UKRI Science and Technology Facilities Council</subfield>
    <subfield code="0">(orcid)0000-0001-5307-348X</subfield>
    <subfield code="a">Burnley, Tom</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Pacific Lutheran University</subfield>
    <subfield code="0">(orcid)0000-0002-8345-343X</subfield>
    <subfield code="a">Cao, Renzhi</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Missouri</subfield>
    <subfield code="0">(orcid)0000-0003-0305-2853</subfield>
    <subfield code="a">Cheng, Jianlin</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">European Molecular Biology Laboratory</subfield>
    <subfield code="0">(orcid)0000-0002-3796-8352</subfield>
    <subfield code="a">Chojnowski, Grzegorz</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of York</subfield>
    <subfield code="0">(orcid)0000-0002-0189-1437</subfield>
    <subfield code="a">Cowtan, Kevin</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Stony Brook University</subfield>
    <subfield code="0">(orcid)0000-0002-2390-2002</subfield>
    <subfield code="a">Dill, Ken</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Washington Seattle</subfield>
    <subfield code="0">(orcid)0000-0002-7524-8938</subfield>
    <subfield code="a">DiMaio, Frank</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Washington Seattle</subfield>
    <subfield code="0">(orcid)0000-0001-7024-7998</subfield>
    <subfield code="a">Farrell, Daniel P</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of California San Francisco</subfield>
    <subfield code="0">(orcid)0000-0002-5080-2859</subfield>
    <subfield code="a">Fraser, James S</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of California San Diego</subfield>
    <subfield code="0">(orcid)0000-0001-6653-6682</subfield>
    <subfield code="a">Herzik, Mark A Jr</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of York</subfield>
    <subfield code="0">(orcid)0000-0003-1039-8000</subfield>
    <subfield code="a">Hoh, Soon Wen</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Saint Louis University</subfield>
    <subfield code="0">(orcid)0000-0002-8584-5154</subfield>
    <subfield code="a">Hou, Jie</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Los Alamos National Laboratory</subfield>
    <subfield code="0">(orcid)0000-0001-6690-8458</subfield>
    <subfield code="a">Hung, Li-Wei</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Max Planck Institute for Biophysical Chemistry</subfield>
    <subfield code="0">(orcid)0000-0001-8781-1604</subfield>
    <subfield code="a">Igaev, Maxim</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">UKRI Science and Technology Facilities Council</subfield>
    <subfield code="0">(orcid)0000-0002-0997-8422</subfield>
    <subfield code="a">Joseph, Agnel P</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Purdue University</subfield>
    <subfield code="0">(orcid)0000-0003-4091-6614</subfield>
    <subfield code="a">Kihara, Daisuke</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Baylor College of Medicine</subfield>
    <subfield code="0">(orcid)0000-0002-2721-678X</subfield>
    <subfield code="a">Kumar, Dilip</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Arizona State University</subfield>
    <subfield code="a">Mittal, Sumit</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of California Davis</subfield>
    <subfield code="0">(orcid)0000-0002-4803-0378</subfield>
    <subfield code="a">Monastryrskyy, Bohdan</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of York</subfield>
    <subfield code="0">(orcid)0000-0002-6347-9587</subfield>
    <subfield code="a">Olek, Mateusz</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">UKRI Science and Technology Facilities Council</subfield>
    <subfield code="0">(orcid)0000-0002-4883-1546</subfield>
    <subfield code="a">Palmer, Colin M</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">European Bioinformatics Institute</subfield>
    <subfield code="0">(orcid)0000-0001-7663-9028</subfield>
    <subfield code="a">Patwardhan, Ardan</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Florida</subfield>
    <subfield code="0">(orcid)0000-0002-5054-5338</subfield>
    <subfield code="a">Perez, Alberto</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Washington Bothell</subfield>
    <subfield code="0">(orcid)0000-0002-8285-571X</subfield>
    <subfield code="a">Pfab, Jonas</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Stanford University</subfield>
    <subfield code="0">(orcid)0000-0002-0848-5335</subfield>
    <subfield code="a">Pintilie, Greg D</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Duke University</subfield>
    <subfield code="0">(orcid)0000-0002-3311-2944</subfield>
    <subfield code="a">Richardson, Jane S</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Purdue University</subfield>
    <subfield code="0">(orcid)0000-0002-4167-2108</subfield>
    <subfield code="a">Sarkar, Daipayan</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Forschungszentrum Jülich</subfield>
    <subfield code="0">(orcid)0000-0002-8481-6298</subfield>
    <subfield code="a">Schäfer, Luisa U</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Stanford University</subfield>
    <subfield code="0">(orcid)0000-0003-1077-5750</subfield>
    <subfield code="a">Schmid, Michael F</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Heinrich Heine University Düsseldorf</subfield>
    <subfield code="0">(orcid)0000-0003-1803-5431</subfield>
    <subfield code="a">Schröder, Gunnar F</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Broad Institute of MIT and Harvard</subfield>
    <subfield code="a">Shekhar, Mrinal</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Washington Bothell</subfield>
    <subfield code="0">(orcid)0000-0001-7039-2589</subfield>
    <subfield code="a">Si, Dong</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Arizona State University</subfield>
    <subfield code="0">(orcid)0000-0002-9000-2397</subfield>
    <subfield code="a">Singharoy, Abishek</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Purdue University</subfield>
    <subfield code="0">(orcid)0000-0002-5339-909X</subfield>
    <subfield code="a">Terashi, Genki</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">New Mexico Consortium</subfield>
    <subfield code="0">(orcid)0000-0001-6384-0320</subfield>
    <subfield code="a">Terwilliger, Thomas C</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Max Planck Institute for Biophysical Chemistry</subfield>
    <subfield code="0">(orcid)0000-0002-8865-0651</subfield>
    <subfield code="a">Vaiana, Andrea</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Washington Seattle</subfield>
    <subfield code="0">(orcid)0000-0002-7095-5983</subfield>
    <subfield code="a">Wang, Liguo</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of California San Francisco</subfield>
    <subfield code="0">(orcid)0000-0002-4225-7459</subfield>
    <subfield code="a">Wankowicz, Stephanie A</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Duke University</subfield>
    <subfield code="0">(orcid)0000-0002-5808-8768</subfield>
    <subfield code="a">Williams, Christopher J</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">UKRI Science and Technology Facilities Council</subfield>
    <subfield code="0">(orcid)0000-0003-0496-6796</subfield>
    <subfield code="a">Winn, Martyn</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Missouri</subfield>
    <subfield code="0">(orcid)0000-0002-1545-3462</subfield>
    <subfield code="a">Wu, Tianqi</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Janssen Research and Development</subfield>
    <subfield code="0">(orcid)0000-0001-7520-0646</subfield>
    <subfield code="a">Yu, Xiaodi</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Stanford University</subfield>
    <subfield code="0">(orcid)0000-0003-0414-4776</subfield>
    <subfield code="a">Zhang, Kaiming</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Rutgers University</subfield>
    <subfield code="0">(orcid)0000-0002-3337-0660</subfield>
    <subfield code="a">Berman, Helen M</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Stanford University</subfield>
    <subfield code="0">(orcid)0000-0002-8910-3078</subfield>
    <subfield code="a">Chiu, Wah</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">726520</subfield>
    <subfield code="z">md5:6c38dac86fc27b0ce976b4fe46297f18</subfield>
    <subfield code="u">https://zenodo.org/record/4148789/files/2019-EMDataResource-Challenge-web.pdf</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">730578</subfield>
    <subfield code="z">md5:53b53791192cf5095a6fc26d3cf268f1</subfield>
    <subfield code="u">https://zenodo.org/record/4148789/files/correlation-images.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">187501048</subfield>
    <subfield code="z">md5:17cad0e8d75c05310114425877384dec</subfield>
    <subfield code="u">https://zenodo.org/record/4148789/files/maps.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">4534264</subfield>
    <subfield code="z">md5:54e75cf33147d4d30c1ba6705e0ae534</subfield>
    <subfield code="u">https://zenodo.org/record/4148789/files/models.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">77201237</subfield>
    <subfield code="z">md5:e0a8091dd3a1b527b38a7715a58c50e9</subfield>
    <subfield code="u">https://zenodo.org/record/4148789/files/results.tar.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">45286</subfield>
    <subfield code="z">md5:714f60634c66c3b8ac0eda6ce0e5d1a1</subfield>
    <subfield code="u">https://zenodo.org/record/4148789/files/Scores.xlsx</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">201002</subfield>
    <subfield code="z">md5:ffc0df64d3e54d18b4530b21399f34c2</subfield>
    <subfield code="u">https://zenodo.org/record/4148789/files/targets.tar.gz</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2020-10-28</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire_data</subfield>
    <subfield code="p">user-3dcryoemchallenges</subfield>
    <subfield code="o">oai:zenodo.org:4148789</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">Rutgers University</subfield>
    <subfield code="0">(orcid)0000-0002-3261-7035</subfield>
    <subfield code="a">Lawson, Catherine L</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">2019 EMDataResource Model Metrics Challenge Dataset</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-3dcryoemchallenges</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">https://creativecommons.org/licenses/by/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;This is the full dataset of the 2019 Cryo-EM Map-based Model Metrics Challenge sponsored by EMDataResource (&lt;a href="http://www.emdataresource.org"&gt;www.emdataresource.org&lt;/a&gt;, &lt;a href="http://challenges.emdataresource.org"&gt;challenges.emdataresource.org&lt;/a&gt;, &lt;a href="http://model-compare.emdataresource.org"&gt;model-compare.emdataresource.org&lt;/a&gt;). The goals of this challenge were (1) to assess the quality of models that can be produced using current modeling software, (2) to check the reproducibility of modeling results from different software developers and users, and (3) compare the performance of current metrics used for evaluation of models. The focus was on near-atomic resolution maps with an innovative twist: three of four target maps formed a resolution series (1.8 to 3.1 &amp;Aring;) from the same specimen and imaging experiment. Tools developed in previous challenges were expanded for managing, visualizing and analyzing the 63 submitted coordinate models, and several new metrics were introduced.&lt;/p&gt;

&lt;p&gt;File Descriptions:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;2019-EMDataResource-Challenge-web.pdf: Archive of News, Goals, Timeline, Targets, Modelling Instructions, Process, FAQ, Submission Instructions, Submission Summary Statistics source from the &lt;a href="https://challenges.emdataresource.org"&gt;EMDR Challenges&lt;/a&gt; website&lt;/li&gt;
	&lt;li&gt;correlation-images.tar.gz: Pairwise correlation tables for selected metric scores from the &lt;a href="https://model-compare.emdataresource.org"&gt;EMDR Model Compare&lt;/a&gt; website&lt;/li&gt;
	&lt;li&gt;maps.tar.gz: The maps used for Fit-to-Map analyses in the Challenge&lt;/li&gt;
	&lt;li&gt;models.tar.gz: The 63 models submitted by the modelling teams&lt;/li&gt;
	&lt;li&gt;results.tar.gz: The output logs for all of the analysis methods&lt;/li&gt;
	&lt;li&gt;Scores.xlsx: Scores for each model and analysis method, compiled into spreadsheet format&lt;/li&gt;
	&lt;li&gt;targets.tar.gz: The reference models used in the analysis&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Post submission correction to the web archive PDF document: The full list of EMDataResource members on the model committee is as follows: Cathy Lawson, Andriy Kryshtafovych, Greg Pintilie, Mike Schmid, Helen Berman, Wah Chiu.&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.4148788</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.4148789</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">dataset</subfield>
  </datafield>
</record>
290
177
views
downloads
All versions This version
Views 290290
Downloads 177177
Data volume 2.0 GB2.0 GB
Unique views 258258
Unique downloads 136136

Share

Cite as