<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "https://jats.nlm.nih.gov/publishing/1.1/JATS-journalpublishing1.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.1" specific-use="sps-1.9" xml:lang="pt">
  <front>
    <journal-meta>
      <journal-id journal-id-type="nlm-ta">Arq Bras Cardiol</journal-id>
      <journal-id journal-id-type="publisher-id">abc</journal-id>
      <journal-title-group>
        <journal-title>Arquivos Brasileiros de Cardiologia</journal-title>
        <abbrev-journal-title abbrev-type="publisher">Arq. Bras. Cardiol.</abbrev-journal-title>
      </journal-title-group>
      <issn pub-type="ppub">0066-782X</issn>
      <issn pub-type="epub">1678-4170</issn>
      <publisher>
        <publisher-name>Sociedade Brasileira de Cardiologia - SBC</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="publisher-id" specific-use="scielo-v3">6QJhpDZwWqmjvmfZpbfVZMR</article-id>
      <article-id pub-id-type="publisher-id" specific-use="scielo-v2">S0066-782X2020000600795</article-id>
      <article-id pub-id-type="publisher-id" specific-use="previous-pid">S0066-782X2020005004204</article-id>
      <article-id pub-id-type="publisher-id">abc.20190206</article-id>
      <article-id pub-id-type="doi">10.36660/abc.20190206</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Artigo Original</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Os Escores HEART, TIMI e GRACE para Predi&#231;&#227;o de Eventos Cardiovasculares Adversos Maiores no Per&#237;odo de 30 Dias na Era de Troponina I de Alta Sensibilidade</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0002-6470-6737</contrib-id>
          <name>
            <surname>Torralba</surname>
            <given-names>Felipe</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Navarro</surname>
            <given-names>Alberto</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>la Hoz</surname>
            <given-names>Juan Castellanos-de</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0001-9513-9897</contrib-id>
          <name>
            <surname>Ortiz</surname>
            <given-names>Carlos</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Botero</surname>
            <given-names>Alberth</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Alarc&#243;n</surname>
            <given-names>Freddy</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0002-9915-1831</contrib-id>
          <name>
            <surname>Isaza</surname>
            <given-names>Nicolas</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Isaza</surname>
            <given-names>Daniel</given-names>
          </name>
          <xref ref-type="aff" rid="aff1">
            <sup>1</sup>
          </xref>
        </contrib>
      </contrib-group>
      <aff id="aff1">
        <label>1</label>
        <institution content-type="orgname">Fundacion Cardioinfantil Instituto de Cardiologia</institution>
        <addr-line>
          <named-content content-type="city">Bogota Cundinamarca</named-content>
        </addr-line>
        <country country="CO">Col&#244;mbia</country>
        <institution content-type="original">Fundacion Cardioinfantil Instituto de Cardiologia, Bogota Cundinamarca - Col&#244;mbia</institution>
      </aff>
      <author-notes>
        <corresp id="c01"> Correspond&#234;ncia: Felipe Torralba <bold>&#8226;</bold> Fundacion Cardioinfantil Instituto de Cardiologia - ak19#128b66 402 Bogota, Cundinamarca, 111121 &#8211; Col&#244;mbia E-mail: <email>feliptorr1@gmail.com</email>
				</corresp>
        <fn fn-type="con">
          <p>Contribui&#231;&#227;o dos autores</p>
          <p>Concep&#231;&#227;o e desenho da pesquisa: Torralba F, Navarro A, Ortiz C; Obten&#231;&#227;o de dados: Torralba F, Navarro A, Botero A, Alarc&#243;n F; An&#225;lise e interpreta&#231;&#227;o dos dados: Torralba F, Castellanos JC, Botero A, Alarc&#243;n F, Isaza N, Isaza D; An&#225;lise estat&#237;stica: Castellanos JC; Reda&#231;&#227;o do manuscrito: Torralba F, Navarro A, Ortiz C, Isaza N, Isaza D; Revis&#227;o cr&#237;tica do manuscrito quanto ao conte&#250;do intelectual importante: Torralba F, Navarro A, Castellanos JC, Ortiz C, Isaza N, Isaza D.</p>
        </fn>
        <fn fn-type="conflict">
          <p>Potencial conflito de interesses</p>
          <p>Declaro n&#227;o haver conflito de interesses pertinentes.</p>
        </fn>
      </author-notes>
      <pub-date date-type="pub" publication-format="electronic">
        <day>13</day>
        <month>03</month>
        <year>2020</year>
      </pub-date>
      <pub-date date-type="collection" publication-format="electronic">
        <month>05</month>
        <year>2020</year>
      </pub-date>
      <volume>114</volume>
      <issue>5</issue>
      <fpage>795</fpage>
      <lpage>802</lpage>
      <history>
        <date date-type="received">
          <day>22</day>
          <month>03</month>
          <year>2019</year>
        </date>
        <date date-type="rev-recd">
          <day>02</day>
          <month>06</month>
          <year>2019</year>
        </date>
        <date date-type="accepted">
          <day>17</day>
          <month>07</month>
          <year>2019</year>
        </date>
      </history>
      <permissions>
        <license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/" xml:lang="en">
          <license-p> This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. </license-p>
        </license>
      </permissions>
      <abstract>
        <title>Resumo</title>
        <sec>
          <title>Fundamento</title>
          <p> M&#250;ltiplos sistemas de pontua&#231;&#227;o t&#234;m sido elaborados para calcular o risco de eventos cardiovasculares adversos maiores (MACE) em pacientes com dor no peito. N&#227;o h&#225; dados que avaliem se o escore HEART tem um desempenho superior a TIMI e GRACE para a predi&#231;&#227;o de MACE, especialmente na era de troponina I de alta sensibilidade e em uma popula&#231;&#227;o exclusivamente latino-americana.</p>
        </sec>
        <sec>
          <title>Objetivo</title>
          <p> Comparar o desempenho dos escores HEART, TIMI e GRACE para a predi&#231;&#227;o de MACE em 30 dias de acompanhamento, em pacientes atendidos com dor no peito no departamento de emerg&#234;ncia.</p>
        </sec>
        <sec>
          <title>M&#233;todos</title>
          <p> Os escores HEART, TIMI e GRACE foram analisados em 519 pacientes com dor no peito no departamento de emerg&#234;ncia. O desfecho prim&#225;rio foi a ocorr&#234;ncia de MACE no per&#237;odo de 30 dias. O desempenho do escore HEART foi comparado com o dos escores TIMI e GRACE utilizando o teste de DeLong, considerando estatisticamente significativos os valores de p de 0,05.</p>
        </sec>
        <sec>
          <title>Resultados</title>
          <p> Um total de 224 pacientes (43%) apresentaram MACE no per&#237;odo de 30 dias. A estat&#237;stica C para os escores HEART, TIMI e GRACE foi de 0,937, 0,844 e 0,797 respectivamente (p &lt; 0,0001). Uma pontua&#231;&#227;o de 3 ou menos no escore HEART apresentou uma sensibilidade de 99,5% e um valor preditivo negativo de 99% para classificar pacientes de baixo risco de maneira correta; ambos os valores foram mais elevados do que aqueles obtidos pelos outros escores.</p>
        </sec>
        <sec>
          <title>Conclus&#227;o</title>
          <p> O escore HEART, em um per&#237;odo de 30 dias, prediz eventos cardiovasculares, mais eficazmente, em compara&#231;&#227;o com os outros escores. Troponinas de alta sensibilidade mant&#234;m a superioridade previamente demonstrada deste escore. Este escore oferece uma identifica&#231;&#227;o mais precisa dos pacientes de baixo risco. (Arq Bras Cardiol. 2020; [online].ahead print, PP.0-0)</p>
        </sec>
      </abstract>
      <kwd-group xml:lang="pt">
        <kwd>Doen&#231;as Cardiovasculares/mortalidade</kwd>
        <kwd>Dor no Peito</kwd>
        <kwd>Infarto do Mioc&#225;rdio</kwd>
        <kwd>Predi&#231;&#227;o</kwd>
        <kwd>Medi&#231;&#227;o de Risco</kwd>
        <kwd>Fatores de Risco</kwd>
        <kwd>Troponina</kwd>
        <kwd>Isquemia Mioc&#225;rdica</kwd>
      </kwd-group>
      <counts>
        <fig-count count="6"/>
        <table-count count="6"/>
        <equation-count count="0"/>
        <ref-count count="25"/>
      </counts>
    </article-meta>
  </front>
  <body>
    <sec sec-type="intro">
      <title>Introdu&#231;&#227;o</title>
      <p>A dor no peito &#233; uma das queixas mais comuns em pacientes que s&#227;o atendidos no departamento de emerg&#234;ncia, com aproximadamente 15 milh&#245;es de consultas nos Estados Unidos e na Europa.<sup><xref ref-type="bibr" rid="B1">1</xref></sup> Estima-se que 55% destes pacientes tenham uma causa n&#227;o card&#237;aca para a dor no peito e que apenas um quinto seja definitivamente diagnosticado com s&#237;ndromes coron&#225;rias agudas.<sup><xref ref-type="bibr" rid="B1">1</xref> , <xref ref-type="bibr" rid="B2">2</xref></sup> Aproximadamente 85% dos pacientes com dor no peito s&#227;o internados, embora at&#233; 60% dos casos pudessem ser tratados no ambulat&#243;rio.<sup><xref ref-type="bibr" rid="B3">3</xref></sup></p>
      <p>Na Col&#244;mbia, as doen&#231;as cardiovasculares tamb&#233;m s&#227;o uma causa de alta mortalidade; entre essas, a cardiopatia isqu&#234;mica foi a causa principal durante a d&#233;cada anterior, correspondendo a 49,5% do total desse grupo.<sup><xref ref-type="bibr" rid="B4">4</xref> , <xref ref-type="bibr" rid="B5">5</xref></sup> Os custos anuais do tratamento de pacientes com dor no peito de causas n&#227;o card&#237;acas podem chegar at&#233; 8 bilh&#245;es de d&#243;lares nos EUA e a aproximadamente 3,9 bilh&#245;es de d&#243;lares na Col&#244;mbia.<sup><xref ref-type="bibr" rid="B6">6</xref></sup> Estas despesas originam-se principalmente dos custos-leito di&#225;rios e dos estudos radiol&#243;gicos e laboratoriais.<sup><xref ref-type="bibr" rid="B2">2</xref> , <xref ref-type="bibr" rid="B7">7</xref> , <xref ref-type="bibr" rid="B8">8</xref></sup> Este impacto econ&#244;mico significativo tem incentivado esfor&#231;os para desenvolver alternativas que possibilitem o uso mais eficiente de recursos, sobretudo em pa&#237;ses com or&#231;amentos de sa&#250;de limitados.<sup><xref ref-type="bibr" rid="B3">3</xref> , <xref ref-type="bibr" rid="B8">8</xref> , <xref ref-type="bibr" rid="B9">9</xref></sup></p>
      <p>O desenvolvimento de uma ferramenta para determinar, com precis&#227;o, o risco de eventos cardiovasculares adversos maiores (MACE) nestes pacientes &#233; essencial, e sistemas de pontua&#231;&#227;o como o TIMI e o GRACE foram criados para enfrentar este problema.<sup><xref ref-type="bibr" rid="B10">10</xref> , <xref ref-type="bibr" rid="B11">11</xref></sup> Mais recentemente, o escore HEART foi criado, sendo o primeiro que foi projetado de maneira prospectiva para predizer MACE.<sup><xref ref-type="bibr" rid="B12">12</xref> - <xref ref-type="bibr" rid="B14">14</xref></sup></p>
      <p>O escore HEART superou os escores TIMI e GRACE em popula&#231;&#245;es asi&#225;ticas, europeias e norte-americanas.<sup><xref ref-type="bibr" rid="B11">11</xref> , <xref ref-type="bibr" rid="B15">15</xref></sup> O presente estudo visou comparar a precis&#227;o destes escores para predizer MACE em um grupo de pacientes latino-americanos com dor no peito que foram atendidos em um centro de refer&#234;ncia cardiovascular. At&#233; onde sabemos, este &#233; o primeiro estudo prospectivo desse tipo.</p>
    </sec>
    <sec sec-type="methods">
      <title>M&#233;todos</title>
      <p>Trata-se de um estudo prospectivo observacional de testes diagn&#243;sticos realizados na Fundaci&#243;n Cardioinfantil, localizada em Bogot&#225;, Col&#244;mbia. &#201; um hospital de alta complexidade, especializado em medicina cardiovascular, com uma m&#233;dia mensal de 9.000 consultas de emerg&#234;ncia, 15% das quais correspondem a emerg&#234;ncias cardiovasculares.</p>
      <p>Foram inclu&#237;dos no estudo os pacientes com idade superior a 18 anos que foram atendidos no departamento de emerg&#234;ncia com dor aguda no peito entre agosto de 2017 e fevereiro de 2018. De acordo com o protocolo institucional, os pacientes foram avaliados pelo cardiologista; foi realizada a eletrocardiografia, e foi medida a troponina I de alta sensibilidade (TnI-as) inicialmente e 3 ap&#243;s horas, caso necess&#225;rio, utilizando ARCHITECT STAT assay (Abbot, Lake Bluff, IL, EUA).</p>
      <p>Foi diagnosticado infarto agudo do mioc&#225;rdio (IAM) quando os valores de TnI-as foram superiores a 0,026 ng/mL (valor de refer&#234;ncia 0,0 &#8211; 0,026 ng/ml). Neste caso, os pacientes foram internados para atendimento hospitalar, arteriografia coronariana e revasculariza&#231;&#227;o percut&#226;nea ou cir&#250;rgica. Quando os valores foram negativos, mas a dor foi considerada de probabilidade intermedi&#225;ria ou alta, os pacientes foram internados para avalia&#231;&#227;o subsequente com uma estrat&#233;gia de estratifica&#231;&#227;o n&#227;o invasiva.</p>
      <p>Foram exclu&#237;dos do estudo os pacientes com infarto do mioc&#225;rdio com eleva&#231;&#227;o do segmento ST e causas n&#227;o card&#237;acas de dor no peito, tais como pneumonia, trauma ou dor psicog&#234;nica.</p>
      <p>Foram calculados os escores HEART, TIMI e GRACE para este grupo de pacientes no momento da consulta.</p>
      <sec>
        <title>Escores de risco</title>
        <p>Os m&#233;todos para calcular os escores GRACE, TIMI e HEART foram descritos em artigos pr&#233;vios e estar&#227;o resumidos em breve.<sup><xref ref-type="bibr" rid="B14">14</xref> , <xref ref-type="bibr" rid="B16">16</xref> , <xref ref-type="bibr" rid="B17">17</xref></sup> Foram realizados os c&#225;lculos dos escores utilizando as informa&#231;&#245;es dispostas no registro m&#233;dico eletr&#244;nico, o primeiro electrocardiograma no momento de apresenta&#231;&#227;o e os primeiros valores laboratoriais medidos, incluindo a medi&#231;&#227;o da troponina com a dosagem de TnI-as.</p>
        <p>O escore HEART consiste nas seguintes 5 vari&#225;veis categ&#243;ricas: hist&#243;rico m&#233;dico do paciente, eletrocardiograma, idade, fatores de risco para doen&#231;a card&#237;aca coron&#225;ria e troponina. Cada vari&#225;vel possui um valor m&#225;ximo de 2 pontos, correspondendo a uma pontua&#231;&#227;o m&#225;xima de 10, a qual indica um paciente com risco m&#225;ximo. O escore GRACE consiste nas seguintes 5 vari&#225;veis categ&#243;ricas: idade, frequ&#234;ncia card&#237;aca, press&#227;o arterial, creatinina e classe Killip; e as seguintes 3 vari&#225;veis nominais: parada card&#237;aca, desvio do segmento ST e eleva&#231;&#227;o da troponina. Cada item corresponde a um valor, e a soma desses valores determina o risco de MACE. Finalmente, o escore TIMI consiste nas seguintes 7 vari&#225;veis nominais dicot&#244;micas: idade acima de 65 anos, mais de 3 fatores de risco para doen&#231;a arterial coronariana, estenose arterial coronariana significativa, sintomas de angina grave, desvio do segmento ST, uso de aspirina durante a &#250;ltima semana e eleva&#231;&#227;o da troponina. A pontua&#231;&#227;o m&#225;xima do TIMI &#233; 7, pontua&#231;&#245;es mais altas indicando riscos mais altos.</p>
      </sec>
      <sec>
        <title>&#201;tica</title>
        <p>O estudo foi realizado de acordo com os princ&#237;pios estabelecidos na Declara&#231;&#227;o de Helsinki da Associa&#231;&#227;o M&#233;dica Mundial, o C&#243;digo de Nuremberg e as Diretrizes Internacionais para pesquisa envolvendo seres humanos da Organiza&#231;&#227;o Mundial da Sa&#250;de, bem como com as regula&#231;&#245;es nacionais relacionados a cuidados b&#225;sicos em sa&#250;de. O estudo foi aprovado pelo comit&#234; de &#233;tica e pesquisa da Fundaci&#243;n Cardioinfantil e os pacientes inclu&#237;dos neste estudo forneceram o seu consentimento informado esclarecido.</p>
      </sec>
      <sec>
        <title>Gerenciamento dos dados</title>
        <p>Os dados inclu&#237;ram as informa&#231;&#245;es demogr&#225;ficas dos pacientes e as informa&#231;&#245;es sobre hist&#243;rico cl&#237;nico, valores laboratoriais, achados eletrocardiogr&#225;ficos e sinais vitais.</p>
        <p>Os valores laboratoriais inclu&#237;ram creatinina e TnI-as, sendo os exames atualmente aplicados pelo protocolo institucional.</p>
        <p>O cardiologista assistente avaliou o eletrocardiograma de 12 deriva&#231;&#245;es de acordo com as diretrizes da American Heart Association.<sup><xref ref-type="bibr" rid="B18">18</xref></sup> Quando necess&#225;rio, o exame foi submetido a um segundo cardiologista cego para avalia&#231;&#227;o.</p>
        <p>Foi criado um banco de dados criptografado ao qual somente os autores do estudo tiveram acesso, e foi desenvolvido um algoritmo para o c&#225;lculo autom&#225;tico dos escores de risco.</p>
      </sec>
      <sec>
        <title>Acompanhamento</title>
        <p>O acompanhamento foi realizado no 30&#186; dia, revisando-se o registro m&#233;dico eletr&#244;nico e empregando uma pesquisa telef&#244;nica. Foi aplicado um formato estruturado com 4 perguntas claras sobre a ocorr&#234;ncia de eventos cardiovasculares importantes (morte, infarto do mioc&#225;rdio, revasculariza&#231;&#227;o cir&#250;rgica ou revasculariza&#231;&#227;o percut&#226;nea), para determinar a presen&#231;a do desfecho prim&#225;rio.</p>
      </sec>
      <sec>
        <title>Desfechos</title>
        <p>Foi diagnosticado IAM quando os valores de troponina foram acima do percentil 99 dos valores de refer&#234;ncia (TnI-as &gt; 0,026 ng/mL) e evid&#234;ncia de isquemia mioc&#225;rdica foi documentada no eletrocardiograma. Foram aplicados os crit&#233;rios descritos pela terceira defini&#231;&#227;o universal de IAM, a qual era v&#225;lida no momento da elabora&#231;&#227;o do protocolo.<sup><xref ref-type="bibr" rid="B19">19</xref></sup> Tamb&#233;m foram definidos o infarto do mioc&#225;rdio com eleva&#231;&#227;o do segmento ST (IMCST), o infarto do mioc&#225;rdio sem eleva&#231;&#227;o do segmento ST (IMSST) e sinais de isquemia de acordo com as diretrizes validadas no momento da elabora&#231;&#227;o do protocolo.<sup><xref ref-type="bibr" rid="B20">20</xref></sup></p>
        <p>A revasculariza&#231;&#227;o percut&#226;nea foi definida como qualquer interven&#231;&#227;o por meio de um cateter nas art&#233;rias coron&#225;rias e a revasculariza&#231;&#227;o cir&#250;rgica foi definida como qualquer cirurgia card&#237;aca na qual enxertos de art&#233;ria coron&#225;ria foram realizados. MACE foram definidos como morte por qualquer causa, infarto do mioc&#225;rdio e cirurgia ou revasculariza&#231;&#227;o percut&#226;nea. Foi conclu&#237;do o acompanhamento 30 dias ap&#243;s a interna&#231;&#227;o no departamento de emerg&#234;ncia.</p>
      </sec>
      <sec>
        <title>An&#225;lise estat&#237;stica</title>
        <p>N&#243;s calculamos uma amostra de 550 pacientes, para obter 185 MACE utilizando o m&#233;todo de sensibilidade m&#225;xima de Simel e Samsa,<sup><xref ref-type="bibr" rid="B21">21</xref></sup> com a finalidade de ter uma pot&#234;ncia de 80% e um intervalo de confian&#231;a de 95% com um erro alfa de 5%. Para cada escore, o melhor valor de corte foi calculado utilizando a &#237;ndice de Youden,<sup><xref ref-type="bibr" rid="B22">22</xref></sup> considerando significativos os valores de p de 0,05. Subsequentemente, foram calculadas a estat&#237;stica C, a raz&#227;o de verossimilhan&#231;a (RV) positiva e negativa, a sensibilidade e a especificidade. Em seguida, a RV foi calculada para cada estrato de risco. Foi calculada a diferen&#231;a entre as RV utilizando o teste para propor&#231;&#245;es binomiais adequadas (o teste de qui-quadrado e o teste exato de Fisher), considerando significativos os valores de p de 0,05.</p>
        <p>A &#225;rea sob a curva para cada teste foi calculada e comparada utilizando o teste n&#227;o param&#233;trico de DeLong (p = 0,05). Por fim, tamb&#233;m foi realizado um teste de calibra&#231;&#227;o para cada escore para comparar os MACE esperados e reais na popula&#231;&#227;o estudada, de acordo com o m&#233;todo do cinto de calibra&#231;&#227;o descrito por Finazzi S, et al.,<sup><xref ref-type="bibr" rid="B23">23</xref></sup> do Italian Group for the Evaluation of Interventions in Intensive Care Medicine (GiViTi).<sup><xref ref-type="bibr" rid="B23">23</xref></sup></p>
        <p>A an&#225;lise foi realizada utilizando-se o programa estat&#237;stico R, vers&#227;o 3.3.3 (the R Foundation for Statistical Computing, Viena, &#193;ustria).</p>
      </sec>
    </sec>
    <sec sec-type="results">
      <title>Resultados</title>
      <p>Os pacientes foram recrutados entre agosto de 2017 e fevereiro de 2018. O fluxo de pacientes do presente estudo est&#225; apresentado na <xref ref-type="fig" rid="f01">Figura 1</xref> .</p>
      <p>
        <fig id="f01">
          <label>Figura 1</label>
          <caption>
            <title>&#8211; <italic>Pacientes do estudo.</italic></title>
          </caption>
          <graphic xlink:href="1678-4170-abc-114-05-0795-90206-gf01.jpg"/></fig>
      </p>
      <p>Em total, foram inclu&#237;dos 519 pacientes na an&#225;lise, com um per&#237;odo de acompanhamento de 30 dias. As caracter&#237;sticas de base dos pacientes est&#227;o apresentadas na <xref ref-type="table" rid="t1">Tabela 1</xref> . MACE foram confirmadas em 224 pacientes durante os primeiros 30 dias de acompanhamento, com um total de 351 eventos (IAM, revasculariza&#231;&#227;o ou morte), correspondendo a uma incid&#234;ncia de MACE de 43% e uma m&#233;dia de 1,56 MACE por paciente com o desfecho prim&#225;rio. Foi diagnosticado o IMSST em 194 pacientes. Destes, 108 foram submetidos a revasculariza&#231;&#227;o percut&#226;nea; 46 foram submetidos a revasculariza&#231;&#227;o cir&#250;rgica e 3 morreram.</p>
      <p>
        <table-wrap id="t1">
          <label>Tabela 1</label>
          <caption>
            <title>&#8211; Caracter&#237;sticas da popula&#231;&#227;o de pacientes com e sem eventos cardiovasculares no per&#237;odo de 30 dias</title>
          </caption>
          <table frame="hsides" rules="groups">
            <colgroup width="25%">
              <col/>
              <col/>
              <col/>
              <col/>
            </colgroup>
            <thead>
              <tr>
                <th align="left" style="font-weight:normal">
								</th>
                <th>Popula&#231;&#227;o (n = 519)</th>
                <th>Com MACE (n = 224)</th>
                <th>Sem MACE (n = 295)</th>
              </tr>
            </thead>
            <tbody>
              <tr>
                <td>Idade m&#233;dia (%)</td>
                <td align="center">64,31 (12,11%)</td>
                <td align="center">66,9 (11,69%)</td>
                <td align="center">62,3 (13,7%)</td>
              </tr>
              <tr>
                <td>Sexo masculino, n (%)</td>
                <td align="center">291 (56,06%)</td>
                <td align="center">207 (59,5%)</td>
                <td align="center">84 (40,5%)</td>
              </tr>
              <tr>
                <td>Sem fatores de risco cardiovasculares (IMC &gt; 30, tabagismo, DM2, doen&#231;a arterial coronariana familiar, idade &lt; 55 anos, hipertens&#227;o, hipercolesterolemia)</td>
                <td align="center">64(12,3%)</td>
                <td align="center">40 (40%)</td>
                <td align="center">24 (60%)</td>
              </tr>
              <tr>
                <td>1 &#8211; 2 fatores de risco</td>
                <td align="center">348 (67%)</td>
                <td align="center">247 (70,97%)</td>
                <td align="center">101 (29,02%)</td>
              </tr>
              <tr>
                <td>3 ou mais fatores de risco</td>
                <td align="center">98 (18,8%)</td>
                <td align="center">74 (75,5%)</td>
                <td align="center">24 (24,5%)</td>
              </tr>
              <tr>
                <td>Cardiopatia coron&#225;ria pr&#233;via como o &#250;nico fator de risco</td>
                <td align="center">84 (16,1%)</td>
                <td align="center">61 (72,6%)</td>
                <td align="center">23 (27,3%)</td>
              </tr>
            </tbody>
          </table>
          <table-wrap-foot>
            <fn id="TFN1">
              <p>
                <italic>DM2: diabetes mellitus tipo 2; IMC: &#237;ndice de massa corporal.</italic>
              </p>
            </fn>
          </table-wrap-foot>
        </table-wrap>
      </p>
      <sec>
        <title>Compara&#231;&#227;o dos escores HEART, GRACE e TIMI</title>
        <p>A estratifica&#231;&#227;o de risco para cada escore est&#225; apresentada na <xref ref-type="table" rid="t2">Tabela 2</xref> . Com base no escore HEART, os pacientes nos grupos de risco baixo, intermedi&#225;rio e alto tiveram incid&#234;ncias de MACE de 3,1%, 46,2% e 93,7%, respectivamente. A taxa de MACE no grupo de baixo risco calculado de acordo com o escore HEART foi menor que aquelas apresentadas nos grupos de baixo risco calculados pelos outros dois escores.</p>
        <p>
          <table-wrap id="t2">
            <label>Tabela 2</label>
            <caption>
              <title>&#8211; Ocorr&#234;ncia de MACE (IAM, revasculariza&#231;&#227;o percut&#226;nea, revasculariza&#231;&#227;o cir&#250;rgica ou morte) de acordo com os grupos de risco</title>
            </caption>
            <table frame="hsides" rules="groups">
              <colgroup width="25%">
                <col/>
                <col/>
                <col/>
                <col/>
              </colgroup>
              <thead>
                <tr>
                  <th align="left">Pontua&#231;&#227;o no HEART</th>
                  <th>Pacientes (n)</th>
                  <th>MACE (n)</th>
                  <th>MACE (%)</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td>Baixo (0 &#8211; 3)</td>
                  <td align="center">194</td>
                  <td align="center">6</td>
                  <td align="center">3,1</td>
                </tr>
                <tr>
                  <td>Intermedi&#225;rio (4 &#8211; 6)</td>
                  <td align="center">182</td>
                  <td align="center">84</td>
                  <td align="center">46,2</td>
                </tr>
                <tr>
                  <td>Alto (7 &#8211; 10)</td>
                  <td align="center">143</td>
                  <td align="center">134</td>
                  <td align="center">93,7</td>
                </tr>
                <tr>
                  <td>
                    <bold>Pontua&#231;&#227;o no TIMI</bold>
                  </td>
                  <td>
									</td>
                  <td>
									</td>
                  <td>
									</td>
                </tr>
                <tr>
                  <td>Baixo (1 &#8211; 2)</td>
                  <td align="center">336</td>
                  <td align="center">21</td>
                  <td align="center">10,1</td>
                </tr>
                <tr>
                  <td>Intermedi&#225;rio (3 &#8211; 4)</td>
                  <td align="center">130</td>
                  <td align="center">119</td>
                  <td align="center">55,6</td>
                </tr>
                <tr>
                  <td>Alto (5 &#8211; 7)</td>
                  <td align="center">53</td>
                  <td align="center">84</td>
                  <td align="center">86,6</td>
                </tr>
                <tr>
                  <td>
                    <bold>Pontua&#231;&#227;o no GRACE</bold>
                  </td>
                  <td>
									</td>
                  <td>
									</td>
                  <td>
									</td>
                </tr>
                <tr>
                  <td>Baixo (&lt; 88)</td>
                  <td align="center">183</td>
                  <td align="center">65</td>
                  <td align="center">22,2</td>
                </tr>
                <tr>
                  <td>Intermedi&#225;rio (89 &#8211; 118)</td>
                  <td align="center">165</td>
                  <td align="center">88</td>
                  <td align="center">60,7</td>
                </tr>
                <tr>
                  <td>Alto (&gt; 118)</td>
                  <td align="center">171</td>
                  <td align="center">71</td>
                  <td align="center">87,7</td>
                </tr>
              </tbody>
            </table>
            <table-wrap-foot>
              <fn id="TFN2">
                <p>
                  <italic>* MACE totais = 351. <sup>&#8224;</sup> MACE por paciente: 351 MACE / 224 pacientes = 1,56 MACE/paciente.</italic>
                </p>
              </fn>
            </table-wrap-foot>
          </table-wrap>
        </p>
        <p>A pontua&#231;&#227;o &#8804; 3 no escore HEART teve uma sensibilidade de 99,5% e um valor preditivo negativo (VPN) de 99% por predizer MACE na categoria de baixo risco ( <xref ref-type="table" rid="t3">Tabela 3</xref> ). Ambos os par&#226;metros eram mais elevados que aqueles obtidos pelos outros escores para os grupos de baixo risco de MACE (TIMI: sensibilidade 90%, VPN 89,9%; GRACE: sensibilidade 70%, VPN 77,8%).</p>
        <p>
          <table-wrap id="t3">
            <label>Tabela 3</label>
            <caption>
              <title>&#8211; Caracter&#237;sticas operativas os escores HEART, TIMI e GRACE</title>
            </caption>
            <table frame="hsides" rules="groups">
              <colgroup width="25%">
                <col/>
                <col/>
                <col/>
                <col/>
              </colgroup>
              <thead>
                <tr>
                  <th align="left" style="font-weight:normal">
									</th>
                  <th>HEART &#8804; 3 (IC 95%)</th>
                  <th>TIMI &#8804; 2 (IC 95%)</th>
                  <th>GRACE &#8804; 108 (IC 95%)</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td>SENS</td>
                  <td align="center">99,5% (97 &#8211; 99,9)</td>
                  <td align="center">90% (86 - 94)</td>
                  <td align="center">70,9% (64,5 &#8211; 76,8)</td>
                </tr>
                <tr>
                  <td>ESPEC</td>
                  <td align="center">36,6% (31,1 &#8211; 42,4)</td>
                  <td align="center">63% (57,5 &#8211; 68,8)</td>
                  <td align="center">77,2% (72 &#8211; 81,9)</td>
                </tr>
                <tr>
                  <td>VPN</td>
                  <td align="center">99% (95 &#8211; 99)</td>
                  <td align="center">89,9% (85 &#8211; 91,9)</td>
                  <td align="center">77,8% (72,3 &#8211; 82,3)</td>
                </tr>
                <tr>
                  <td>VPP</td>
                  <td align="center">54% (48 &#8211; 97)</td>
                  <td align="center">65,2% (59,6 &#8211; 75,6)</td>
                  <td align="center">70,3% (64 &#8211; 76)</td>
                </tr>
                <tr>
                  <td>RV (+)</td>
                  <td align="center">1,57 (1,4 &#8211; 1,7)</td>
                  <td align="center">2,47 (2,1 &#8211; 2,8)</td>
                  <td align="center">3,125 (2,4 &#8211; 3,9)</td>
                </tr>
                <tr>
                  <td>RV (&#8722;)</td>
                  <td align="center">0,012 (0,001 &#8211; 0,08)</td>
                  <td align="center">0,147 (0,09 &#8211; 0,22)</td>
                  <td align="center">0,375 (0,3 &#8211; 0,4)</td>
                </tr>
              </tbody>
            </table>
            <table-wrap-foot>
              <fn id="TFN3">
                <p>
                  <italic>* ESPEC: especificidade; RV: raz&#227;o de verossimilhan&#231;a; SENS: sensibilidade; VPN: valor preditivo negativo; VPP: valor preditivo positivo.</italic>
                </p>
              </fn>
            </table-wrap-foot>
          </table-wrap>
        </p>
        <p>As curvas ROC para cada escore est&#227;o apresentados na <xref ref-type="fig" rid="f02">Figura 2</xref> . A estat&#237;stica C para o escore HEART foi 0,937, o qual era mais alto do que os outros dois, e foi encontrada uma diferen&#231;a estatisticamente significativa utilizando o teste n&#227;o param&#233;trico de DeLong (p &lt; 0,0001).</p>
        <p>
          <fig id="f02">
            <label>Figura 2</label>
            <caption>
              <title>&#8211; <italic>Curvas ROC para os escores HEART, TIMI e GRACE.</italic></title>
            </caption>
            <graphic xlink:href="1678-4170-abc-114-05-0795-90206-gf02.jpg"/></fig>
        </p>
        <p>Por fim, o teste do cinto de calibra&#231;&#227;o do GiViTi foi utilizado para comparar resultados esperados e observados ( <xref ref-type="fig" rid="f03">Figura 3</xref> ), demonstrando calibra&#231;&#227;o adequada do escore HEART para pacientes com baixo risco de MACE.<sup><xref ref-type="bibr" rid="B20">20</xref></sup></p>
        <p>
          <fig id="f03">
            <label>Figura 3</label>
            <caption>
              <title>&#8211; <italic>Teste do cinto de calibra&#231;&#227;o para o escore HEART.</italic></title>
            </caption>
            <graphic xlink:href="1678-4170-abc-114-05-0795-90206-gf03.jpg"/></fig>
        </p>
      </sec>
    </sec>
    <sec sec-type="discussion">
      <title>Discuss&#227;o</title>
      <p>N&#243;s verificamos que o escore HEART para pacientes com dor no peito &#233; uma ferramenta confi&#225;vel para predizer desfechos cardiovasculares maiores, com base na descri&#231;&#227;o de sintomas do paciente, dados do registro cl&#237;nico, achados eletrocardiogr&#225;ficos e valor inicial da TnI-as. O escore &#233; facilmente aplic&#225;vel; n&#227;o requer c&#225;lculos computarizados e tem sido validado por estudos nacionais multic&#234;ntricos em m&#250;ltiplas popula&#231;&#245;es.<sup><xref ref-type="bibr" rid="B10">10</xref> , <xref ref-type="bibr" rid="B11">11</xref> , <xref ref-type="bibr" rid="B14">14</xref> , <xref ref-type="bibr" rid="B15">15</xref></sup></p>
      <p>Em contraste, o escore GRACE &#233; um modelo para predizer a mortalidade em pacientes com s&#237;ndrome coronariana aguda que tem sido adequadamente validado, mas o fato que deve ser calculado eletronicamente limita a sua aplicabilidade.<sup><xref ref-type="bibr" rid="B17">17</xref></sup> Similarmente, o escore TIMI foi elaborado para determinar a necessidade para terapia agressiva em pacientes com s&#237;ndrome coronariana aguda, permitindo o c&#225;lculo do risco por meio de vari&#225;veis dicot&#244;micas, sem pesar as vari&#225;veis ou levar em considera&#231;&#227;o a apresenta&#231;&#227;o cl&#237;nica do paciente.<sup><xref ref-type="bibr" rid="B16">16</xref></sup></p>
      <p>Os resultados do presente estudo s&#227;o favor&#225;veis para o escore HEART, com uma estat&#237;stica C de 0,93; este valor indica uma capacidade excelente para predizer o risco em pacientes com dor no peito, em compara&#231;&#227;o com os escores TIMI e GRACE. Isto &#233; consistente com o que foi previamente relatado por Six et al.,<sup><xref ref-type="bibr" rid="B10">10</xref></sup> Sakamoto et al.,<sup><xref ref-type="bibr" rid="B11">11</xref></sup> Backus et al.,<sup><xref ref-type="bibr" rid="B15">15</xref></sup> confirmando que pontua&#231;&#245;es baixas no escore HEART<sup><xref ref-type="bibr" rid="B24">24</xref></sup> s&#227;o muito precisas para excluir a ocorr&#234;ncia de MACE nos pacientes de baixo risco com acompanhamento de 30 dias.<sup><xref ref-type="bibr" rid="B10">10</xref> , <xref ref-type="bibr" rid="B11">11</xref> , <xref ref-type="bibr" rid="B15">15</xref> , <xref ref-type="bibr" rid="B24">24</xref></sup></p>
      <p>O nosso estudo obteve uma incid&#234;ncia de MACE de 43%, a qual &#233; mais alta que as de 13% e 36% relatadas na literatura.<sup><xref ref-type="bibr" rid="B11">11</xref> , <xref ref-type="bibr" rid="B15">15</xref></sup> Esta taxa alta de MACE pode ser devida &#224; distin&#231;&#227;o da institui&#231;&#227;o como um centro de refer&#234;ncia para doen&#231;a cardiovascular, o qual determina um n&#250;mero acima da m&#233;dia de pacientes com riscos intermedi&#225;rios e altos de cardiopatia coron&#225;ria. Adicionalmente, o uso exclusivo de TnI-as durante este estudo pode justificar a taxa mais alta de detec&#231;&#227;o de MACE, em compara&#231;&#227;o com aquela previamente relatada. Por&#233;m, apesar de taxas mais altas de MACE, independente do estado de risco, o escore HEART manteve a sua precis&#227;o preditiva, superando os escores TIMI e GRACE.</p>
      <p>Em rela&#231;&#227;o &#224; sensibilidade e o VPN dos testes, n&#243;s verificamos que a estat&#237;stica C foi mais alta para o escore HEART ao usar um valor de corte de 3 pontos, o qual &#233; o limite para a categoria de baixo risco. Tanto a sensibilidade quanto o VPN s&#227;o pr&#243;ximos a 100% e s&#227;o significativamente mais elevados que a sensibilidade e o VPN dos outros dois escores. Com base nestes resultados, pode-se concluir que uma pontua&#231;&#227;o abaixo de 3 no escore HEART identifica os pacientes que podem ser tratados com uma estrat&#233;gia conservadora de maneira segura, com alta precis&#227;o, visto que o risco de desfechos cardiovasculares adversos &#233; baixo.</p>
      <p>Adicionalmente, de acordo com o m&#233;todo do cinto de calibra&#231;&#227;o do GiViTi, foi observado que h&#225; calibra&#231;&#227;o adequada entre os desfechos esperados e observados para o grupo de baixo risco do escore HEART, em contraste com os grupos de baixo risco dos outros dois escores analisados. Isto corrobora o uso do escore HEART como um escore de primeira linha para estratificar o risco em pacientes com dor no peito com suspeita de origem card&#237;aca. Adicionalmente, considerando a sua facilidade de aplica&#231;&#227;o e a sua valida&#231;&#227;o adequada, pode ser uma ferramenta valiosa para aprimorar a tomada de decis&#227;o e a distribui&#231;&#227;o apropriada dos recursos. Isso foi demonstrado por Mahler et al.,<sup><xref ref-type="bibr" rid="B12">12</xref></sup> com o uso do &#8220;caminho HEART,&#8221; o qual combina a aplica&#231;&#227;o do escore com dosagem de troponina no momento de apresenta&#231;&#227;o e 3 horas mais tarde. Este caminho resultou em uma redu&#231;&#227;o significativa de testes desnecess&#225;rios e uma estadia hospitalar mais breve.<sup><xref ref-type="bibr" rid="B12">12</xref> , <xref ref-type="bibr" rid="B25">25</xref></sup></p>
      <p>At&#233; onde sabemos, nenhum outro estudo relatou o desempenho dos escores de risco na era do TnI-as em uma popula&#231;&#227;o exclusivamente latino-americana. A natureza prospectiva do estudo fortalece os achados. Portanto, estes resultados servem como uma valida&#231;&#227;o de achados pr&#233;vios em rela&#231;&#227;o ao escore HEART, e devem incentivar outros projetos multic&#234;ntricos com popula&#231;&#245;es maiores. Tamb&#233;m acreditamos que estes resultados devem expandir o uso do escore HEART como uma ferramenta valiosa que visa facilitar a tomada de decis&#227;o em uma popula&#231;&#227;o desafiadora de pacientes.</p>
      <sec>
        <title>Limita&#231;&#245;es</title>
        <p>Os escores TIMI e GRACE foram desenvolvidos como ferramentas para quantificar risco em pacientes com diagn&#243;stico estabelecido de s&#237;ndrome coron&#225;ria aguda, enquanto o escore HEART foi elaborado para avaliar pacientes com dor no peito. Por&#233;m, apesar das diferen&#231;as nos seus objetivos iniciais, na pr&#225;tica cl&#237;nica do mundo real, eles t&#234;m sido utilizados de forma intercambi&#225;vel. Al&#233;m disso, estudos pr&#233;vios t&#234;m comparado os escores para avalia&#231;&#227;o de risco de dor no peito em situa&#231;&#245;es de emerg&#234;ncia.</p>
        <p>O protocolo de pesquisa do presente estudo foi realizado em um &#250;nico centro especializado, o qual pode n&#227;o refletir o comportamento de outras popula&#231;&#245;es em centros com n&#237;veis diferentes de complexidade ou em outras regi&#245;es ou pa&#237;ses. Portanto, novos estudos com popula&#231;&#245;es multic&#234;ntricas maiores ser&#227;o necess&#225;rios no futuro para aprimorar a aplicabilidade destes achados.</p>
        <p>Embora o tamanho da amostra tenha sido menor do que inicialmente calculado, o fato de que foi obtido um n&#250;mero maior de MACE (n = 224) no grupo analisado de 519 pacientes possibilitou o c&#225;lculo de uma pot&#234;ncia adequada, acima de 80%.</p>
        <p>Adicionalmente, fatores diferentes podem influenciar a aplicabilidade do escore, considerando que os pacientes nem sempre podem fornecer o seu hist&#243;rico cl&#237;nico com precis&#227;o, e por este motivo os fatores de risco podem n&#227;o ser adequadamente relatados. As altera&#231;&#245;es eletrocardiogr&#225;ficas e as eleva&#231;&#245;es de troponina podem ser insignificantes nas fases iniciais de infarto do mioc&#225;rdio ou podem ser falsamente elevadas por outros dist&#250;rbios, como doen&#231;a renal cr&#244;nica, insufici&#234;ncia card&#237;aca, arritmias, taquicardia e sepse, entre outros.</p>
        <p>Finalmente, a informa&#231;&#227;o do acompanhamento baseia-se nos dados fornecidos pelos pacientes e seus familiares, o que pode limitar a confiabilidade dos dados. Embora as informa&#231;&#245;es baseiem-se no formato estruturado com 4 perguntas claras, podem estar sujeitas a erros de interpreta&#231;&#227;o.</p>
      </sec>
    </sec>
    <sec sec-type="conclusions">
      <title>Conclus&#245;es</title>
      <p>N&#243;s verificamos que o escore HEART foi mais eficaz na previs&#227;o de MACE com 30 dias de acompanhamento em compara&#231;&#227;o com os escores TIMI e GRACE na era da TnI-as em uma popula&#231;&#227;o exclusivamente latino-americana com dor no peito com suspeita de origem card&#237;aca em um centro cardiovascular de alta complexidade.</p>
      <p>O uso de TnI-as manteve o desempenho superior previamente demonstrado do escore HEART em compara&#231;&#227;o com os escores TIMI e GRACE.</p>
      <p>O escore HEART possibilita a diferencia&#231;&#227;o mais precisa dos pacientes com baixo risco de apresentar MACE, o qual permitir&#225; que os m&#233;dicos optem por altas hospitalares de maneira mais precoce, possibilitando a economia de horas de estadia no hospital e testes diagn&#243;sticos desnecess&#225;rios. Isto pode resultar em cuidados melhores para pacientes e na distribui&#231;&#227;o mais eficiente dos recursos dos sistemas de sa&#250;de.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <title>Refer&#234;ncias</title>
      <ref id="B1">
        <label>1</label>
        <mixed-citation>1. Nawar EW, Niska RW, Xu J. National Hospital Ambulatory Medical Care Survey: 2005 emergency department summary. Adv Data. 2007(386):1-32.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Nawar</surname>
              <given-names>EW</given-names>
            </name>
            <name>
              <surname>Niska</surname>
              <given-names>RW</given-names>
            </name>
            <name>
              <surname>Xu</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <article-title>National Hospital Ambulatory Medical Care Survey: 2005 emergency department summary</article-title>
          <source>Adv Data</source>
          <year>2007</year>
          <volume>386</volume>
          <fpage>1</fpage>
          <lpage>32</lpage>
        </element-citation>
      </ref>
      <ref id="B2">
        <label>2</label>
        <mixed-citation>2. Roberts RR, Zalenski RJ, Mensah EK, Rydman RJ, Ciavarella G, Gussow L, et al. Costs of an emergency department-based accelerated diagnostic protocol vs hospitalization in patients with chest pain: a randomized controlled trial. JAMA. 1997;278(20):1670-6.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Roberts</surname>
              <given-names>RR</given-names>
            </name>
            <name>
              <surname>Zalenski</surname>
              <given-names>RJ</given-names>
            </name>
            <name>
              <surname>Mensah</surname>
              <given-names>EK</given-names>
            </name>
            <name>
              <surname>Rydman</surname>
              <given-names>RJ</given-names>
            </name>
            <name>
              <surname>Ciavarella</surname>
              <given-names>G</given-names>
            </name>
            <name>
              <surname>Gussow</surname>
              <given-names>L</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>Costs of an emergency department-based accelerated diagnostic protocol vs hospitalization in patients with chest pain: a randomized controlled trial</article-title>
          <source>JAMA</source>
          <year>1997</year>
          <volume>278</volume>
          <issue>20</issue>
          <fpage>1670</fpage>
          <lpage>1676</lpage>
        </element-citation>
      </ref>
      <ref id="B3">
        <label>3</label>
        <mixed-citation>3. Kanzaria HK, Hoffman JR, Probst MA, Caloyeras JP, Berry SH, Brook RH. Emergency physician perceptions of medically unnecessary advanced diagnostic imaging. Acad Emerg Med. 2015;22(4):390-8.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Kanzaria</surname>
              <given-names>HK</given-names>
            </name>
            <name>
              <surname>Hoffman</surname>
              <given-names>JR</given-names>
            </name>
            <name>
              <surname>Probst</surname>
              <given-names>MA</given-names>
            </name>
            <name>
              <surname>Caloyeras</surname>
              <given-names>JP</given-names>
            </name>
            <name>
              <surname>Berry</surname>
              <given-names>SH</given-names>
            </name>
            <name>
              <surname>Brook</surname>
              <given-names>RH</given-names>
            </name>
          </person-group>
          <article-title>Emergency physician perceptions of medically unnecessary advanced diagnostic imaging</article-title>
          <source>Acad Emerg Med</source>
          <year>2015</year>
          <volume>22</volume>
          <issue>4</issue>
          <fpage>390</fpage>
          <lpage>398</lpage>
        </element-citation>
      </ref>
      <ref id="B4">
        <label>4</label>
        <mixed-citation>4. Gallardo-Solarte K, Acosta FPB, Jim&#233;nez RR. Costos de la enfermedad cr&#243;nica no transmisible: la realidad colombiana. Rev Cienc Salud. 2016;14(1):103-14.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Gallardo-Solarte</surname>
              <given-names>K</given-names>
            </name>
            <name>
              <surname>Acosta</surname>
              <given-names>FPB</given-names>
            </name>
            <name>
              <surname>Jim&#233;nez</surname>
              <given-names>RR</given-names>
            </name>
          </person-group>
          <article-title>Costos de la enfermedad cr&#243;nica no transmisible: la realidad colombiana</article-title>
          <source>Rev Cienc Salud</source>
          <year>2016</year>
          <volume>14</volume>
          <issue>1</issue>
          <fpage>103</fpage>
          <lpage>114</lpage>
        </element-citation>
      </ref>
      <ref id="B5">
        <label>5</label>
        <mixed-citation>5. Observatorio Nacional de Salud. Quinto Informe ONS: carga de enfermedad por enfermedades cr&#243;nicas no transmisibles y discapacidad en Colombia. Colombia: ONS; 2015.</mixed-citation>
        <element-citation publication-type="report">
          <person-group person-group-type="author">
            <collab>Observatorio Nacional de Salud</collab>
          </person-group>
          <source>Quinto Informe ONS: carga de enfermedad por enfermedades cr&#243;nicas no transmisibles y discapacidad en Colombia</source>
          <publisher-loc>Colombia</publisher-loc>
          <publisher-name>ONS</publisher-name>
          <year>2015</year>
        </element-citation>
      </ref>
      <ref id="B6">
        <label>6</label>
        <mixed-citation>6. Observatorio de la Seguridad Social. Grupo de Econom&#237;a de la Salud GES. Evaluaci&#243;n econ&#243;mica en salud: t&#243;picos te&#243;ricos y aplicaciones en Colombia. Universidad de Antioquia. 2006;5(14):1-16.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <collab>Observatorio de la Seguridad Social</collab>
            <collab>Grupo de Econom&#237;a de la Salud GES</collab>
          </person-group>
          <article-title>Evaluaci&#243;n econ&#243;mica en salud: t&#243;picos te&#243;ricos y aplicaciones en Colombia</article-title>
          <source>Universidad de Antioquia</source>
          <year>2006</year>
          <volume>5</volume>
          <issue>14</issue>
          <fpage>1</fpage>
          <lpage>16</lpage>
        </element-citation>
      </ref>
      <ref id="B7">
        <label>7</label>
        <mixed-citation>7. Storrow AB, Gibler WB. Chest pain centers: diagnosis of acute coronary syndromes. Ann Emerg Med. 2000;35(5):449-61.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Storrow</surname>
              <given-names>AB</given-names>
            </name>
            <name>
              <surname>Gibler</surname>
              <given-names>WB</given-names>
            </name>
          </person-group>
          <article-title>Chest pain centers: diagnosis of acute coronary syndromes</article-title>
          <source>Ann Emerg Med</source>
          <year>2000</year>
          <volume>35</volume>
          <issue>5</issue>
          <fpage>449</fpage>
          <lpage>461</lpage>
        </element-citation>
      </ref>
      <ref id="B8">
        <label>8</label>
        <mixed-citation>8. Redberg RF. Getting to best care at lower cost. JAMA Intern Med. 2013;173(2):91-2.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Redberg</surname>
              <given-names>RF</given-names>
            </name>
          </person-group>
          <article-title>Getting to best care at lower cost</article-title>
          <source>JAMA Intern Med</source>
          <year>2013</year>
          <volume>173</volume>
          <issue>2</issue>
          <fpage>91</fpage>
          <lpage>92</lpage>
        </element-citation>
      </ref>
      <ref id="B9">
        <label>9</label>
        <mixed-citation>9. Groarke J, O&#8217;Brien J, Go G, Susanto M, Owens P, Maree AO. Cost burden of non-specific chest pain admissions. Ir J Med Sci. 2013;182(1):57-61.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Groarke</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>O&#8217;Brien</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Go</surname>
              <given-names>G</given-names>
            </name>
            <name>
              <surname>Susanto</surname>
              <given-names>M</given-names>
            </name>
            <name>
              <surname>Owens</surname>
              <given-names>P</given-names>
            </name>
            <name>
              <surname>Maree</surname>
              <given-names>AO</given-names>
            </name>
          </person-group>
          <article-title>Cost burden of non-specific chest pain admissions</article-title>
          <source>Ir J Med Sci</source>
          <year>2013</year>
          <volume>182</volume>
          <issue>1</issue>
          <fpage>57</fpage>
          <lpage>61</lpage>
        </element-citation>
      </ref>
      <ref id="B10">
        <label>10</label>
        <mixed-citation>10. Six AJ, Cullen L, Backus BE, Greenslade J, Parsonage W, Aldous S, et al. The HEART score for the assessment of patients with chest pain in the emergency department: a multinational validation study. Crit Pathw Cardiol. 2013;12(3):121-6.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Six</surname>
              <given-names>AJ</given-names>
            </name>
            <name>
              <surname>Cullen</surname>
              <given-names>L</given-names>
            </name>
            <name>
              <surname>Backus</surname>
              <given-names>BE</given-names>
            </name>
            <name>
              <surname>Greenslade</surname>
              <given-names>J</given-names>
            </name>
            <name>
              <surname>Parsonage</surname>
              <given-names>W</given-names>
            </name>
            <name>
              <surname>Aldous</surname>
              <given-names>S</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>The HEART score for the assessment of patients with chest pain in the emergency department: a multinational validation study</article-title>
          <source>Crit Pathw Cardiol</source>
          <year>2013</year>
          <volume>12</volume>
          <issue>3</issue>
          <fpage>121</fpage>
          <lpage>126</lpage>
        </element-citation>
      </ref>
      <ref id="B11">
        <label>11</label>
        <mixed-citation>11. Sakamoto JT, Liu N, Koh ZX, Fung NX, Heldeweg ML, Ng JC, et al. Comparing HEART, TIMI, and GRACE scores for prediction of 30-day major adverse cardiac events in high acuity chest pain patients in the emergency department. Int J Cardiol. 2016 Oct 15;221:759-64.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Sakamoto</surname>
              <given-names>JT</given-names>
            </name>
            <name>
              <surname>Liu</surname>
              <given-names>N</given-names>
            </name>
            <name>
              <surname>Koh</surname>
              <given-names>ZX</given-names>
            </name>
            <name>
              <surname>Fung</surname>
              <given-names>NX</given-names>
            </name>
            <name>
              <surname>Heldeweg</surname>
              <given-names>ML</given-names>
            </name>
            <name>
              <surname>Ng</surname>
              <given-names>JC</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>Comparing HEART, TIMI, and GRACE scores for prediction of 30-day major adverse cardiac events in high acuity chest pain patients in the emergency department</article-title>
          <source>Int J Cardiol</source>
          <year>2016</year>
          <month>10</month>
          <day>15</day>
          <volume>221</volume>
          <fpage>759</fpage>
          <lpage>764</lpage>
        </element-citation>
      </ref>
      <ref id="B12">
        <label>12</label>
        <mixed-citation>12. Mahler SA, Riley RF, Hiestand BC, Russell GB, Hoekstra JW, Lefebvre CW, et al. The HEART Pathway randomized trial: identifying emergency department patients with acute chest pain for early discharge. Circ Cardiovasc Qual Outcomes. 2015;8(2):195-203.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Mahler</surname>
              <given-names>SA</given-names>
            </name>
            <name>
              <surname>Riley</surname>
              <given-names>RF</given-names>
            </name>
            <name>
              <surname>Hiestand</surname>
              <given-names>BC</given-names>
            </name>
            <name>
              <surname>Russell</surname>
              <given-names>GB</given-names>
            </name>
            <name>
              <surname>Hoekstra</surname>
              <given-names>JW</given-names>
            </name>
            <name>
              <surname>Lefebvre</surname>
              <given-names>CW</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>The HEART Pathway randomized trial: identifying emergency department patients with acute chest pain for early discharge</article-title>
          <source>Circ Cardiovasc Qual Outcomes</source>
          <year>2015</year>
          <volume>8</volume>
          <issue>2</issue>
          <fpage>195</fpage>
          <lpage>203</lpage>
        </element-citation>
      </ref>
      <ref id="B13">
        <label>13</label>
        <mixed-citation>13. Fanaroff AC, Rymer JA, Goldstein SA, Simel DL, Newby LK. Does this patient with chest pain have acute coronary syndrome?: the rational clinical examination systematic review. JAMA. 2015;314(18):1955-65.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Fanaroff</surname>
              <given-names>AC</given-names>
            </name>
            <name>
              <surname>Rymer</surname>
              <given-names>JA</given-names>
            </name>
            <name>
              <surname>Goldstein</surname>
              <given-names>SA</given-names>
            </name>
            <name>
              <surname>Simel</surname>
              <given-names>DL</given-names>
            </name>
            <name>
              <surname>Newby</surname>
              <given-names>LK</given-names>
            </name>
          </person-group>
          <article-title>Does this patient with chest pain have acute coronary syndrome?: the rational clinical examination systematic review</article-title>
          <source>JAMA</source>
          <year>2015</year>
          <volume>314</volume>
          <issue>18</issue>
          <fpage>1955</fpage>
          <lpage>1965</lpage>
        </element-citation>
      </ref>
      <ref id="B14">
        <label>14</label>
        <mixed-citation>14. Six AJ, Backus BE, Kelder JC. Chest pain in the emergency room: value of the HEART score. Neth Heart J. 2008;16(6):191-6.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Six</surname>
              <given-names>AJ</given-names>
            </name>
            <name>
              <surname>Backus</surname>
              <given-names>BE</given-names>
            </name>
            <name>
              <surname>Kelder</surname>
              <given-names>JC</given-names>
            </name>
          </person-group>
          <article-title>Chest pain in the emergency room: value of the HEART score</article-title>
          <source>Neth Heart J</source>
          <year>2008</year>
          <volume>16</volume>
          <issue>6</issue>
          <fpage>191</fpage>
          <lpage>196</lpage>
        </element-citation>
      </ref>
      <ref id="B15">
        <label>15</label>
        <mixed-citation>15. Backus BE, Six AJ, Kelder JC, Bosschaert MA, Mast EG, Mosterd A, et al. A prospective validation of the HEART score for chest pain patients at the emergency department. Int J Cardiol. 2013;168(3):2153-8.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Backus</surname>
              <given-names>BE</given-names>
            </name>
            <name>
              <surname>Six</surname>
              <given-names>AJ</given-names>
            </name>
            <name>
              <surname>Kelder</surname>
              <given-names>JC</given-names>
            </name>
            <name>
              <surname>Bosschaert</surname>
              <given-names>MA</given-names>
            </name>
            <name>
              <surname>Mast</surname>
              <given-names>EG</given-names>
            </name>
            <name>
              <surname>Mosterd</surname>
              <given-names>A</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>A prospective validation of the HEART score for chest pain patients at the emergency department</article-title>
          <source>Int J Cardiol</source>
          <year>2013</year>
          <volume>168</volume>
          <issue>3</issue>
          <fpage>2153</fpage>
          <lpage>2158</lpage>
        </element-citation>
      </ref>
      <ref id="B16">
        <label>16</label>
        <mixed-citation>16. Antman EM, Cohen M, Bernink PJ, McCabe CH, Horacek T, Papuchis G, et al. The TIMI risk score for unstable angina/non-ST elevation MI: A method for prognostication and therapeutic decision making. JAMA. 2000;284(7):835-42.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Antman</surname>
              <given-names>EM</given-names>
            </name>
            <name>
              <surname>Cohen</surname>
              <given-names>M</given-names>
            </name>
            <name>
              <surname>Bernink</surname>
              <given-names>PJ</given-names>
            </name>
            <name>
              <surname>McCabe</surname>
              <given-names>CH</given-names>
            </name>
            <name>
              <surname>Horacek</surname>
              <given-names>T</given-names>
            </name>
            <name>
              <surname>Papuchis</surname>
              <given-names>G</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>The TIMI risk score for unstable angina/non-ST elevation MI: A method for prognostication and therapeutic decision making</article-title>
          <source>JAMA</source>
          <year>2000</year>
          <volume>284</volume>
          <issue>7</issue>
          <fpage>835</fpage>
          <lpage>842</lpage>
        </element-citation>
      </ref>
      <ref id="B17">
        <label>17</label>
        <mixed-citation>17. Eagle KA, Lim MJ, Dabbous OH, Pieper KS, Goldberg RJ, Van de Werf F, et al. A validated prediction model for all forms of acute coronary syndrome: estimating the risk of 6-month postdischarge death in an international registry. JAMA. 2004;291(22):2727-33.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Eagle</surname>
              <given-names>KA</given-names>
            </name>
            <name>
              <surname>Lim</surname>
              <given-names>MJ</given-names>
            </name>
            <name>
              <surname>Dabbous</surname>
              <given-names>OH</given-names>
            </name>
            <name>
              <surname>Pieper</surname>
              <given-names>KS</given-names>
            </name>
            <name>
              <surname>Goldberg</surname>
              <given-names>RJ</given-names>
            </name>
            <name>
              <surname>Van de Werf</surname>
              <given-names>F</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>A validated prediction model for all forms of acute coronary syndrome: estimating the risk of 6-month postdischarge death in an international registry</article-title>
          <source>JAMA</source>
          <year>2004</year>
          <volume>291</volume>
          <issue>22</issue>
          <fpage>2727</fpage>
          <lpage>2733</lpage>
        </element-citation>
      </ref>
      <ref id="B18">
        <label>18</label>
        <mixed-citation>18. Wagner GS, Macfarlane P, Wellens H, Josephson M, Gorgels A, Mirvis DM, et al. AHA/ACCF/HRS recommendations for the standardization and interpretation of the electrocardiogram: part VI: acute ischemia/infarction: a scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Cardiology Foundation; and the Heart Rhythm Society. Endorsed by the International Society for Computerized Electrocardiology. J Am Coll Cardiol. 2009;53(11):1003-11.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Wagner</surname>
              <given-names>GS</given-names>
            </name>
            <name>
              <surname>Macfarlane</surname>
              <given-names>P</given-names>
            </name>
            <name>
              <surname>Wellens</surname>
              <given-names>H</given-names>
            </name>
            <name>
              <surname>Josephson</surname>
              <given-names>M</given-names>
            </name>
            <name>
              <surname>Gorgels</surname>
              <given-names>A</given-names>
            </name>
            <name>
              <surname>Mirvis</surname>
              <given-names>DM</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>AHA/ACCF/HRS recommendations for the standardization and interpretation of the electrocardiogram: part VI: acute ischemia/infarction: a scientific statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Cardiology Foundation; and the Heart Rhythm Society. Endorsed by the International Society for Computerized Electrocardiology</article-title>
          <source>J Am Coll Cardiol</source>
          <year>2009</year>
          <volume>53</volume>
          <issue>11</issue>
          <fpage>1003</fpage>
          <lpage>1011</lpage>
        </element-citation>
      </ref>
      <ref id="B19">
        <label>19</label>
        <mixed-citation>19. Taylor J. Third universal definition of myocardial infarction. Eur Heart J. 2012;33(20):2506-7.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Taylor</surname>
              <given-names>J</given-names>
            </name>
          </person-group>
          <article-title>Third universal definition of myocardial infarction</article-title>
          <source>Eur Heart J</source>
          <year>2012</year>
          <volume>33</volume>
          <issue>20</issue>
          <fpage>2506</fpage>
          <lpage>2507</lpage>
        </element-citation>
      </ref>
      <ref id="B20">
        <label>20</label>
        <mixed-citation>20. Ib&#225;nez B, James S, Agewall S, Antunes MJ, Bucciarelli-Ducci C, Bueno H, et al. 2017 ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation. Rev Esp Cardiol (Engl Ed). 2017;70(12):1082.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Ib&#225;nez</surname>
              <given-names>B</given-names>
            </name>
            <name>
              <surname>James</surname>
              <given-names>S</given-names>
            </name>
            <name>
              <surname>Agewall</surname>
              <given-names>S</given-names>
            </name>
            <name>
              <surname>Antunes</surname>
              <given-names>MJ</given-names>
            </name>
            <name>
              <surname>Bucciarelli-Ducci</surname>
              <given-names>C</given-names>
            </name>
            <name>
              <surname>Bueno</surname>
              <given-names>H</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>2017 ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation</article-title>
          <source>Rev Esp Cardiol (Engl Ed)</source>
          <year>2017</year>
          <volume>70</volume>
          <issue>12</issue>
          <size units="pages">1082</size>
        </element-citation>
      </ref>
      <ref id="B21">
        <label>21</label>
        <mixed-citation>21. Simel DL, Samsa GP, Matchar DB. Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol. 1991;44(8):763-70.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Simel</surname>
              <given-names>DL</given-names>
            </name>
            <name>
              <surname>Samsa</surname>
              <given-names>GP</given-names>
            </name>
            <name>
              <surname>Matchar</surname>
              <given-names>DB</given-names>
            </name>
          </person-group>
          <article-title>Likelihood ratios with confidence: sample size estimation for diagnostic test studies</article-title>
          <source>J Clin Epidemiol</source>
          <year>1991</year>
          <volume>44</volume>
          <issue>8</issue>
          <fpage>763</fpage>
          <lpage>770</lpage>
        </element-citation>
      </ref>
      <ref id="B22">
        <label>22</label>
        <mixed-citation>22. Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32-5.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Youden</surname>
              <given-names>WJ</given-names>
            </name>
          </person-group>
          <article-title>Index for rating diagnostic tests</article-title>
          <source>Cancer</source>
          <year>1950</year>
          <volume>3</volume>
          <issue>1</issue>
          <fpage>32</fpage>
          <lpage>35</lpage>
        </element-citation>
      </ref>
      <ref id="B23">
        <label>23</label>
        <mixed-citation>23. Finazzi S, Poole D, Luciani D, Cogo PE, Bertolini G. Calibration belt for quality-of-care assessment based on dichotomous outcomes. PLoS One. 2011;6(2):e16110.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Finazzi</surname>
              <given-names>S</given-names>
            </name>
            <name>
              <surname>Poole</surname>
              <given-names>D</given-names>
            </name>
            <name>
              <surname>Luciani</surname>
              <given-names>D</given-names>
            </name>
            <name>
              <surname>Cogo</surname>
              <given-names>PE</given-names>
            </name>
            <name>
              <surname>Bertolini</surname>
              <given-names>G</given-names>
            </name>
          </person-group>
          <article-title>Calibration belt for quality-of-care assessment based on dichotomous outcomes</article-title>
          <source>PLoS One</source>
          <year>2011</year>
          <volume>6</volume>
          <issue>2</issue>
          <elocation-id>e16110</elocation-id>
        </element-citation>
      </ref>
      <ref id="B24">
        <label>24</label>
        <mixed-citation>24. Stopyra JP, Harper WS, Higgins TJ, Prokesova JV, Winslow JE, Nelson RD, et al. Prehospital Modified HEART score predictive of 30-day adverse cardiac events. Prehosp Disaster Med. 2018;33(1):58-62.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Stopyra</surname>
              <given-names>JP</given-names>
            </name>
            <name>
              <surname>Harper</surname>
              <given-names>WS</given-names>
            </name>
            <name>
              <surname>Higgins</surname>
              <given-names>TJ</given-names>
            </name>
            <name>
              <surname>Prokesova</surname>
              <given-names>JV</given-names>
            </name>
            <name>
              <surname>Winslow</surname>
              <given-names>JE</given-names>
            </name>
            <name>
              <surname>Nelson</surname>
              <given-names>RD</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>Prehospital Modified HEART score predictive of 30-day adverse cardiac events</article-title>
          <source>Prehosp Disaster Med</source>
          <year>2018</year>
          <volume>33</volume>
          <issue>1</issue>
          <fpage>58</fpage>
          <lpage>62</lpage>
        </element-citation>
      </ref>
      <ref id="B25">
        <label>25</label>
        <mixed-citation>25. Hyams JM, Streitz MJ, Oliver JJ, Wood RM, Maksimenko YM, Long B, et al. Impact of the HEART pathway on admission rates for emergency department patients with chest pain: an external clinical validation study. J Emerg Med. 2018;54(4):549-57.</mixed-citation>
        <element-citation publication-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hyams</surname>
              <given-names>JM</given-names>
            </name>
            <name>
              <surname>Streitz</surname>
              <given-names>MJ</given-names>
            </name>
            <name>
              <surname>Oliver</surname>
              <given-names>JJ</given-names>
            </name>
            <name>
              <surname>Wood</surname>
              <given-names>RM</given-names>
            </name>
            <name>
              <surname>Maksimenko</surname>
              <given-names>YM</given-names>
            </name>
            <name>
              <surname>Long</surname>
              <given-names>B</given-names>
            </name>
            <etal>et al</etal>
          </person-group>
          <article-title>Impact of the HEART pathway on admission rates for emergency department patients with chest pain: an external clinical validation study</article-title>
          <source>J Emerg Med</source>
          <year>2018</year>
          <volume>54</volume>
          <issue>4</issue>
          <fpage>549</fpage>
          <lpage>557</lpage>
        </element-citation>
      </ref>
    </ref-list>
    <fn-group>
      <fn fn-type="other">
        <p>Vincula&#231;&#227;o acad&#234;mica</p>
        <p>N&#227;o h&#225; vincula&#231;&#227;o deste estudo a programas de p&#243;s-gradua&#231;&#227;o.</p>
      </fn>
      <fn fn-type="other">
        <p>Aprova&#231;&#227;o &#233;tica e consentimento informado</p>
        <p>Este estudo foi aprovado pelo Comit&#234; de &#201;tica da Fundaci&#243;n Cardioinfantil sob o n&#250;mero de protocolo 20-2017. Todos os procedimentos envolvidos nesse estudo est&#227;o de acordo com a Declara&#231;&#227;o de Helsinki de 1975, atualizada em 2013. O consentimento informado foi obtido de todos os participantes inclu&#237;dos no estudo.</p>
      </fn>
    </fn-group>
    <fn-group>
      <fn fn-type="supported-by">
        <p>Fontes de financiamento</p>
        <p>O presente estudo n&#227;o teve fontes de financiamento externas.</p>
      </fn>
    </fn-group>
  </back>
  <sub-article article-type="translation" id="TRen" xml:lang="en">
    <front-stub>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Original Article</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>HEART, TIMI, and GRACE Scores for Prediction of 30-Day Major Adverse Cardiovascular Events in the Era of High-Sensitivity Troponin</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0002-6470-6737</contrib-id>
          <name>
            <surname>Torralba</surname>
            <given-names>Felipe</given-names>
          </name>
          <xref ref-type="aff" rid="aff1001">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Navarro</surname>
            <given-names>Alberto</given-names>
          </name>
          <xref ref-type="aff" rid="aff1001">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>la Hoz</surname>
            <given-names>Juan Castellanos-de</given-names>
          </name>
          <xref ref-type="aff" rid="aff1001">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0001-9513-9897</contrib-id>
          <name>
            <surname>Ortiz</surname>
            <given-names>Carlos</given-names>
          </name>
          <xref ref-type="aff" rid="aff1001">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Botero</surname>
            <given-names>Alberth</given-names>
          </name>
          <xref ref-type="aff" rid="aff1001">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Alarc&#243;n</surname>
            <given-names>Freddy</given-names>
          </name>
          <xref ref-type="aff" rid="aff1001">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <contrib-id contrib-id-type="orcid">0000-0002-9915-1831</contrib-id>
          <name>
            <surname>Isaza</surname>
            <given-names>Nicolas</given-names>
          </name>
          <xref ref-type="aff" rid="aff1001">
            <sup>1</sup>
          </xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Isaza</surname>
            <given-names>Daniel</given-names>
          </name>
          <xref ref-type="aff" rid="aff1001">
            <sup>1</sup>
          </xref>
        </contrib>
      </contrib-group>
      <aff id="aff1001">
        <label>1</label>
        <country country="CO">Colombia</country>
        <institution content-type="original">Fundacion Cardioinfantil Instituto de Cardiologia, Bogota Cundinamarca &#8211; Colombia</institution>
      </aff>
      <author-notes>
        <corresp id="c01001">Mailing Address: Felipe Torralba &#8226; Fundacion Cardioinfantil Instituto de Cardiologia - ak19#128b66 402 Bogota, Cundinamarca, 111121 &#8211; Colombia E-mail: feliptorr1@gmail.com</corresp>
        <fn fn-type="con">
          <p>Author contributions</p>
          <p>Conception and design of the research: Torralba F, Navarro A, Ortiz C; Acquisition of data: Torralba F, Navarro A, Botero A, Alarc&#243;n F; Analysis and interpretation of the data: Torralba F, Castellanos JC, Botero A, Alarc&#243;n F, Isaza N, Isaza D; Statistical analysis: Castellanos JC; Writing of the manuscript: Torralba F, Navarro A, Ortiz C, Isaza N, Isaza D; Critical revision of the manuscript for intellectual content: Torralba F, Navarro A, Castellanos JC, Ortiz C, Isaza N, Isaza D.</p>
        </fn>
        <fn fn-type="conflict">
          <p>Potential Conflict of Interest</p>
          <p>No potential conflict of interest relevant to this article was reported.</p>
        </fn>
      </author-notes>
      <abstract>
        <title>Abstract</title>
        <sec>
          <title>Background</title>
          <p>Multiple scoring systems have been designed to calculate the risk of major adverse cardiovascular events (MACE) in patients with chest pain. There is no data on whether the HEART score outperforms TIMI and GRACE in the prediction of MACE, especially in the era of high-sensitivity troponin assay and in an exclusively Latin-American population.</p>
        </sec>
        <sec>
          <title>Objective</title>
          <p>To compare the performance of the HEART, TIMI, and GRACE scores for predicting major cardiovascular events at 30 days of follow-up, in patients who consult for chest pain in the emergency department.</p>
        </sec>
        <sec>
          <title>Methods</title>
          <p>HEART, TIMI, and GRACE scores were analyzed in 519 patients with chest pain at the emergency department. The primary endpoint was the occurrence of MACE within 30 days. The performance of the HEART score was compared with the TIMI and GRACE scores using the DeLong test with p values of 0.05 considered statistically significant.</p>
        </sec>
        <sec>
          <title>Results</title>
          <p>A total of 224 patients (43%) had MACE at 30 days. The C statistic for the HEART, TIMI, and GRACE score was 0.937, 0.844, and 0.797 respectively (p &lt; 0.0001). A HEART score of 3 or less had a sensitivity of 99.5% and a negative predictive value of 99% to classify low risk patients correctly; both values were higher than those obtained by the other scores.</p>
        </sec>
        <sec>
          <title>Conclusion</title>
          <p>The HEART score more effectively predicts cardiovascular events at 30 days of follow-up compared to the other scores. High-sensitivity troponins maintain this score&#8217;s previously demonstrated superiority. This score offers more precise identification of low-risk patients. (Arq Bras Cardiol. 2020; [online].ahead print, PP.0-0)</p>
        </sec>
      </abstract>
      <kwd-group xml:lang="en">
        <kwd>Cardiovascular Diseases/mortality</kwd>
        <kwd>Chest Pain</kwd>
        <kwd>Myocardial Infarction</kwd>
        <kwd>Forecasting Risk Assessment</kwd>
        <kwd>Risk Factors</kwd>
        <kwd>Troponin</kwd>
        <kwd>Myocardial Ischemia</kwd>
      </kwd-group>
    </front-stub>
    <body>
      <sec sec-type="intro">
        <title>Introduction</title>
        <p>Chest pain is one of the most common complaints in patients presenting to the emergency department, with approximately 15 million patient visits in the United States and Europe.<sup><xref ref-type="bibr" rid="B1">1</xref></sup> It is estimated that 55% of these patients have a non-cardiac cause for chest pain and only one fifth are definitively diagnosed with acute coronary syndromes.<sup><xref ref-type="bibr" rid="B1">1</xref> , <xref ref-type="bibr" rid="B2">2</xref></sup> Approximately 85% of patients with chest pain are admitted, in spite of the fact that up to 60% of cases could be managed in the outpatient setting.<sup><xref ref-type="bibr" rid="B3">3</xref></sup></p>
        <p>In Colombia, cardiovascular diseases are also a cause of high mortality; among these, ischemic heart disease was the main cause in the previous decade, accounting for 49.5% of the total in this group.<sup><xref ref-type="bibr" rid="B4">4</xref> , <xref ref-type="bibr" rid="B5">5</xref></sup> The annual cost of treatment for patients with chest pain of non-cardiac cause can be as high as 8 billion dollars in the USA and approximately 3.9 billion dollars in Colombia.<sup><xref ref-type="bibr" rid="B6">6</xref></sup> These expenses originate primarily from daily bed costs and radiological and laboratory studies.<sup><xref ref-type="bibr" rid="B2">2</xref> , <xref ref-type="bibr" rid="B7">7</xref> , <xref ref-type="bibr" rid="B8">8</xref></sup> This significant economic impact has driven efforts to develop alternatives that enable more efficient use of resources, particularly in countries with limited health budgets.<sup><xref ref-type="bibr" rid="B3">3</xref> , <xref ref-type="bibr" rid="B8">8</xref> , <xref ref-type="bibr" rid="B9">9</xref></sup></p>
        <p>The development of a tool to accurately determine the risk of major adverse cardiovascular events (MACE) in these patients is essential, and scoring systems such as TIMI and GRACE have been designed to address this problem.<sup><xref ref-type="bibr" rid="B10">10</xref> , <xref ref-type="bibr" rid="B11">11</xref></sup> More recently, the HEART score was created, being the first one prospectively designed to predict MACE.<sup><xref ref-type="bibr" rid="B12">12</xref> - <xref ref-type="bibr" rid="B14">14</xref></sup></p>
        <p>The HEART score has outperformed the TIMI and GRACE scores in Asian, European, and North American populations.<sup><xref ref-type="bibr" rid="B11">11</xref> , <xref ref-type="bibr" rid="B15">15</xref></sup> This study aimed to compare the accuracy of these scores for predicting MACE in a group of Latin-American patients with chest pain who presented to a cardiovascular reference center. To the best of our knowledge, this is the first prospective study of this nature.</p>
      </sec>
      <sec sec-type="methods">
        <title>Methods</title>
        <p>This is a prospective observational study of diagnostic tests carried out in the Fundaci&#243;n Cardioinfantil, located in Bogot&#225;, Colombia. It is a high-complexity hospital specialized in cardiovascular medicine, with a monthly average of 9,000 emergency consultations, 15% of which correspond to cardiovascular emergencies.</p>
        <p>Patients over 18 years of age who presented at the emergency department with acute chest pain between August 2017 and February 2018 were included in the study. According to the institutional protocol, patients were evaluated by the cardiologist; electrocardiography was performed, and high sensitivity troponin I (hsTnI) was measured, initially and 3 hours later if needed, using ARCHITECT STAT assay (Abbot, Lake Bluff, IL, USA).</p>
        <p>Acute myocardial infarction (AMI) was diagnosed when hsTnI values were greater than 0.026 ng/mL (reference value 0.0 &#8211; 0.026 ng/ml). In this case, patients were admitted for in-hospital care, coronary arteriography, and either percutaneous or surgical revascularization. When values were negative, but pain was considered of intermediate or high probability, the patients were admitted for further evaluation with a non-invasive stratification strategy.</p>
        <p>Patients with myocardial infarction with ST elevation and non-cardiac causes of chest pain, such as pneumonia, trauma, or psychogenic pain, were excluded from this study.</p>
        <p>The HEART, TIMI, and GRACE risk scores were calculated for this group of patients at the time of consultation.</p>
        <sec>
          <title>Risk Scores</title>
          <p>The methods for calculating the GRACE, TIMI, and HEART scores have been described in previous articles and are briefly summarized below.<sup><xref ref-type="bibr" rid="B14">14</xref> , <xref ref-type="bibr" rid="B16">16</xref> , <xref ref-type="bibr" rid="B17">17</xref></sup> The score calculations were performed using the information documented in the electronic medical record, the first electrocardiogram upon presentation, and the first laboratory values measured, including troponin measurement with the hsTnI assay.</p>
          <p>The HEART score consists of the following 5 categorical variables: the patient&#8217;s medical history, electrocardiogram, age, risk factors for coronary heart disease, and troponin. Each variable has a maximum value of 2 points adding up to a maximum score of 10, which indicates a patient with maximum risk. The GRACE score consists of the following 5 categorical variables: age, heart rate, blood pressure, creatinine, and Killip class; and the following 3 nominal variables: cardiac arrest, ST-segment deviation, and troponin elevation. Each item is assigned a value, and the sum of these values determines the risk of MACE. Finally, the TIMI score consists of the following 7 dichotomous nominal variables: age over 65 years, more than 3 risk factors for coronary artery disease, significant coronary artery stenosis, symptoms of severe angina, ST-segment deviation, use of aspirin in the last week, and elevation of troponin. The maximum TIMI score is 7, with higher scores indicating higher risks.</p>
        </sec>
        <sec>
          <title>Ethics</title>
          <p>The study was carried out in accordance with the principles laid out in the Declaration of Helsinki of the World Medical Association, the Nuremberg Code, and the World Health Organization International Ethical Guidelines for research involving humans, as well as domestic regulations related to basic health care. The study received approval from the ethics and research committee of the Fundaci&#243;n Cardioinfantil, and the patients included in the study provided their informed consent.</p>
        </sec>
        <sec>
          <title>Data management</title>
          <p>The data included demographic information of the patients, as well as information on clinical history, laboratory values, electrocardiographic findings, and vital signs.</p>
          <p>Laboratory values included creatinine and hsTnI, which are the assays currently applied in the institutional protocol.</p>
          <p>The attending cardiologist evaluated the 12-lead electrocardiogram according to the guidelines of the American Heart Association.<sup><xref ref-type="bibr" rid="B18">18</xref></sup> If necessary, the exam was submitted to a second blinded attending cardiologist for evaluation.</p>
          <p>An encrypted database was created to which only the authors of the study had access, and an algorithm was developed for the automatic calculation of the risk scores.</p>
        </sec>
        <sec>
          <title>Follow-up</title>
          <p>Follow-up was performed at 30 days, reviewing the electronic medical record and employing a telephone survey. A structured format was applied with 4 clear questions regarding the occurrence of major cardiovascular events (death, myocardial infarction, surgical revascularization, or percutaneous revascularization), to determine the presence of the primary outcome.</p>
        </sec>
        <sec>
          <title>Outcomes</title>
          <p>The diagnosis of AMI was made when troponin values rose above the 99th percentile of reference values (hsTnI &gt; 0.026 ng/mL), and evidence of myocardial ischemia was documented on electrocardiogram. We applied the criteria described by the third universal definition of AMI, which was valid at the time the protocol was written.<sup><xref ref-type="bibr" rid="B19">19</xref></sup> We also defined ST-elevation myocardial infarction (STEMI), non-ST-elevation myocardial infarction (NSTEMI), and signs of ischemia according to the guidelines validated at the time of protocol design.<sup><xref ref-type="bibr" rid="B20">20</xref></sup></p>
          <p>Percutaneous revascularization was defined as any intervention through a catheter in the coronary arteries, and surgical revascularization was defined as any cardiac surgery in which coronary artery grafts were made. MACE were defined as death from any cause, myocardial infarction, and surgical or percutaneous myocardial revascularization. Follow up was completed 30 days after admission to the emergency department.</p>
        </sec>
        <sec>
          <title>Statistical analysis</title>
          <p>We calculated a sample of 550 patients, to obtain 185 MACE using Simel and Samsa&#8217;s method of maximum sensitivity,<sup><xref ref-type="bibr" rid="B21">21</xref></sup> in order to yield a power of 80% and a confidence interval of 95% with an alpha error of 5%. For each score, the best cutoff point was calculated using the Youden index,<sup><xref ref-type="bibr" rid="B22">22</xref></sup> considering p values of 0.05 significant. Subsequently, the C statistic, the positive and negative likelihood ratio (LR), sensitivity, and specificity were calculated. Then, the LR was calculated for each risk stratum. The difference between LR was calculated using the test for adequate binomial proportions (Chi-square test and Fisher&#8217;s exact test), considering p values of 0.05 significant.</p>
          <p>The area under the curve for each test was calculated and compared using the nonparametric DeLong test (p = 0.05), and, finally, a calibration test was also made for each score to compare expected and actual major cardiovascular events in the study population, according to the calibration belt method described by Finazzi S, et al.<sup><xref ref-type="bibr" rid="B23">23</xref></sup> from the Italian Group for the Evaluation of Interventions in Intensive Care Medicine (GiViTi).<sup><xref ref-type="bibr" rid="B23">23</xref></sup></p>
          <p>Analysis was carried out using the statistical program R, version 3.3.3 (the R Foundation for Statistical Computing, Vienna, Austria).</p>
        </sec>
      </sec>
      <sec sec-type="results">
        <title>Results</title>
        <p>Patients were recruited between August 2017 and February 2018. The present study&#8217;s patient flow is shown in <xref ref-type="fig" rid="f01001">Figure 1</xref> .</p>
        <p>
          <fig id="f01001">
            <label>Figure 1</label>
            <caption>
              <title>&#8211; <italic>Patients of the study.</italic></title>
            </caption>
            <graphic xlink:href="1678-4170-abc-114-05-0795-90206-gf01-en.jpg"/></fig>
        </p>
        <p>A total of 519 patients were included in the analysis, with a follow-up period of 30 days. Baseline patient characteristics are shown in <xref ref-type="table" rid="t1001">Table 1</xref> . MACE were confirmed in 224 patients within the first 30 days of follow-up, with a total of 351 events (AMI, revascularization, or death). These account for a MACE incidence of 43% and an average of 1.56 MACE per patient with the primary outcome. NSTEMI was diagnosed in 194 patients. Of these patients, 108 underwent percutaneous revascularization; 46 underwent surgical revascularization, and 3 died.</p>
        <p>
          <table-wrap id="t1001">
            <label>Table 1</label>
            <caption>
              <title>&#8211; Population characteristics of patients with and without cardiovascular events at 30 days</title>
            </caption>
            <table frame="hsides" rules="groups">
              <colgroup width="25%">
                <col/>
                <col/>
                <col/>
                <col/>
              </colgroup>
              <thead>
                <tr>
                  <th align="left" style="font-weight:normal">
									</th>
                  <th>Population (n = 519)</th>
                  <th>MACE (n = 224)</th>
                  <th>No MACE (n = 295)</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td>Average age (%)</td>
                  <td align="center">64.31 (12.11%)</td>
                  <td align="center">66.9 (11.69%)</td>
                  <td align="center">62.3 (13.7%)</td>
                </tr>
                <tr>
                  <td>Male sex, n (%)</td>
                  <td align="center">291 (56.06%)</td>
                  <td align="center">207 (59.5%)</td>
                  <td align="center">84 (40.5%)</td>
                </tr>
                <tr>
                  <td>Without cardiovascular risk factors (BMI &gt; 30, smoker, DM2, family coronary artery disease, age &lt; 55 years, hypertension, hypercholesterolemia)</td>
                  <td align="center">64 (12.3%)</td>
                  <td align="center">40 (40%)</td>
                  <td align="center">24 (60%)</td>
                </tr>
                <tr>
                  <td>1 &#8211; 2 risk factors</td>
                  <td align="center">348 (67%)</td>
                  <td align="center">247 (70.97%)</td>
                  <td align="center">101 (29.02%)</td>
                </tr>
                <tr>
                  <td>3 or more risk factors</td>
                  <td align="center">98 (18.8%)</td>
                  <td align="center">74 (75.5%)</td>
                  <td align="center">24 (24.5%)</td>
                </tr>
                <tr>
                  <td>Previous coronary heart disease as the only factor</td>
                  <td align="center">84 (16.1%)</td>
                  <td align="center">61 (72.6%)</td>
                  <td align="center">23 (27.3%)</td>
                </tr>
              </tbody>
            </table>
            <table-wrap-foot>
              <fn id="TFN1001">
                <p>
                  <italic>BMI: body mass index; DM2: diabetes mellitus type 2.</italic>
                </p>
              </fn>
            </table-wrap-foot>
          </table-wrap>
        </p>
        <sec>
          <title>HEART, GRACE, and TIMI score comparison</title>
          <p>Risk stratification for each score is shown in <xref ref-type="table" rid="t2001">Table 2</xref> . Based on the HEART score, patients in the low, intermediate, and high risk groups had 3.1%, 46.2%, and 93.7% incidence of MACE, respectively. The MACE rate in the low-risk group calculated according to the HEART score was lower than that of the low-risk groups calculated by the other two scores.</p>
          <p>
            <table-wrap id="t2001">
              <label>Table 2</label>
              <caption>
                <title>&#8211; Occurrence of MACE (AMI, percutaneous revascularization, surgical revascularization, or death) according to risk groups</title>
              </caption>
              <table frame="hsides" rules="groups">
                <colgroup width="25%">
                  <col/>
                  <col/>
                  <col/>
                  <col/>
                </colgroup>
                <thead>
                  <tr>
                    <th align="left">HEART score</th>
                    <th>Patients (n)</th>
                    <th>MACE (n)</th>
                    <th>MACE (%)</th>
                  </tr>
                </thead>
                <tbody>
                  <tr>
                    <td>Low (0 - 3)</td>
                    <td align="center">194</td>
                    <td align="center">6</td>
                    <td align="center">3.1</td>
                  </tr>
                  <tr>
                    <td>Intermediate (4 &#8211; 6)</td>
                    <td align="center">182</td>
                    <td align="center">84</td>
                    <td align="center">46.2</td>
                  </tr>
                  <tr>
                    <td>High (7 &#8211; 10)</td>
                    <td align="center">143</td>
                    <td align="center">134</td>
                    <td align="center">93.7</td>
                  </tr>
                  <tr>
                    <td>
                      <bold>TIMI score</bold>
                    </td>
                    <td>
										</td>
                    <td>
										</td>
                    <td>
										</td>
                  </tr>
                  <tr>
                    <td>Low (1 &#8211; 2)</td>
                    <td align="center">336</td>
                    <td align="center">21</td>
                    <td align="center">10.1</td>
                  </tr>
                  <tr>
                    <td>Intermediate (3 &#8211; 4)</td>
                    <td align="center">130</td>
                    <td align="center">119</td>
                    <td align="center">55.6</td>
                  </tr>
                  <tr>
                    <td>High (5 &#8211; 7)</td>
                    <td align="center">53</td>
                    <td align="center">84</td>
                    <td align="center">86.6</td>
                  </tr>
                  <tr>
                    <td>
                      <bold>GRACE score</bold>
                    </td>
                    <td>
										</td>
                    <td>
										</td>
                    <td>
										</td>
                  </tr>
                  <tr>
                    <td>Low (&lt; 88)</td>
                    <td align="center">183</td>
                    <td align="center">65</td>
                    <td align="center">22.2</td>
                  </tr>
                  <tr>
                    <td>Intermediate (89 &#8211; 118)</td>
                    <td align="center">165</td>
                    <td align="center">88</td>
                    <td align="center">60.7</td>
                  </tr>
                  <tr>
                    <td>High (&gt; 118)</td>
                    <td align="center">171</td>
                    <td align="center">71</td>
                    <td align="center">87.7</td>
                  </tr>
                </tbody>
              </table>
              <table-wrap-foot>
                <fn id="TFN2001">
                  <p>
                    <italic>* Total MACE = 351.<sup>&#8224;</sup>MACE per patient: 351 MACE / 224 patients = 1.56 MACE / patient.</italic>
                  </p>
                </fn>
              </table-wrap-foot>
            </table-wrap>
          </p>
          <p>A HEART score &#8804; 3 had a sensitivity of 99.5% and a negative predictive value (NPV) of 99% to predict MACE in the low risk category ( <xref ref-type="table" rid="t3001">Table 3</xref> ). Both parameters were higher than those obtained with the other scores for the low risk MACE group (TIMI: sensitivity 90%, NPV 89.9%; GRACE: sensitivity 70%, NPV 77.8%).</p>
          <p>
            <table-wrap id="t3001">
              <label>Table 3</label>
              <caption>
                <title>&#8211; Operative characteristics for the HEART, TIMI, and GRACE scores</title>
              </caption>
              <table frame="hsides" rules="groups">
                <colgroup width="25%">
                  <col/>
                  <col/>
                  <col/>
                  <col/>
                </colgroup>
                <thead>
                  <tr>
                    <th align="left" style="font-weight:normal">
										</th>
                    <th>HEART score &#8804; 3 (CI 95%)</th>
                    <th>TIMI score &#8804; 2 (CI 95%)</th>
                    <th>GRACE score &#8804; 108 (CI 95%)</th>
                  </tr>
                </thead>
                <tbody>
                  <tr>
                    <td>SENS</td>
                    <td align="center">99.5% (97 &#8211; 99.9)</td>
                    <td align="center">90% (86 - 94)</td>
                    <td align="center">70.9% (64.5 &#8211; 76.8)</td>
                  </tr>
                  <tr>
                    <td>SPEC</td>
                    <td align="center">36.6% (31.1 &#8211; 42.4)</td>
                    <td align="center">63% (57.5 &#8211; 68.8)</td>
                    <td align="center">77.2% (72 &#8211; 81.9)</td>
                  </tr>
                  <tr>
                    <td>NPV</td>
                    <td align="center">99% (95 - 99)</td>
                    <td align="center">89.9% (85 &#8211; 91.9)</td>
                    <td align="center">77.8% (72.3 &#8211; 82.3)</td>
                  </tr>
                  <tr>
                    <td>PPV</td>
                    <td align="center">54% (48 - 97)</td>
                    <td align="center">65.2% (59.6 &#8211; 75.6)</td>
                    <td align="center">70.3% (64 - 76)</td>
                  </tr>
                  <tr>
                    <td>LR (+)</td>
                    <td align="center">1.57 (1.4 &#8211; 1.7)</td>
                    <td align="center">2.47 (2.1 &#8211; 2.8)</td>
                    <td align="center">3.125 (2.4 &#8211; 3.9)</td>
                  </tr>
                  <tr>
                    <td>LR (&#8722;)</td>
                    <td align="center">0.012 (0.001 &#8211; 0.08)</td>
                    <td align="center">0.147 (0.09 &#8211; 0.22)</td>
                    <td align="center">0.375 (0.3 &#8211; 0.4)</td>
                  </tr>
                </tbody>
              </table>
              <table-wrap-foot>
                <fn id="TFN3001">
                  <p>
                    <italic>* SENS: sensitivity; SPEC: specificity; NPV: negative predictive value; PPV: positive predictive value; LR: likelihood ratio.</italic>
                  </p>
                </fn>
              </table-wrap-foot>
            </table-wrap>
          </p>
          <p>The ROC curves for each score are shown in <xref ref-type="fig" rid="f02001">Figure 2</xref> . The C statistic for the HEART score was 0.937, which was higher than the other two scores, and a statistically significant difference was found using the nonparametric DeLong test (p &lt; 0.0001).</p>
          <p>
            <fig id="f02001">
              <label>Figure 2</label>
              <caption>
                <title>&#8211; <italic>ROC curves for the HEART, TIMI and GRACE scores.</italic></title>
              </caption>
              <graphic xlink:href="1678-4170-abc-114-05-0795-90206-gf02-en.jpg"/></fig>
          </p>
          <p>Finally, the GiViTi calibration belt test was used to compare expected and observed results ( <xref ref-type="fig" rid="f03001">Figure 3</xref> ), showing adequate calibration of the HEART score for patients with low MACE risk.<sup><xref ref-type="bibr" rid="B20">20</xref></sup></p>
          <p>
            <fig id="f03001">
              <label>Figure 3</label>
              <caption>
                <title>&#8211; <italic>Calibration belt test for HEART score</italic></title>
              </caption>
              <graphic xlink:href="1678-4170-abc-114-05-0795-90206-gf03-en.jpg"/></fig>
          </p>
        </sec>
      </sec>
      <sec sec-type="discussion">
        <title>Discussion</title>
        <p>We found that the HEART score for patients with chest pain is a reliable tool for predicting major cardiovascular outcomes based on the patients&#8217; description of symptoms, clinical record data, electrocardiographic findings, and initial hsTnI value. It is readily applicable; it does not require computerized calculations, and it has been validated by international multicenter studies in multiple populations.<sup><xref ref-type="bibr" rid="B10">10</xref> , <xref ref-type="bibr" rid="B11">11</xref> , <xref ref-type="bibr" rid="B14">14</xref> , <xref ref-type="bibr" rid="B15">15</xref></sup></p>
        <p>Conversely, the GRACE score is a model for predicting mortality in patients with acute coronary syndrome that has been adequately validated, but the fact that it must be calculated electronically limits its applicability.<sup><xref ref-type="bibr" rid="B17">17</xref></sup> Similarly, the TIMI score was designed to determine the need for aggressive therapy in patients with acute coronary syndrome, allowing the calculation of risk through the use of dichotomous variables without weighing the variables or taking patient&#8217;s clinical presentation into account.<sup><xref ref-type="bibr" rid="B16">16</xref></sup></p>
        <p>The results of this study are favorable for the HEART score, with a C statistic value of 0.93, which indicates an excellent ability to predict the risk of patients with chest pain, compared to the TIMI and GRACE scores. This is consistent with what was previously reported by Six et al.,<sup><xref ref-type="bibr" rid="B10">10</xref></sup> Sakamoto et al.,<sup><xref ref-type="bibr" rid="B11">11</xref></sup> Backus et al.,<sup><xref ref-type="bibr" rid="B15">15</xref></sup> and confirming that low scores on the HEART<sup><xref ref-type="bibr" rid="B24">24</xref></sup> scale are very accurate for ruling out the occurrence of MACE in low-risk patients with a 30-day follow up.<sup><xref ref-type="bibr" rid="B10">10</xref> , <xref ref-type="bibr" rid="B11">11</xref> , <xref ref-type="bibr" rid="B15">15</xref> , <xref ref-type="bibr" rid="B24">24</xref></sup></p>
        <p>Our study had a MACE incidence of 43%, which is higher than the 13% and 36% reported in the literature.<sup><xref ref-type="bibr" rid="B11">11</xref> , <xref ref-type="bibr" rid="B15">15</xref></sup> This high rate of MACE might be due to the institution&#8217;s distinction as a referral center for cardiovascular disease, which leads to a higher than average number of patients with intermediate and high risks of coronary heart disease. Additionally, the exclusive use of hsTnI during this study might explain a higher rate of MACE detection than previously reported. However, despite higher rates of MACE, irrespective of risk status, the HEART score maintained its predictive precision, outperforming both the TIMI and GRACE scores.</p>
        <p>With regards to the sensitivity and the NPV of the tests, we found that the C statistic was higher for the HEART score when using a cutoff of 3 points, which is the limit for the low-risk category. Both the sensitivity and NPV are close to 100%, and they are significantly higher than the sensitivity and NPV of the other two scores. Based on these results it can be concluded that a HEART score below 3 identifies patients that can safely be managed with a conservative strategy with high certainty, given that the risk of adverse cardiovascular outcomes is low.</p>
        <p>Additionally, according to the GiViTi belt method, it is observed that there is adequate calibration between expected and observed outcomes for the low-risk group in the HEART score, as opposed to the low-risk groups in the two other scores analyzed. This supports the potential use of the HEART score as a first line score to stratify risk in patients with chest pain of suspected cardiac origin. Additionally, given its ease of application and adequate validation, it can be a valuable tool to enhance decision making and proper distribution of resources. This has been demonstrated by Mahler et al.,<sup><xref ref-type="bibr" rid="B12">12</xref></sup> with the use of the &#8220;HEART pathway,&#8221; which combines the application of this score with troponin testing upon presentation and 3 hours later. This pathway led to a significant reduction of unnecessary tests and a shorter total hospital stay.<sup><xref ref-type="bibr" rid="B12">12</xref> , <xref ref-type="bibr" rid="B25">25</xref></sup></p>
        <p>To the best of our knowledge, no other studies have reported the performance of risk scores conducted in the era of hsTnI in an exclusively Latin-American population. The prospective nature of the study strengthens the findings. Therefore, these results serve as a validation of previous findings regarding the HEART score, and they should motivate further multicentric projects with larger populations. Also, we believe that these results should expand the use of the HEART score as a valuable tool that aims to facilitate decision making in a challenging patient population.</p>
        <sec>
          <title>Limitations</title>
          <p>The TIMI and GRACE score were developed as tools to quantify risk in patients with an established diagnosis of acute coronary syndrome, whereas the HEART score was designed to assess patients with chest pain. However, despite the difference in their initial objective, in real-world clinical practice they have been used interchangeably. Furthermore, previous studies have compared the scores for risk assessment of chest pain in emergency settings.</p>
          <p>This research protocol was carried out in a single specialized center, which may not accurately reflect the behavior of other populations in centers with different levels of complexity or in different regions or countries. Therefore, new studies with larger, multicentric populations will be required in the future to enhance the applicability of these findings.</p>
          <p>Although the sample size was smaller than initially calculated, the fact that a greater number of MACE (n = 224) was obtained in the analyzed group of 519 patients made it possible to calculate an adequate power greater than 80%.</p>
          <p>Additionally, different factors may affect score applicability, as patients may not always provide accurate clinical history, and therefore risk factors may not be adequately reported. Electrocardiographic changes and troponin elevations may be non-significant in the early stages of myocardial infarction, or they may be falsely elevated by other disorders such as chronic kidney disease, heart failure, arrhythmias, tachycardia, and sepsis, among others.</p>
          <p>Finally, the follow-up information is based on the data provided by patients and their family members, which could limit the reliability of the data. Although the information is based on a structured format with 4 clear questions, it may be subject to misinterpretation.</p>
        </sec>
      </sec>
      <sec sec-type="conclusions">
        <title>Conclusions</title>
        <p>We found that the HEART score was more effective in predicting MACE at 30 days of follow up compared to the TIMI and GRACE scores in the era of hsTnI in an exclusively Latin-American population with chest pain of suspected cardiac origin at a high complexity cardiovascular center.</p>
        <p>The use of hsTnI maintained the previously demonstrated superior performance of the HEART score compared to the TIMI and GRACE scores.</p>
        <p>The HEART score allows for more accurate differentiation of patients with low risks of presenting major cardiovascular events, which will enable physicians to opt for earlier discharge and which may allow savings in hours of in-hospital stay and unnecessary diagnostic tests. This could lead to better care for patients and more efficient distribution of healthcare system resources.</p>
      </sec>
    </body>
    <back>
      <fn-group>
        <fn fn-type="other">
          <p>Study Association</p>
          <p>This study is not associated with any thesis or dissertation work.</p>
        </fn>
        <fn fn-type="other">
          <p>Ethics approval and consent to participate</p>
          <p>This study was approved by the Ethics Committee of the Fundaci&#243;n Cardioinfantil under the protocol number 20-2017. All the procedures in this study were in accordance with the 1975 Helsinki Declaration, updated in 2013. Informed consent was obtained from all participants included in the study.</p>
        </fn>
      </fn-group>
      <fn-group>
        <fn fn-type="supported-by">
          <p>Sources of Funding</p>
          <p>There were no external funding sources for this study.</p>
        </fn>
      </fn-group>
    </back>
  </sub-article>
</article>
