31 research outputs found
CMT: A Memory Compression Method for Continual Knowledge Learning of Large Language Models
No full textLarge Language Models (LLMs) need to adapt to the continuous changes in data, tasks, and user preferences. Due to their massive size and the high costs associated with training, LLMs are not suitable for frequent retraining. However, updates are necessary to keep them in sync with rapidly evolving human knowledge. To address these challenges, this paper proposes the Compression Memory Training (CMT) method, an efficient and effective online adaptation framework for LLMs that features robust knowledge retention capabilities.
Inspired by human memory mechanisms, CMT compresses and extracts information from new documents to be stored in a memory bank. When answering to queries related to these new documents, the model aggregates these document memories from the memory bank to better answer user questions. The parameters of the LLM itself do not change during training and inference, reducing the risk of catastrophic forgetting. To enhance the encoding, retrieval, and aggregation of memory, we further propose three new general and flexible techniques, including memory-aware objective, self-matching and top-k aggregation. Extensive experiments conducted on three continual learning datasets (i.e., StreamingQA, SQuAD and ArchivalQA) demonstrate that the proposed method improves model adaptability and robustness across multiple base LLMs (e.g., +4.07 EM & +4.19 F1 in StreamingQA with Llama-2-7b)
California Environmental Protection Agency
No full textPlease include the attached comments on the Office ofEnvironmental Health Hazard Assessment's (OEHHA) draft CrVI public health goal (PHG) released for public comment in August 2009. We believe that these comprehensive comments address the many weaknesses in the proposed PHG requiring further evaluation and appropriate change to the proposed PHG at this time. We further believe that the now ongoing research at The Hamner Institutes will result in the provision of critical scientific findings which may have significant impacts on the level and scientific credibility of the PHG for CrVl proposed by OEHHA. Since the Hamner Institutes r~search will be completed within the coming year we ask that OEHHA consider wahing to finalize this PHG until OEHHA has considered the findings ofthat research. Thank you for the opportunity to comment.. Sincerely, f'\J \ ~:--···~-~--~
Association of left ventricular strain and E/e’ ratio with carotid wall layers
No full textIn an interesting report published in July 2020, Nakanishi et al. showed that greater carotid intima-media thickness (cIMT) was associated with abnormal left ventricular (LV) global longitudinal strain (GLS) and E/e’ ratio values in a community-based population [ [1] ]. As stated by the authors, the mechanisms underlying these associations are still uncertain. It is noteworthy that cIMT does not discriminate wall thickening due to increases in intima thickness (cIT), a more proper marker of atherosclerosis, or media thickness (cMT), a layer mostly composed of vascular smooth muscle cells [ [2] , [3] ]. Therefore, evaluation of carotid wall layers might provide additional insights regarding the relationship between cIMT and markers of cardiac function31010911
Cervical Arterial Dissections and Association With Cervical Manipulative Therapy
No full textCervical artery dissections (CDs) are among the most common causes of stroke in young and middle-aged adults. The aim of this scientific statement is to review the current state of evidence on the diagnosis and management of CDs and their statistical association with cervical manipulative therapy (CMT). In some forms of CMT, a high or low amplitude thrust is applied to the cervical spine by a healthcare professional.
Members of the writing group were appointed by the American Heart Association Stroke Council's Scientific Statements Oversight Committee and the American Heart Association's Manuscript Oversight Committee. Members were assigned topics relevant to their areas of expertise and reviewed appropriate literature, references to published clinical and epidemiology studies, morbidity and mortality reports, clinical and public health guidelines, authoritative statements, personal files, and expert opinion to summarize existing evidence and to indicate gaps in current knowledge.
Patients with CD may present with unilateral headaches, posterior cervical pain, or cerebral or retinal ischemia (transient ischemic or strokes) attributable mainly to artery-artery embolism, CD cranial nerve palsies, oculosympathetic palsy, or pulsatile tinnitus. Diagnosis of CD depends on a thorough history, physical examination, and targeted ancillary investigations. Although the role of trivial trauma is debatable, mechanical forces can lead to intimal injuries of the vertebral arteries and internal carotid arteries and result in CD. Disability levels vary among CD patients with many having good outcomes, but serious neurological sequelae can occur. No evidence-based guidelines are currently available to endorse best management strategies for CDs. Antiplatelet and anticoagulant treatments are both used for prevention of local thrombus and secondary embolism. Case-control and other articles have suggested an epidemiologic association between CD, particularly vertebral artery dissection, and CMT. It is unclear whether this is due to lack of recognition of preexisting CD in these patients or due to trauma caused by CMT. Ultrasonography, computed tomographic angiography, and magnetic resonance imaging with magnetic resonance angiography are useful in the diagnosis of CD. Follow-up neuroimaging is preferentially done with noninvasive modalities, but we suggest that no single test should be seen as the gold standard.
CD is an important cause of ischemic stroke in young and middle-aged patients. CD is most prevalent in the upper cervical spine and can involve the internal carotid artery or vertebral artery. Although current biomechanical evidence is insufficient to establish the claim that CMT causes CD, clinical reports suggest that mechanical forces play a role in a considerable number of CDs and most population controlled studies have found an association between CMT and VAD stroke in young patients. Although the incidence of CMT-associated CD in patients who have previously received CMT is not well established, and probably low, practitioners should strongly consider the possibility of CD as a presenting symptom, and patients should be informed of the statistical association between CD and CMT prior to undergoing manipulation of the cervical spine
Identifying Genetic Biomarkers Predicting Response to Anti-Vascular Endothelial Growth Factor Injections in Diabetic Macular Edema
No full textIntraocular anti-vascular endothelial growth factor (VEGF) therapies are the front-line treatment for diabetic macular edema (DME); however, treatment response varies widely. This study aimed to identify genetic determinants associated with anti-VEGF treatment response in DME. We performed a genome-wide association study on 220 Australian patients with DME treated with anti-VEGF therapy, genotyped on the Illumina Global Screening Array, and imputed to the Haplotype Reference Consortium panel. The primary outcome measures were changes in central macular thickness (CMT in microns) and best-corrected visual acuity (BCVA in ETDRS letters) after 12 months. Association between single nucleotide polymorphism (SNP) genotypes and DME outcomes were evaluated by linear regression, adjusting for the first three principal components, age, baseline CMT/BCVA, duration of diabetic retinopathy, and HbA1c. Two loci reached genome-wide significance (p < 5 × 10−8) for association with increased CMT: a single SNP on chromosome 6 near CASC15 (rs78466540, p = 1.16 × 10−9) and a locus on chromosome 12 near RP11-116D17.1 (top SNP rs11614480, p = 2.69 × 10−8). Four loci were significantly associated with reduction in BCVA: two loci on chromosome 11, downstream of NTM (top SNP rs148980760, p = 5.30 × 10−9) and intronic in RP11-744N12.3 (top SNP rs57801753, p = 1.71 × 10−8); one near PGAM1P1 on chromosome 5 (rs187876551, p = 1.52 × 10−8); and one near TBC1D32 on chromosome 6 (rs118074968, p = 4.94 × 10−8). In silico investigations of each locus identified multiple expression quantitative trait loci and potentially relevant candidate genes warranting further analysis. Thus, we identified multiple genetic loci predicting treatment outcomes for anti-VEGF therapies in DME. This work may potentially lead to managing DME using personalized treatment approaches
Identifying Genetic Biomarkers Predicting Response to Anti-Vascular Endothelial Growth Factor Injections in Diabetic Macular Edema
No full textIntraocular anti-vascular endothelial growth factor (VEGF) therapies are the front-line treatment for diabetic macular edema (DME); however, treatment response varies widely. This study aimed to identify genetic determinants associated with anti-VEGF treatment response in DME. We performed a genome-wide association study on 220 Australian patients with DME treated with anti-VEGF therapy, genotyped on the Illumina Global Screening Array, and imputed to the Haplotype Reference Consortium panel. The primary outcome measures were changes in central macular thickness (CMT in microns) and best-corrected visual acuity (BCVA in ETDRS letters) after 12 months. Association between single nucleotide polymorphism (SNP) genotypes and DME outcomes were evaluated by linear regression, adjusting for the first three principal components, age, baseline CMT/BCVA, duration of diabetic retinopathy, and HbA1c. Two loci reached genome-wide significance (p < 5 × 10−8) for association with increased CMT: a single SNP on chromosome 6 near CASC15 (rs78466540, p = 1.16 × 10−9) and a locus on chromosome 12 near RP11-116D17.1 (top SNP rs11614480, p = 2.69 × 10−8). Four loci were significantly associated with reduction in BCVA: two loci on chromosome 11, downstream of NTM (top SNP rs148980760, p = 5.30 × 10−9) and intronic in RP11-744N12.3 (top SNP rs57801753, p = 1.71 × 10−8); one near PGAM1P1 on chromosome 5 (rs187876551, p = 1.52 × 10−8); and one near TBC1D32 on chromosome 6 (rs118074968, p = 4.94 × 10−8). In silico investigations of each locus identified multiple expression quantitative trait loci and potentially relevant candidate genes warranting further analysis. Thus, we identified multiple genetic loci predicting treatment outcomes for anti-VEGF therapies in DME. This work may potentially lead to managing DME using personalized treatment approaches
Identifying genetic biomarkers predicting response to anti-vascular endothelial growth factor injections in diabetic macular edema
No full textIntraocular anti-vascular endothelial growth factor (VEGF) therapies are the front-line treatment for diabetic macular edema (DME); however, treatment response varies widely. This study aimed to identify genetic determinants associated with anti-VEGF treatment response in DME. We performed a genome-wide association study on 220 Australian patients with DME treated with anti-VEGF therapy, genotyped on the Illumina Global Screening Array, and imputed to the Haplotype Reference Consortium panel. The primary outcome measures were changes in central macular thickness (CMT in microns) and best-corrected visual acuity (BCVA in ETDRS letters) after 12 months. Association between single nucleotide polymorphism (SNP) genotypes and DME outcomes were evaluated by linear regression, adjusting for the first three principal components, age, baseline CMT/BCVA, duration of diabetic retinopathy, and HbA1c. Two loci reached genome-wide significance (p −8) for association with increased CMT: a single SNP on chromosome 6 near CASC15 (rs78466540, p = 1.16 × 10−9) and a locus on chromosome 12 near RP11-116D17.1 (top SNP rs11614480, p = 2.69 × 10−8). Four loci were significantly associated with reduction in BCVA: two loci on chromosome 11, downstream of NTM (top SNP rs148980760, p = 5.30 × 10−9) and intronic in RP11-744N12.3 (top SNP rs57801753, p = 1.71 × 10−8); one near PGAM1P1 on chromosome 5 (rs187876551, p = 1.52 × 10−8); and one near TBC1D32 on chromosome 6 (rs118074968, p = 4.94 × 10−8). In silico investigations of each locus identified multiple expression quantitative trait loci and potentially relevant candidate genes warranting further analysis. Thus, we identified multiple genetic loci predicting treatment outcomes for anti-VEGF therapies in DME. This work may potentially lead to managing DME using personalized treatment approaches.</p
Dynamin 2 and human diseases
No full textInternational audienceDynamin 2 (DNM2) mutations cause autosomal dominant centronuclear myopathy (CNM), a rare form of congenital myopathy, and intermediate and axonal forms of Charcot-Marie-Tooth disease (CMT), a peripheral neuropathy. DNM2 is a large GTPase mainly involved in membrane trafficking through its function in the formation and release of nascent vesicles from biological membranes. DNM2 participates in clathrin-dependent and clathrin-independent endocytosis and intracellular membrane trafficking (from endosomes and Golgi apparatus). Recent studies have also implicated DNM2 in exocytosis. DNM2 belongs to the machinery responsible for the formation of vesicles and regulates the cytoskeleton providing intracellular vesicle transport. In addition, DNM2 tightly interacts with, and is involved in the regulation of actin and microtubule networks, independent from membrane trafficking processes. We summarize here the molecular, biochemical and functional data on DNM2 and discuss the possible pathophysiological mechanisms via which DNM2 mutations can lead to two distinct neuromuscular disorders
Dreaming and adaptation: the perspective of control- mastery theory
No full textThe aim of this paper is to illustrate the meaning and functions of dreams according to controlmastery theory (CMT), a cognitive-dynamic relational theory developed and empirically validated in the last 40 years by the San Francisco Psychotherapy Research Group (Gazzillo, 2016; Silberschatz, 2005; Weiss, 1993a; Weiss, Sampson, & the Mount Zion Psychotherapy Research Group, 1986). CMT stresses how dreams reflect the person's efforts to adapt to reality; their production is regulated by a safety principle and is an expression of human unconscious higher adaptive functions. According to this model, dreams represent our unconscious attempts to find solutions to emotionally relevant problems. In dreams people think about their main concerns, particularly those concerns that they have been unable to solve by conscious thought alone, and they try to develop and test plans and policies for dealing with them. After having introduced the reader to the main concepts of CMT, we will illustrate the different facets of the CMT model of dreams with several clinical examples. Finally, we will describe the core elements of recently developed models of dream functions and meanings based on empirical research on sleep and dreams, and we will show their substantial compatibility with hypotheses proposed by CMT
AVALIAÇÃO DA CONCENTREAÇÃO DO LACTATO DESIDROGENASE EM CADELAS PORTADORAS DE NEOPLASIAS MAMÁRIAS
Get PDFThe increase in lactate dehydrogenase (LDH) activity is associated with hypoxia due to the rapid proliferation of cancer cells and high metabolic demands. Few studies have evaluated the LDH concentration in canine mammary tumor (CMT). Thus, the objective of this work was to evaluate serum LDH concentrations in CMT and its association with prognostic factors. Thirty bitches participated in the work and were divided equally into two groups, with and without CMT. The average concentration of LDH was significantly higher in CMT (424.9±244.4 U / L) compared to the control group (299.0±170.3 U / L) and its values were positively correlated with inflammation and / or macroscopic ulceration (r=0.6), tumor size (r=0.5), histopathological grade (r=0.6), metastatic lymph node (r=0.7) and clinical stage (r=0.5).O aumento da atividade da lactato desidrogenase (LDH) está associado à hipóxia devido à rápida proliferação de células cancerígenas e altas demandas metabólicas. Poucos estudos avaliaram a concentração de LDH em tumor mamário canino (CMT). Assim, o objetivo deste trabalho foi avaliar as concentrações séricas de LDH na CMT e sua associação com fatores prognósticos. Trinta cadelas participaram do trabalho e foram divididas igualmente em dois grupos, com e sem CMT. A concentração média de LDH foi significativamente maior no CMT (424,9±244,4 U/L) em comparação ao grupo controle (299,0±170,3 U/L) e seus valores foram positivamente correlacionados com inflamação e/ou ulceração macroscópica (r=0,6), tamanho do tumor (r=0,5), grau histopatológico (r=0,6), linfonodo metastático (r=0,7) e estágio clínico (r=0,5)
