205 research outputs found
GUI-WORLD: A Dataset for GUI-oriented Multimodal LLM-based Agents
Recently, Multimodal Large Language Models (MLLMs) have been used as agents
to control keyboard and mouse inputs by directly perceiving the Graphical User
Interface (GUI) and generating corresponding code. However, current agents
primarily exhibit excellent understanding capabilities in static environments
and are predominantly applied in relatively simple domains, such as Web or
mobile interfaces. We argue that a robust GUI agent should be capable of
perceiving temporal information on the GUI, including dynamic Web content and
multi-step tasks. Additionally, it should possess a comprehensive understanding
of various GUI scenarios, including desktop software and multi-window
interactions. To this end, this paper introduces a new dataset, termed
GUI-World, which features meticulously crafted Human-MLLM annotations,
extensively covering six GUI scenarios and eight types of GUI-oriented
questions in three formats. We evaluate the capabilities of current
state-of-the-art MLLMs, including ImageLLMs and VideoLLMs, in understanding
various types of GUI content, especially dynamic and sequential content. Our
findings reveal that ImageLLMs struggle with dynamic GUI content without
manually annotated keyframes or operation history. On the other hand, VideoLLMs
fall short in all GUI-oriented tasks given the sparse GUI video dataset. Based
on GUI-World, we take the initial step of leveraging a fine-tuned VideoLLM as a
GUI agent, demonstrating an improved understanding of various GUI tasks.
However, due to the limitations in the performance of base LLMs, we conclude
that using VideoLLMs as GUI agents remains a significant challenge. We believe
our work provides valuable insights for future research in dynamic GUI content
understanding. The code and dataset are publicly available at our project
homepage: https://gui-world.github.io/
Methods of Divination Found in Jiaoshi Yilin: A Study of the Bibliography and Characteristic Features the Extant Texts
Jiaoshi Yilin 焦氏易林 (hereafter Yilin) is a book of divination, which is thought to be written by Jiao Yanshou 焦延壽, who served the imperial court of Former Han Dynasty Emperor Zhao (昭帝; r. 87–74 BCE). This article takes up the issue of the work’s approach to divination, which has been argued to conform to shifa 筮法 of I-Ching 易經. However, during the Song Period, a debate arose regarding that approach, resulting in a method of adoption quite dissimilar to that of I-Ching. The author proceeds to examine for the first time the Yilin approach to divination focusing on that very controversy and the discussions that have followed up to the present day.
The author begins by laying out the characteristic features of the work and compiling a bibliographical genealogy of the extant copies. The existing genre may be generally categorized into the Yuan-Period manuscript (元抄本), the Ming-Period print (明刻本) and the Song-Period collated print (校宋本), the last of which is thought to be based on the first, in spite of its name. The author argues that one reason why large discrepancies exist between the texts of the Yuan manuscript and the Ming print is that the former was based on a version which predated the collation done by Huang Bosi 黃伯思 (1079–1119), while the latter postdated it. Moreover, the manuscript which the author discovered in the National Library of China contains prefaces which carries information regarding the fengua-zhiri 分卦直日 method of assigning hexagrams to days of the month.
The author then turns to Yilin’s methodology via an examination of the prefaces to the texts and related sources from the Song Period, which reveals at least three possibilities: 1) the I-Ching method for deriving hexagrams using divining sticks; 2) the above mentioned fengua-zhiri method; and 3) a combination of 1) and 2). That being said, since the fengua-zhiri method was specifically discussed during the Song Period, it was probably first proposed at that time in the work’s history, leading the author to conclude that as it is impossible to state definitively what the orthodox divination method of Yilin is, it should be considered as a work outlining a number of different approaches.journal articl
Desiccation cracking in unsaturated soils
A comprehensive study of desiccation shrinkage and cracking in unsaturated soils is performed, including macroscopic and microscopic desiccation tests on two commercially available soils. In addition, a new fully coupled drainage-deformation numerical model is developed for analysing desiccation in variably saturated soils. The contributions made in this thesis include: i) a new set of experimental data for unconstrained and linear constrained desiccation testing of clayey soils as well as drying induced crack pattern test data, ii) new experimental data on the effect of micro-structure on desiccation induced cracking, investigated using scanning emission microscopic and image analysis techniques, iii) a 2-dimensional pore-network model prediction of soil water characteristic curve (SWCC) in unsaturated soils, iv) a model for a realistic reconstruction of pore size distribution in soils based on the particle size distribution curve of the soil constrained by the void ratio, and v) a fully coupled two-phase distinct lattice spring model (DLSM) to simulate desiccation shrinkage and cracking in soil, taking into account explicitly the interaction of pore fluid with the deformation of the soil matrix through a new water bond constitutive model. All the input model parameters are physically identified, and procedures are discussed for their determination in the laboratory. All constitutive and numerical models proposed are verified against experimental data generated during the course of this investigation as well as data from the literature. Remarkable agreement between numerical results and experimental data are obtained in all the cases considered.
Through the study of the desiccation test results, it is revealed that three important parameters control cracking of soil during desiccation: air entry value of the largest pores, heterogeneity of pore size distribution, and constraints (e.g., traction or friction boundary condition, residual stresses in the soil, and soil structure with the help of traction or friction boundary condition)
Occult Verse: Poetry, Divination and Classical Exegesis in Han China (202 BCE 220 CE): A Study of the Han Divination Manual Jiaoshi Yilin 焦氏易林
The present thesis sets out to examine a divination manual entitled Jiaoshi Yilin 焦氏易林 _(Mister Jiao’s Forest of Changes), which began to circulate around the late Western Han (202 BCE-8 CE) to the early Eastern Han period (25 CE-220 CE). The manual consists of 4096 oracular poems appropriated from classical sources including theShijing詩經 _(Classic of Songs), theZhouyi周易 _(Zhou Changes) and the Chunqiu春秋 _(Spring and Autumn [Annals]). The text has previously been examined in author-oriented studies mainly as an anthology of four-syllable verse, or as a summa of philosophical contemplation of the Han philosopher Jiao Yanshou焦延壽 _(fl.1 cent. BCE). Through applying hermeneutics and reception aesthetics theory, the present thesis shifts the focus from the “author” to the “reader”. It aims to illustrate how the classics were interpreted and adapted in a cosmological discourse in order to meet the demands of readers who wished to procure future knowledge and guidance for making daily decisions.My study presents an alternative Han reading of the classics, which instead of being underpinned by political, moral, and philosophical concerns, focused more on divinatory settings and utilitarian applications for resolving life problems. The study is intended to enrich our understanding of the transmission and permeation of the tenets and precedents in classics in the wider social fabric and stratum. In Chapter 1, after reviewing the debate over the authorship and authenticity of the manual, I advance that from the perspective of transmission of mantic knowledge centredon texts in the Han period, readers and transmitters had an active role in the compilation of mantic texts. Jiaoshi Yilin was a composite text with collective authorship. The inconsistencies in the literary style, interpolations and miscellaneous contents targeting different groups of readers are indicative of the multi-layered nature ofthe text. From the phonetic system, the historical events referred to in the text and the belief in the cult of the Queen Mother of the West embedded in the text, it can be deduced that an early version of the manual was compiled sometime between the first century BCE to the first century CE. I also arguethat Jiaoshi Yilinwas not related tothezhiri值日 _([sixty four Hexagrams] corresponding to the days) method, which was attributed to the ascribed author Jiao Yanshou. Instead,Jiaoshi Yilinwas meant to be used with the zhigua之卦 _(changing hexagrams)method,which was observed in milfoil stalk divination in the Spring and Autumn and Warring States periods. The application of the zhigua method in Jiaoshi Yilinreflected the standardisation and popularisation of milfoil stalk divination during the Han period. Chapter 2 delineates the historical and intellectual context of the prophetic interpretation of classics in texts like Jiaoshi Yilin. The chapter postulates that the classics were imbued with divine authority, prophetic and talismanic properties to make prophecies in the correlative cosmological model embraced bytheHan society. The readers of the classics were conflated with occultists in their shared hermetic knowledge and in their roles at court. In addition, the ethical standards promulgated in the classics such aswuchang五常 _(five consistencies)and sangang 三綱 _(three bonds) were further absorbed in the cosmological discourse, and reconciled with terms and tenets in that discourse such asyinyangand wuxing五行 _(five phases). Therefore, it was the interaction between the technical-occult tradition and Han Confucianism that shaped the reception of the classics in a prophetic context. Chapters 3, 4, and 5 explore the strategies and characteristics of the interpretation of the classics in Jiaoshi Yilinby comparing the prophetic interpretations in this text with interpretations of the same classical sources in classical commentaries. Chapter 3 focuses on orthographical and lexical features of the appropriation of the ShijinginJiaoshi Yilinby comparing graphic and lexical variations with their counterparts in the Mao recension of theShijing. It can be noted that the readings inJiaoshi Yilinthat are at odds with the Maoshirepresent an alternative understanding and creative engagement on the part of the Han readership. In particular, archaic language was replaced with updated and colloquial language in Jiaoshi Yilin. Chapter 4 compares Jiaoshi Yilin’s interpretation of the imagery in the Shijingwith the interpretation in Mao commentaries and in Zheng Xuan’s annotations. Chapter 5 lists the commentaries on theZhouyiby the school of xiangshu象數 _(images and numbers)to highlight strategies and assumptions in the explanation of theZhouyiin Jiaoshi Yilin. The comparison shows that in their interpretationsof the classics, Jiaoshi Yilinand the classical commentaries shared language and strategies inspired by the correlative mode of thought, and both interpretations linked the ethical values promulgated in the classics with cosmological categories. Nevertheless, Jiaoshi Yilin’s interpretation is characterised by a concern for personal welfare and by its esoteric interests
Shakespeare and Space
Co-editor of book, with Cong Cong, and author of the chapter 'London, Stratford, Coventry: Shakespearean theatre and the spaces of history
Bridging the Attitude-Behaviour Gap in Household Energy Consumption
The attitude-behaviour gap in energy consumption refers to the imparity between people's environmental values (and attitudes) and their actual behavior in consumption. This paper calls for the facilitation of the behaviour change process that is implementable in the context of one's everyday life to address the attitude-behaviour gap in household energy consumption. Two interrelated intervention design constructs are proposed based on the results of literature review, namely (1) providing consumers accurate information about actionable suggestions in the specific context of their everyday life, and (2) fostering consumers' motivation to engage in the behavior change process towards energy conservation. Smart Grid technologies are instrumental in both intervention types.Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.System Engineerin
Parallel session 2a : Teaching and learning innovations
Presented Titles: Can Blended Learning Ease the Impact of COVID-19 in Rural Schools in Sabah, Malaysia? [Authors: Hamzah Nor bin Aedy Rahman; Santiana Ramli] An Exploration of the Impact of Student Engagement in Extracurricular Activities in One Taiwan University on Their Hope of Jobs under COVID-19 Crisis [Author: Pei-Wen Chen] A Tale of Two Cities in Service-Learning: Cross-Cultural Comparison Between Hong Kong and Singapore of Student Developmental Outcomes After Service-Learning Experience and Validation of S-LOMS [Authors: Ka Hing Lau; Robin Stanley Snell] The Impact of The Epidemic on the Decision-Making and Behaviour of Elite College Students Studying Abroad: A Qualitative Study across Three Time Periods [Authors: Wenqin Shen; Yilin Chai; Jing Feng; Ziyou Mo
Preparation of activated carbon from walnut shell and its application in industrial wastewater
Specific measures of emporium fire loss prevention ability improvement
AbstractThe present loss prevention of the majority emporium focus on the economic loss prevention, neglects of the fire and other disasters losses, and lacks of effective measures of fire loss prevention and other disasters. The early emporium fire detection and alarm measures based on Lambert-Beer Law was analyzed and discussed, and the transmittance curve and three-dimensional camber of an ellipsoid fire fume were researched, during the time from fume occurring to expanding, the transmittance of fume ellipsoid increases in nonlinear as the ellipsoid volume increasing, the distribution of transmittance contour accords with exponent curve. The transmittance approximates 0 in the fire fume occurred instant, and increases and approximates to 1 with the fume volume increasing. The specific safety management measures of emporium fire loss prevention included the fire control safety education, fire service installations routine check and maintenance and management of fire hazards; the corresponding fire emergency measures included the fire plan development, evacuation and sending fire message in time were advanced. In very early fire, the period of enough CO, CO2 produced is much early than smoke and flame. The early emporium fire detection and alarm measures based on Lambert-Beer Law used the relationship between the transmittance T of absorbed monochromatic light and the concentration C or the thickness F of the substance, detecting the levels of CO, CO2 in the emporium air, can detect and alarm in the fire early smouldering or brewing process. Such detection and alarm measures can provide more time to the fire control works, and minimize the fire losses. The specific safety management measures of emporium fire loss prevention and the corresponding fire emergency measures discussed can also effectively improve the emporium loss prevention capabilities on the various fire stages
Strategic Use of Data Assimilation for Dynamic Data-Driven Simulation
Dynamic data-driven simulation (DDDS) incorporates real-time measurement data to improve simulation models during model run-time. Data assimilation (DA) methods aim to best approximate model states with imperfect measurements, where particle Filters (PFs) are commonly used with discrete-event simulations. In this paper, we study three critical conditions of DA using PFs: (1) the time interval of iterations, (2) the number of particles and (3) the level of actual and perceived measurement errors (or noises), and provide recommendations on how to strategically use data assimilation for DDDS considering these conditions. The results show that the estimation accuracy in DA is more constrained by the choice of time intervals than the number of particles. Good accuracy can be achieved without many particles if the time interval is sufficiently short. An over estimation of the level of measurement errors has advantages over an under estimation. Moreover, a slight over estimation has better estimation accuracy and is more responsive to system changes than an accurate perceived level of measurement errors.Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.System EngineeringPolicy Analysi
- …
