24,701 research outputs found
Metadata Representations for Queryable ML Model Zoos
No full textMachine learning (ML) practitioners and organizations are building model zoos of pre-trained models, containing metadata describing properties of the ML models and datasets that are useful for reporting, auditing, reproducibility, and interpretability purposes. The metatada is currently not standardised; its expressivity is limited; and there is no interoperable way to store and query it. Consequently, model search, reuse, comparison, and composition are hindered. In this paper, we advocate for standardized ML model metadata representation and management, proposing a toolkit supported to help practitioners manage and query that metadata.Web Information SystemsHuman-Centred Artificial Intelligenc
A Manifesto of Nodalism
Get PDFThis paper proposes the notion of Nodalism as a means describing contemporary culture and of understanding my own creative practice in electronic music composition. It draws on theories and ideas from Kirby, Bauman, Bourriaud, Deleuze, Guatarri, and Gochenour, to demonstrate how networks of ideas or connectionist neural models of cognitive behaviour can be used to contextualize, understand and become a creative tool for the creation of contemporary electronic music
Optimizing ML Inference Queries Under Constraints
No full textThe proliferation of pre-trained ML models in public Web-based model zoos facilitates the engineering of ML pipelines to address complex inference queries over datasets and streams of unstructured content. Constructing optimal plan for a query is hard, especially when constraints (e.g. accuracy or execution time) must be taken into consideration, and the complexity of the inference query increases. To address this issue, we propose a method for optimizing ML inference queries that selects the most suitable ML models to use, as well as the order in which those models are executed. We formally define the constraint-based ML inference query optimization problem, formulate it as a Mixed Integer Programming (MIP) problem, and develop an optimizer that maximizes accuracy given constraints. This optimizer is capable of navigating a large search space to identify optimal query plans on various model zoos.Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Web Information SystemsHuman-Centred Artificial Intelligenc
Maximum likelihood detection of differentially encoded PSK signals transmitted over Rayleigh frequency-flat fading channels
No full textThe problem of maximum likelihood (ML) detection of differentially encoded M-PSK signals on Rayleigh fading channels is investigated. It is shown that the solution to this problem can be easily related to previous results [Vitetta and Taylor, 1994] and leads to the implementation of a receiver structure based on a Viterbi Algorithm. The error rate performance of this receiver is evaluated by means of computer simulations for both coded and uncoded systems
Systems Informed Positive Education
Get PDFAbstract
Positive psychology as a discipline has focused primarily on understanding and building individual wellbeing. But the application of positive psychology within schools brings a number of challenges that transcend simplistic approaches. Schools are dynamic in nature and subject to numerous pressures and competing priorities. Positive psychology interventions can be helpful, some of the time, for some people, but there is a need to identify and transcend the limiting paradigms that drive our research, practices, and beliefs, moving beyond simplistic interventions and programs to broader awareness and mindful action. Systems Informed Positive Education (SIPE) explicitly incorporates aspects of the systems sciences into positive education practice and pedagogy to cultivate optimal learning environments that bring out the best in each individual and of the school community as a whole. This chapter describes SIPE, illustrates SIPE in action, and highlights key principles and their implications for embedding wellbeing at the heart of education
The ICML 2023 Ranking Experiment: Examining Author Self-Assessment in ML/AI Peer Review
Get PDFWe conducted an experiment during the review process of the 2023 International Conference on Machine Learning (ICML), asking authors with multiple submissions to rank their papers based on perceived quality. In total, we received 1,342 rankings, each from a different author, covering 2,592 submissions. In this paper, we present an empirical analysis of how author-provided rankings could be leveraged to improve peer review processes at machine learning conferences. We focus on the Isotonic Mechanism, which calibrates raw review scores using the author-provided rankings. Our analysis shows that these ranking-calibrated scores out-perform the raw review scores in estimating the ground truth “expected review scores” in terms of both squared and absolute error metrics. Furthermore, we propose several cautious, low-risk applications of the Isotonic Mechanism and author-provided rankings in peer review, including supporting senior area chairs in overseeing area chairs’ recommendations, assisting in the selection of paper awards, and guiding the recruitment of emergency reviewers
Building a generalisable ML pipeline at ING
No full textAdvances in data science have caused an increase in the use of Artificial Intelligence (AI), specifically Machine Learning (ML), throughout various fields. Not only in research but in the industry as well, has ML been receiving increasing amounts of interest. Many companies rely on ML models to increase the efficiency of existing processes or offer new services and products. The industry, however, is facing several additional challenges compared to the academic context. One of those challenges is applying the Development Operations (DevOps) model to an ML application, also referred to as MLOps. This thesis sets out to find the specific challenges that practitioners encounter while operationalising ML models. To do so, we perform a single-case case study on an ML pipeline built by the Trade & Communication Surveillance team at the ING bank. This case study consists of conducting a set of interviews and performing a manual code inspection of the pipeline. The team faces challenges ranging from having insufficient time for operationalising each ML project individually to operating in the highlyregulated fintech context. Their pipeline is able to deploy a single ML model but it does not generalise well to other projects. We present the first version of an application that mitigates these challenges. The application is able to deploy ML models to the development environment at ING and can be operated by data scientists to reduce the effort of operationalising an ML model. Computer Science | Software Technolog
'Project smells' - Experiences in Analysing the Software Quality of ML Projects with mllint
No full textMachine Learning (ML) projects incur novel challenges in their development and productionisation over traditional software applications, though established principles and best practices in ensuring the project's software quality still apply. While using static analysis to catch code smells has been shown to improve software quality attributes, it is only a small piece of the software quality puzzle, especially in the case of ML projects given their additional challenges and lower degree of Software Engineering (SE) experience in the data scientists that develop them. We introduce the novel concept of project smells which consider deficits in project management as a more holistic perspective on software quality in ML projects. An open-source static analysis tool mllint was also implemented to help detect and mitigate these. Our research evaluates this novel concept of project smells in the industrial context of ING, a global bank and large software- and data-intensive organisation. We also investigate the perceived importance of these project smells for proof-of-concept versus production-ready ML projects, as well as the perceived obstructions and benefits to using static analysis tools such as mllint. Our findings indicate a need for context-aware static analysis tools, that fit the needs of the project at its current stage of development, while requiring minimal configuration effort from the user. Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Software EngineeringSoftware Technolog
Audiomobiles, Sculptures and Conundrums
No full textRoberto Gerhard was a pioneer of electronic music in England creating a number of substantial concert, theatre and radio works from as early as 1954. Gerhard’s electronic music is one of the richest repositories for understanding the development of the composer’s late compositional technique. Apart from the Symphony no.3, ‘Collages’, none of Gerhard’s electronic music is published. This paper will discuss aspects of Gerhard’s electronic music, focusing on Audiomobiles (1958-59) and Sculptures (1963)
- …
