3,515 research outputs found
Emergent associative memory as a local organising principle for global adaptation in adaptive networks
Complex adaptive systems composed of self-interested agents can in some circumstances self-organise into structures that enhance global adaptation or efficiency. However, the general conditions for such an outcome are poorly understood. In contrast, sufficient conditions for artificial neural networks to form structures that perform collective computational processes such as associative memory/recall, generalisation and optimisation, are well-understood. While such global functions within a single agent or organism may arise from mechanisms (e.g., Hebbian learning) that were selected for this purpose, agents in a multi-agent system have no obvious reason to produce such global behaviours when acting from individual interest. However, Hebbian learning is actually a very simple and fully-distributed habituation or positive feedback principle. Here we use an adaptive network model in which agents can modify their behaviours (states) but also their interactions with other agents (network topology). We show that when self-interested agents can modify how they are affected by other agents then, in adapting these inter- agent relationships to maximise their own utility, they will necessarily alter them in a manner homologous with Hebbian learning. When the agents adapt their behaviours relatively quickly, and their relationships with other agents relatively slowly, we find that the overall network dynamics are modified to find better adapted states more reliably. This separation in timescales causes the state dynamics to spend most of their time at attractors. Thus, the network develops an associative memory that amplifies a subset of its own attractor states. This self-organised modification to the network dynamics enhances its ability to resolve conflicts between agents. Moreover, we show that the system is not merely ‘recalling’ high quality states that have been previously visited, but ‘predicting’ their location by generalising over local attractor states that have already been visited. Thus, globally adaptive behaviours can emerge from self-organising adaptive networks that follow organisational principles familiar in connectionist models of organismic learning
How micro-evolution can guide macro-evolution: multi-scale search via evolved modular variation
A divide-and-conquer approach to problem solving can in principle be far more efficient than tackling a problem as a monolithic whole. This type of approach is most appropriate when problems have the type of modular organisation known as near-decomposability, as implicit in many natural and engineered systems. Existing methods create higher scale composite units from non-random combinations of lower-scale units that reflect sub-problem optima. The use of composite units affords search at a higher scale that, when applied recursively, can ultimately lead to optimal top-level solutions. But for this approach to be efficient, we must decompose a problem in a manner that respects its intrinsic modular structure, information which is in general unavailable a priori. Thus, identifying and subsequently exploiting the structure recursively is vital in providing fully automatic problem decomposition.In this thesis, we define a family of algorithms that probabilistically adapt the scale of decomposition they use to reflect the structure in a problem. By doing so, they can provide optimisation that is provably superior to any single scale of search in nearly decomposable problems. Our proposed framework couples two adaptive processes: a rapid, fine-scale search that guides a slower adaptation of the decomposition. This results in a scaling up of the units used in the rapid search, now operating at a macro-scale. We find that separating the timescales for the fine-scale search and the adaptation of the decomposition is crucial for this kind of scalable optimisation. Using a simple and general class of problems that have no systematic structure, we demonstrate how our approach can nevertheless exploit the incidental structure present. Furthermore, we use idealised cases that have simple modular structure to demonstrate how our method scales as ?(N log N) (where N is the problem size), despite the fact that single-scale search methods scale as ? (2 ?N) – and support this distinction analytically.Although our approach is algorithmically superior to single-scale search, the underlying principles that it is constructed from are simple and can operate using only localised feedback. We discuss intriguing parallels between our approach and the significance of associative evolution for ecosystem adaptation. Our results suggest that macro-evolutionary processes might not be merely extended micro-evolution, but that the action of evolutionary processes upon several scales is fundamentally different from the conventional view of (micro-)evolution at a single scale
Transformations in the Scale of Behaviour and the Global Optimisation of Constraints in Adaptive Networks
The natural energy minimisation behaviour of a dynamical system can be interpreted as a simple optimisation process, finding a locally optimal resolution of problem constraints. In human problem solving, high-dimensional problems are often made much easier by inferring a low-dimensional model of the system in which search is more effective. But this is an approach that seems to require top-down domain knowledge; not one amenable to the spontaneous energy minimisation behaviour of a natural dynamical system. However, in this paper we investigate the ability of distributed dynamical systems to improve their constraint resolution ability over time by self-organisation. We use a ‘self-modelling’ Hopfield network with a novel type of associative connection to illustrate how slowly changing relationships between system components can result in a transformation into a new system which is a low-dimensional caricature of the original system. The energy minimisation behaviour of this new system is significantly more effective at globally resolving the original system constraints. This model uses only very simple, and fully-distributed positive feedback mechanisms that are relevant to other ‘active linking’ and adaptive networks. We discuss how this neural network model helps us to understand transformations and emergent collective behaviour in various non-neural adaptive networks such as social, genetic and ecological networks
The Emperor’s New Clothes? An exploratory study into the purpose and effects of uniform with FE
Introduction
There is a long tradition of school uniform within the UK, yet the topic receives relatively little attention in UK-based research, particularly compared with other parts of the world. In my experiences within FE, I have encountered a prevailing narrative that uniform benefits students’ academic and vocational successes, yet I have not seen robust evidence to support this; whilst some studies explore such correlations, few – perhaps none – are situated within FE; yet this research setting has witnessed diminishing numbers of students adhering to uniform policy, against a backdrop of socioeconomic disruption caused at least in part by Covid-19. Accordingly, this research aims to explore purpose and effects of uniform in FE, with a view to informing future policy design within the setting.
Participants and Methods
The research was set in a large FE college in South-East England. Following an extensive literature review, which provides both justification and direction for the research, a particular faculty within the setting was selected, due to the breadth and variety of vocational courses delivered; all staff and students therein were invited to complete questionnaires, answering questions regarding motivation for uniform policy, understanding of policy, use of uniform, feelings towards uniform and perceived effects of uniform. 34 students and 7 staff responded. The questionnaires were a mixture of open ended and Likert-scale-type questions, producing both qualitative and quantitative data. Thematic analysis was applied to the qualitative data in order to produce semantic-based codes.
Results
The questionnaire results illustrated noticeable disparities between staff and students, regarding their respective understanding of uniform, the reasons for such policies and the desire for them. Neoliberalist values were apparent in the staff’s responses, whilst Foucaultian principles were evident not only within the literature review but within college narratives too.
Discussion
I explore emerging tensions within the setting and suggest possible reprecussions for not addressing these issues promptly. I acknowledge particular implications of uniform relating to cost and inclusion, noting injustices felt by some students, and suggest that policy makers would benefit from including both students and employers in their policy-design processes; such collaboration may lead to greater understanding by all stakeholders, of necessary vocational development and its relationship with uniform. Additionally, I note some limitations of the research and make recommendations for future research
Global adaptation in networks of selfish components: emergent associative memory at the system scale
In some circumstances complex adaptive systems composed of numerous self-interested agents can self-organise into structures that enhance global adaptation, efficiency or function. However, the general conditions for such an outcome are poorly understood and present a fundamental open question for domains as varied as ecology, sociology, economics, organismic biology and technological infrastructure design. In contrast, sufficient conditions for artificial neural networks to form structures that perform collective computational processes such as associative memory/recall, classification, generalisation and optimisation, are well-understood. Such global functions within a single agent or organism are not wholly surprising since the mechanisms (e.g. Hebbian learning) that create these neural organisations may be selected for this purpose, but agents in a multi-agent system have no obvious reason to adhere to such a structuring protocol or produce such global behaviours when acting from individual self-interest. However, Hebbian learning is actually a very simple and fully-distributed habituation or positive feedback principle. Here we show that when self-interested agents can modify how they are affected by other agents (e.g. when they can influence which other agents they interact with) then, in adapting these inter-agent relationships to maximise their own utility, they will necessarily alter them in a manner homologous with Hebbian learning. Multi-agent systems with adaptable relationships will thereby exhibit the same system-level behaviours as neural networks under Hebbian learning. For example, improved global efficiency in multi-agent systems can be explained by the inherent ability of associative memory to generalise by idealising stored patterns and/or creating new combinations of sub-patterns. Thus distributed multi-agent systems can spontaneously exhibit adaptive global behaviours in the same sense, and by the same mechanism, as the organisational principles familiar in connectionist models of organismic learning
Symbiosis Enables the Evolution of Rare Complexes in Structured Environments
We present a model that considers evolvable symbiotic associations between species, such that one species can have an influence over the likelihood of other species being present in its environment. We show that this process of 'symbiotic evolution' leads to rare and adaptively significant complexes that are unavailable via non-associative evolution
Kara Gust interviews author and bioregionalist Stephanie Mills
Author and ecologist Stephanie Mills talks about how she started writing and publishing, writing on nature and the environment, the challenges of being a writer, the influence of Michigan on her work, bio-regionalism, and a new book she is working on. Mills is interviewed by Michigan State University Librarian Kara Gust for the Michigan State University Libraries' Michigan Writers Series
Optimisation in ‘Self-modelling’ Complex Adaptive Systems
When a dynamical system with multiple point attractors is released from an arbitrary initial condition it will relax into a configuration that locally resolves the constraints or opposing forces between interdependent state variables. However, when there are many conflicting interdependencies between variables, finding a configuration that globally optimises these constraints by this method is unlikely, or may take many attempts. Here we show that a simple distributed mechanism can incrementally alter a dynamical system such that it finds lower energy configurations, more reliably and more quickly. Specifically, when Hebbian learning is applied to the connections of a simple dynamical system undergoing repeated relaxation, the system will develop an associative memory that amplifies a subset of its own attractor states. This modifies the dynamics of the system such that its ability to find configurations that minimise total system energy, and globally resolve conflicts between interdependent variables, is enhanced. Moreover, we show that the system is not merely ‘recalling’ low energy states that have been previously visited but ‘predicting’ their location by generalising over local attractor states that have already been visited. This ‘self-modelling’ framework, i.e. a system that augments its behaviour with an associative memory of its own attractors, helps us better-understand the conditions under which a simple locally-mediated mechanism of self-organisation can promote significantly enhanced global resolution of conflicts between the components of a complex adaptive system. We illustrate this process in random and modular network constraint problems equivalent to graph colouring and distributed task allocation problems
- …
