Understanding Computational Costs of Cellular-Level Brain Tissue Simulations Through Analytical Performance Models

Computational modeling and simulation have become essential tools in the quest to better understand the brain's makeup and to decipher the causal interrelations of its components. The breadth of biochemical and biophysical processes and structures in the brain has led to the development of a large variety of model abstractions and specialized tools, often times requiring high performance computing resources for their timely execution. What has been missing so far was an in-depth analysis of the complexity of the computational kernels, hindering a systematic approach to identifying bottlenecks of algorithms and hardware. If whole brain models are to be achieved on emerging computer generations, models and simulation engines will have to be carefully co-designed for the intrinsic hardware tradeoffs. For the first time, we present a systematic exploration based on analytic performance modeling. We base our analysis on three in silico models, chosen as representative examples of the most widely employed modeling abstractions: current-based point neurons, conductance-based point neurons and conductance-based detailed neurons. We identify that the synaptic modeling formalism, i.e. current or conductance-based representation, and not the level of morphological detail, is the most significant factor in determining the properties of memory bandwidth saturation and shared-memory scaling of in silico models. Even though general purpose computing has, until now, largely been able to deliver high performance, we find that for all types of abstractions, network latency and memory bandwidth will become severe bottlenecks as the number of neurons to be simulated grows. By adapting and extending a performance modeling approach, we deliver a first characterization of the performance landscape of brain tissue simulations, allowing us to pinpoint current bottlenecks for state-of-the-art in silico models, and make projections for future hardware and software requirements.

Simulation Neurotechnologies for Advancing Brain Research: Parallelizing Large Networks in NEURON

Michael Lee Hines, Felix Schürmann

Large multiscale neuronal network simulations are of increasing value as more big data are gathered about brain wiring and organization under the auspices of a current major research initiative, such as Brain Research through Advancing Innovative Neurotechnologies. The development of these models requires new simulation technologies. We describe here the current use of the NEURON simulator with message passing interface (MPI) for simulation in the domain of moderately large networks on commonly available high-performance computers (HPCs). We discuss the basic layout of such simulations, including the methods of simulation setup, the run-time spike-passing paradigm, and postsimulation data storage and data management approaches. Using the Neuroscience Gateway, a portal for computational neuroscience that provides access to large HPCs, we benchmark simulations of neuronal networks of different sizes (500-100,000 cells), and using different numbers of nodes (1-256). We compare three types of networks, composed of either Izhikevich integrate-and-fire neurons (I&F), single-compartment Hodgkin-Huxley (HH) cells, or a hybrid network with half of each. Results show simulation run time increased approximately linearly with network size and decreased almost linearly with the number of nodes. Networks with I&F neurons were faster than HH networks, although differences were small since all tested cells were point neurons with a single compartment.

Mit Press2016

Simple Neuron Models and Adaptation

Skander Mensi

Predicting activity of single neuron is an important part of the computational neuroscience and a great challenge. Several mathematical models exist, from the simple (one compartment and few parameters, like the SRM or the IF-type models), to the more complex (biophysical model like the Hodgkin-Huxley model). All these models have their own advantages and limitations, but no one is able to reproduce the exact behavior of real neurons. Multiple projects try to simulate complex neural networks, or even the whole brain (i.e. the blue brain project or other big network simulation). To achieve this goal it is very important that simple neuron models simulate, for a low computational cost, the precise activities of all neuron classes. It is well-known that neurons exhibit a lot of different activity patterns (from an electro-physiological point of view). Here we have focused on pyramidal neurons from the layer 5 of the neocortex. They are classified as regular spiking-cells. This cell type shows adaptation and like other neurons, refractoriness. Adaptation and refractoriness are very common neuronal activity in the brain, and so it is important to have a simple model which can reproduce this kind of activity. This project deals with two classical simple neuron models: the adaptive exponential integrate-and-fire model (AdEx) and the spike response model (SRM). We deter- mined the parameters of these two models using data generated with a detailed model, the Destexhe's model which is a HH-like model for cortical pyramidal cells, stimulated with different current injection scenarios. In a second time the model parameters have been set using data from in-vitro recordings of 4 layer 5 pyramidal rat neurons, stimulated with a sinusoid in vivo-like protocol, injected somatically in current-clamp configuration. Then we show that this type of model can capture adaptation and can reproduce the activity of neuron with a high reliability

2008

Emergent Properties of in silico Synaptic Transmission in a Model of the Rat Neocortical Column

Srikanth Ramaswamy

The cerebral cortex occupies nearly 80% of the entire volume of the mammalian brain and is thought to subserve higher cognitive functions like memory, attention and sensory perception. The neocortex is the newest part in the evolution of the cerebral cortex and is perhaps the most intricate brain region ever studied. The neocortical microcircuit is the smallest Œecosystem‚ of the neocortex that consists of a rich assortment of neurons, which are diverse in both their morphological and electrical properties. In the neocortical microcircuit, neurons are horizontally arranged in 6 distinct sheets called layers. The fundamental operating unit of the neocortical microcircuit is believed to be the Neocortical Column (NCC). Functionally, a single NCC is an arrangement of thousands of neurons in a vertical fashion spanning across all the 6 layers. The structure of the entire neocortex arises from a repeated and stereotypical arrangement of several thousands of such columns, where neurons transmit information to each other through specialized points of information transfer called synapses. The dynamics of synaptic transmission can be as diverse as the neurons defining a connection and are crucial to foster the functional properties of the neocortical microcircuit. The Blue Brain Project (BBP) is the first comprehensive endeavour to build a unifying model of the NCC by systematic data integration and biologically detailed simulations. Through the past 5 years, the BBP has built a facility for a data-constraint driven approach towards modelling and integrating biological information across multiple levels of complexity. Guided by fundamental principles derived from biological experiments, the BBP simulation toolchain has undergone a process of continuous refinement to facilitate the frequent construction of detailed in silico models of the NCC. The focus of this thesis lies in characterizing the functional properties of in silico synaptic transmission by incorporating principles of synaptic communication derived through biological experiments. In order to study in silico synaptic transmission it is crucial to gain an understanding of the key players influencing the manner in which synaptic signals are processed in the neocortical microcircuit - ion channel kinetics and distribution profiles, single neuron models and dynamics of synaptic pathways. First, by means of exhaustive literature survey, I identified ion channel kinetics and their distribution profiles on neocortical neurons to build in silico ion channel models. Thereafter, I developed a prototype framework to analyze the somatic and dendritic features of single neuron models constrained by ion channel kinetics. Finally, within a simulation framework integrating the ion channels, single neuron models and dynamics of synaptic transmission, I replicated in vitro experimental protocols in silico, to characterize the transmission properties of monosynaptic connections. These synaptic connections, arising from the axo-dendritric apposition of neuronal arbours were sampled across many instances of in silico NCC models constructed a priori through the BBP simulation toolchain. In this thesis, I show that when principles of synaptic transmission derived from in vitro experiments are incorporated to model in silico synaptic connections, the resulting anatomy and physiology of synaptic connections modelled from elementary biological rules closely match in vitro data. This thesis work demonstrates that the average synaptic response properties in silico are robust to perturbations in the anatomical and physiological properties of modelled connections in the local neocortical microcircuit. A fundamental discovery through this thesis is an insight into the function of the local neocortical microcircuit by examining the effect of morphological diversity on in silico synaptic transmission. I demonstrate here that intrinsic morphological diversity confers an invariance to the average synaptic response properties in silico in the local neocortical microcircuit, termed "microcircuit level robustness and invariance".