LABSIM (LABoratoire de SIMulation), created mid-October 2010, was initially designed to support ; human-system interaction in aeronautics, rotary-wings operations & systems research studies in order to reveal innovative interaction concepts, prototype & evaluate them in piloted simulation.
VR principles, the LABSIM capabilities can be classified into 3 categories Biophysical Sensors “Quantifying & modeling the human behavior” Sensory-motor devices “Exploring next-gen piloting interfaces”
“Modelling the flight behaviour with high fidelity” Following the VR principles, the LABSIM capabilities can be classified into 3 categories Biophysical Sensors “Quantifying & modeling the human behavior” Sensory-motor devices “Exploring next-gen piloting interfaces”
maintain three physical means : LIPS laboratory for pilot/system interaction studies SCHEME prototyping bench for innovative interfaces PYCSHEL prototyping & conception of systems for helicopters
bench stand for PrototYping & Conception of Systems for HELicopter. It allows the researcher to design, prototype and test systems for Helicopters. It is composed of a CAVE for immersive display, four tactile-screen for avionics and two seated cockpit : one with passive helicopeters sticks and another one with active side-sticks.
bench is composed of a cylindrical 180° immersive display & a single operator station. It is primary used to design/prototype new interaction means & study the subject behaviour & cognitive state through bio-physiological metric such as eye-tracking, mo-cap, ECG, EMG, EEG & GSR. Moreover, this bench is the LABSIM hybrid-reality bridge to real-world UAV.
laboratory is mainly used for the human-system interaction studies. It allows the interaction of up to 10 operators (ATC’s, pilots, UAV payload operators, UAV pilots,…) in a complex scenario with up to 128 vehicles. It grant the possibility to study the interactions between the operators and the systems or between the different operators
bench stand for PrototYping & Conception of Systems for HELicopter. It allows the researcher to design, prototype and test systems for Helicopters. It is composed of a CAVE for immersive display, four tactile-screen for avionics and two seated cockpit : one with passive helicopeters sticks and another one with active side-sticks. SCHEME This bench is composed of a cylindrical 180° immersive display & a single operator station. It is primary used to design/prototype new interaction means & study the subject behaviour & cognitive state through bio-physiological metric such as eye-tracking, mo-cap, ECG, EMG, EEG & GSR. Moreover, this bench is the LABSIM hybrid-reality bridge to real-world UAV. LIPS This laboratory is mainly used for the human-system interaction studies. It allows the interaction of up to 10 operators (ATC’s, pilots, UAV payload operators, UAV pilots,…) in a complex scenario with up to 128 vehicles. It grant the possibility to study the interactions between the operators and the systems or between the different operators
to allow fast & early conception/evaluation cycle of innovative concept in situ ? » Analysis • rapid system prototyping • by the way, time is money, so if you want something to be setup quickly it has to be a cheap or relatively afordable solution => software simulation
to allow fast & early conception/evaluation cycle of innovative concept in situ ? » Analysis • to evaluate something, we need to be representative/immersive enough • it also mean that we will probably have to handle wide range of heterogenous data sensor • and because we are scientist, we will have to provide a data warranty => consistency
to allow fast & early conception/evaluation cycle of innovative concept in situ ? » Analysis • Innovation arises from domain specific experts • innovation could also emerge from a blend, a fusion of various scientific domain • we do computer sciences so we should leaverage this aspect from users => focus on key competencies (reminder: initials conditions)
to allow fast & early conception/evaluation cycle of innovative concept in situ ? » Analysis • human is in the loop => human centered design • human don’t lag so we should focus on performance with near real-time requirements => soft real-time ~100Hz • human centered + computer science => Virtual Reality principles ! • lastly, because we are an in-house ONERA's lab, by human we mean pilot, UAV/ATC operator,…
Performance is a critical metric • studying the effect of various latencies on the human sense of control over an automated system (agency) • prototyping a representative flight dynamic mode requiring regular continuous time clock and tight time resolution • exploring the optimality of a movement produced by the human motricity system during a specific piloting task • dealing with humans in a simulated virtual environment
performant WYSIWYG (What You See Is What You Get) tools to setup a simulation A DIY (Do It Yourself) pipeline shortcut through a fully XML (eXtended Markup Langage) based environment for the guru Tooling
UI BL BL DB DB Users fondamentally don’t want to implement these DB models but they have to because of their need of data. It’s an environmental constraint.
LABSIM ecosystem MODEL B MODEL B MODEL A MODEL A UI 1 UI 1 UI 0 UI 0 DATA Scheme 0 DATA Scheme 0 MODEL A MODEL A Bridge Bridge UI 2 UI 2 UI 0 UI 0 DATA Scheme 1 DATA Scheme 1 MODEL C MODEL C
LABSIM ecosystem (DDS) with BLADE Gateway (HLA) MODEL B MODEL B MODEL A MODEL A UI 1 UI 1 UI 0 UI 0 DATA Scheme 0 DATA Scheme 0 MODEL A MODEL A Bridge Bridge UI 2 UI 2 UI 0 UI 0 DATA Scheme 1 DATA Scheme 1 BLING BLING
Ecosystem gRPC is an open source remote procedure call (RPC) system initially developed at Google. It uses HTTP/2 for transport, Protocol Buffers as the interface description language, and provides features such as authentication, bidirectional streaming and flow control, blocking or nonblocking bindings, and cancellation and timeouts. It generates cross-platform client and server bindings for many languages.
OMG (Object Management Group) DDS (Data Distribution Service) standard is a cloud-based middleware introduced in 2004. It stand as a standard technology for ubiquitous, interoperable, secure, platform independent, and real-time data sharing across network connected devices. DDS behaviour and semantics can be controlled via a rich set of QoS (Quality of Service) Policies.
HTTP/2 Actor Actor Model Model Index[1][4][1]-> Role 218 LABSIM : Software Simulation Ecosystem HTTP/2 Actor Actor Core Core Model Model DDS Simulation Composition Pipeline Simulation Composition Pipeline
Actor Actor Model Model HTTP/2 Actor Actor Model Model Index[1][4][1]-> Role 219 LABSIM : Software Simulation Ecosystem HTTP/2 Actor Actor Core Core Model Model DDS
Actor Actor Model Model HTTP/2 Actor Actor Model Model Index[1][4][1]-> Role 220 LABSIM : Software Simulation Ecosystem HTTP/2 Actor Actor Core Core Model Model
HTTP/2 Actor Actor Model Model HTTP/2 Actor Actor Model Model Index[1][4][1]-> Role 221 LABSIM : Software Simulation Ecosystem HTTP/2 Actor Actor Core Core Model Model
Model HTTP/2 Actor Actor Model Model HTTP/2 Actor Actor Model Model Index[1][4][1]-> Role 222 LABSIM : Software Simulation Ecosystem HTTP/2 Actor Actor Core Core Model Model
Simulation Ecosystem Core Core DDS region-0 Simulation Space Simulation Space DDS region-0 Simulation Space Simulation Space DDS region-0 Simulation Space Simulation Space DDS partition Simulation Space Simulation Space
: Software Simulation Ecosystem Core Core DDS region-0 Simulation Space Simulation Space DDS region-0 Simulation Space Simulation Space DDS region-0 Simulation Space Simulation Space DDS partition Simulation Space Simulation Space
Host N « backend » Host N « backend » Index[1][4][2]-> Hardware 229 LABSIM : Software Simulation Ecosystem HTTP/2 DDS Actor Actor Core Core Model Model
Actor Actor Actor Actor Host M « frontend » Host M « frontend » Model Model Host M+1 « frontend » Host M+1 « frontend » Model Model Host M+2 « frontend » Host M+2 « frontend » Index[1][4][2]-> Hardware 230 LABSIM : Software Simulation Ecosystem HTTP/2 DDS Actor Actor Core Core Model Model
HTTP/2 Model Integration Pipeline THETYS [frontend] KRONOS [slave] DDS-PSM-Cxx [ISO/IEC C++ 2003] Model + ALU THETYS [backend] C# Java Python Go Simulink Labview Node.js CXX gRPC gRPC Properties • Supported OS : Linux & Windows • HTTP/2 transport layer via gRPC & Protobuf • Fully configured through XML