addressed in MSE Production scheduling and simulation, Production system design and improvement, Process modelling and optimization, etc. Mathematical bases Applied operations research, Applied statistics and machine learning, Discrete event systems, Engineering economics, etc. Recent interests Serious gaming, Participatory simulation, Human computation, Game theory and mechanism design, Multi-agent systems, etc. 3 → shifted/expanded to human aspects
of human-involved work systems • Typical research directions/questions • Combination approach of behavioral and mathematical • Some ongoing cases • Summary 4
(or a factory) – is composed of machines and human workers, called manufacturing resources, – which carry out manufacturing operations/tasks according to a given plan or schedule. Planning and scheduling – is a function of assigning necessary operations/tasks to manufacturing resources – by an outside decision maker. 5
Humans are inherently autonomous, and it is difficult to completely take planning/scheduling function away from them. • This characteristic becomes relevant especially in an uncertain and changing environment, and the reality is essentially so. • It may work as a source of flexibility, robustness, resilience, etc. of the system, but not always, and how to make it work is not clear. • Further, even machines are made more and more intelligent and autonomous, that is, similar to humans. • Accordingly, the autonomousness may no longer be ignored, and manufacturing systems should be addressed as being composed of autonomous agents, rather than mechanical resources. 6
and procedural knowledge • Focus and granularity of situational awareness • Forecasting models and decision heuristics What actually are the perceptual and action skills? How to support learning and performing the skills? Preference of one’s own and others’ • Objective function, value function, goals, targets, etc. • Strategic (game-theoretical) interaction with others How to align Incentives towards an overall objective? How to incentivize cooperation/coordination? 7
• My focus is expanded from manufacturing systems to a wider range of work systems including service providing systems, supply chains, etc. • They are addressed as a system where humans and machines (or computers) are collaboratively deliver values to customers. Goals and approaches • To deepen the understanding on, and to support enhancing the performance of, such human-involved collaborative work systems. • By a combination approach of behavioral and mathematical. 8
of human-involved work systems • Typical research directions/questions • Combination approach of behavioral and mathematical • Some ongoing cases • Summary 9
Pedagogical games Inverse RL Cooperation/coordination Participatory simulation Mechanism design Simulation games Reinforcement learning Skills analysis Experimental economics Game theory Preference analysis Collaborative work systems
of human-involved work systems • Typical research directions/questions • Combination approach of behavioral and mathematical • Some ongoing cases • Summary 12
What model? • Agent-based model, which first models each of the humans in the system as an incentivized agent with skills, and study the system- level behavior considering the interactions among the agents. Why? • The system’s overall behavior can be related to the actions and their background rationale of each participant. • It will become straightforward to relate serious game and computer simulation. Each player simply corresponds to a computer agent. 13 (a) Construct a mathematical model of the collaboration system
14 Heuristic/strategy in a dynamic task environment Decision, action Input variables on how current situation is captured The role can be captured as a transformation from input to output. How to define input/output spaces, timing, etc. might also be a key.
Humans can observe (some portion of) the system status, and will act on condition of the observation (to achieve their own goals). 15 System status: s0 Observe System status: s1 Intervene System status: s2 System status: s3 System status: s5 Communication among the agents may also be incorporated Each individual is modelled as an incentivized agent with skills
16 (a) Construct a mathematical model of the collaboration system (d) Collect and analyze the play logs of game (b) (e) Collect and analyze the results of simulation (c) (f) Relate and compare (d) and (e), and draw some findings (b) Develop a serious game based on (a) (c) Develop a computer simulation model based on (a) Refine (a) according to (f) and repeat the analysis Utilize the findings in (f) (f) Relate and compare (d) and (e), and draw some findings
Behavioral approach • Observe humans’ behavior mainly in the game world Mathematical approach • Need to rely on computer simulation in many cases 17 Hypotheses on the skills Behavioral experiments As-expected and surprising results Computer experiments
Behavioral approach • Observe humans’ behavior mainly in the game world Mathematical approach • Need to rely on computer simulation in many cases 18 Behavioral experiments Formalize/general ize/quantify Patterns/rules Computer experiments
setting Multi-agent setting 20 Simple Complex Advanced RL models, such as DQN Simple MDP and reinforcement learning Periodical optimization Multi-agent reinforcement learning Distributed periodical optimization Game theory models and mechanism design Evolutionary game models
of human-involved work systems • Typical research directions/questions • Combination approach of behavioral and mathematical • Some ongoing cases • Summary 21
22 Simple Complex Market research, and Auction-based scheduling In-house supply chain of a large steel manufacturer (ColPMan) Food supply chain (How to reduce food loss/waste?) Operations in a restaurant floor Crane operation task in a factory shop floor Knowledge sharing in a sales department
23 HQ Customers Downstream factories Upstream factory Order materials Assign orders Order Delivery Various decisions concerning production management are distributed to the sites. How to collaboratively address stationary and non-stationary variations?
Term 2 Term 3 ... Period 1-5 Period 1-5 Period 1-5 ... A team of players Simulation Simulation Simulation Simulation Planning information Progress information
according to given plans under various disturbances Game flow #2 Distributed planning with controlled communication DSF1 player DSF2 player DSF3 player USF player HQ player USF DSF3 DSF1 DSF2 HQ Planning information Progress information
approached 1st Round • ConPMan game (ver. 1.0), which uses table discussion, is created. • Discussion data are analyzed exploratorily by protocol analysis. 2nd Round • ConPMan game (ver. 2.0), which uses online chat, is created. • What information is shared, when, with whom is classified. 3rd Round • Planning decisions in each classified information sharing types is mathematically formulated as distributed optimization. • Which type leads to high performance depends on the environment. 27
factory, different kinds of jobs arrive randomly, and they are expected to be finished by their assigned due dates. An operator needs to handle the jobs with a crane between multiple LIFO buffers and a machine. High production rate and low due date lateness penalty should be accomplished. The performance depends heavily on the skills of the operator. 30
Six tables (squares) are handled by a single waitperson (a blue circle). • The color of each table and dish changes from white to yellow, orange, and finally red as waiting time passes.
35 One-third rule Production date Expiration date Delivery limit Sales limit Some argue that this rule is a main cause of the huge food loss and others believe it enhances the supply chain efficiency. Field experiments yield contradictory and inconclusive results.
of human-involved work systems • Typical research directions/questions • Combination approach of behavioral and mathematical • Some ongoing cases • Summary 37
human involved collaborative work systems, and addressing them through a combination approach/perspective of behavioral and mathematical. • The combination approach is characterized by agent-based modelling framework, and how each agent is captured (i.e. as an incentivized agent with skills). • This approach is expected to ultimately reveal how autonomous human workers in a work system should be supported so as to make the most of their potentials. • My next talk on Wednesday will be on “capturing, analyzing and interpreting data from games.” 38
hajimizu
kei18
gpeyre
comfortdesignlab
mkimura
tsantalis
momoseoyama
slab
trafficbrain
teacherpeterpan
toremolo72
shunk031
jrom
zakiwarfel
addyosmani
brianwarren
chrislema
marktimemedia
eileencodes
davidbonilla
panda_program
jacobian
ammeep
gr2m
