Software Engineering for Machine Learning Systems

(Shonan Meeting SEMLS)

October 14-17, 2019 - Shonan Village Center

This event is invitation-only in the Shonan Meeting scheme.
Check also the symposium in Tokyo after this shonan meeting

This meeting aims to bring together leading software engineers, machine learning experts and practitioners to reflect on and discuss the challenges and implications of building software for complex Artificial Intelligence (AI) systems.

The core idea behind this meeting is a growing concern that we have as software engineers in a world where data science, deep learning, and AI are becoming increasingly pervasive. Although AI research has allowed the development of novel algorithms capable of learning new tasks, adapting to the environment, and evolving, their implementation in software systems remains challenging. From an engineering perspective, once an algorithm is implemented, it requires a solid architecture, model/data validation, proper monitoring for changes, dedicated release engineering strategies, judicious adoption of design patterns and security checks, and thorough user experience evaluation and adjustment. All these activities require a combined knowledge in software engineering, data science, and machine learning. A failure to properly address these challenges in such complex software systems can lead to catastrophic consequences. An example of such failure is the recent human toll incidence caused by the $47-million Michigan Integrated Data Automated System (MiDAS), or the recent finding that simple tweaks can fool neural networks in identifying street signs.

The source of emerging difficulties is the shift of the development paradigm. Classically, we have constructed software systems in a deductive way, or by writing down the rules that govern the system behaviors as program code. With machine learning techniques, we generate such rules in an inductive way from training data. This shift does not only simply require new tools that intensively deal with data but also introduces unique characteristics. The resulting system behaviors are uncertain: black-box and unexplainable. They are intrinsically imperfect and it is practically impossible to reason their correctness in a deductive way.

Given the critical and increasing role of AI-based systems in our society it is now imperative to engage software engineers and machine learning experts in in-depth conversations about the necessary perspectives, approaches and roadmaps to address these challenges and concerns.

The meeting will involve two kinds of sessions. One is presentations and targeted discussions, where each participant presents ideas and positions that then kicks off various directions of discussions. The organizers will ensure that these presentations are structured around specific topics. The other is sessions consisting of intensive follow-up discussions involving mixed groups of participants. The meeting will use a dedicated method for conducting the intensive discussion, the current plan is to use a variation of the world café method. The topics will be discovered at the meeting, though the organizers will prepare some beforehand, e.g., what are unique technical challenges for engineering of machine learning systems.

Program

October 13 Sunday

19:00-21:00    Welcome Dinner

October 14 Monday

9:00-9:15    Opening

9:15-10:30    Introduction (1)

10:50-12:00    Introduction (2)

12:00-14:00    Lunch

14:00-15:00    SOTA Review (1)

15:20-17:30    Talks & Discussion (1)

October 15 Tuesday

9:00-10:30    Industry Statements

11:00-12:00    Discussion Kick-off

12:00-14:00    Lunch

14:00-17:30    Group Discussions

October 16 Wednesday

9:00-10:00    SOTA Review (2)

10:00-10:20    Talks &Discussion (2)

10:40-12:00    Talks &Discussion (3)

13:30-21:00    Talks &Excursion and Social Dinner

  1. Hokokuji Temple
  2. Jomyoji Temple (Tea Celemony)
  3. Tsurugaoka Hachimangu Shrine
  4. Komachi-Dori Shopping Street

October 17 Thursday

9:00-10:20    Talks &Discussion (4)

10:40-12:00    Wrap-up

12:00-14:00    Lunch

14:00-16:00    Extended Discussion

Participants

Organizers

Foutse Khomh, Ecole Polytechnique de Montréal, Canada
Fuyuki Ishikawa, National Institute of Informatics, Japan
Hiroshi Maruyama, Preferred Networks, Japan

ACCESS

The venue : Shonan Village Center
#16 bus (30 min.) from JR Zushi or Keikyu Shin-Zushi stations
More detail is found here