Seungwon Do

Research Engineer

Human Computer Interaction
Electronics and Telecommunications Research Institute (ETRI)
@Daejeon, Korea

About me


Seungwon Do is a research engineer at the Defense & Safety Convergence Research Division, ETRI, Korea, where he develops AI-driven battlefield situation awareness systems for real-time decision-making and tactical analysis in defense applications. His work focuses on reinforcement learning, multi-agent systems, and deep learning models to improve autonomous decision-making and situational inference. He is also interested in Human-Computer Interaction (HCI), particularly in computational interaction to improve user experience.

He earned his Bachelor’s degree in Electrical Engineering from Pohang University of Science and Technology (POSTECH) in 2018, where he built a foundation in mathematics, physics, telecommunications, and computer engineering. He then earned a Master’s degree at the Graduate School of Culture Technology, Korea Advanced Institute of Science and Technology (KAIST) in 2020, advised by Prof. Byungjoo Lee, focusing on computational modeling of human cognition and behavior to optimize interactions in Mixed Reality (MR) environments and AI-based simulations.

Since joining ETRI in 2020, he has been engaged in defense projects funded by the Korean Defense Acquisition Program Administration, contributing to reinforcement learning-based AI models, autonomous decision-making frameworks, and AI-driven battlefield analysis. His research aims to develop reliable and interpretable AI solutions that enhance situational awareness in complex battlefield environments.

Research topics

AI-based situation awareness, computational user modeling, and interactions in mixed reality environments


Education


Korea Advanced Institute of Science and Technology (KAIST) | 2018-2020
M.S. in Graduate School of Culture Technology
Advised by Prof. Byungjoo Lee

Pohang University of Science and Technology (POSTECH) | 2013-2018
B.S. in Dept. of Electrical Engineering

Seoul National University | 2016
Exchange Student in Dept. of Computer Science and Engineering


Work Experience


Electronics and Telecommunications Research Institute (ETRI) | 2020-current
Research Engineer at the Intelligent Convergence Research Laboratory

Korea Advanced Institute of Science and Technology (KAIST) | 2018
Research Intern at the Ubiquitous Virtual Reality Lab

LG CNS | 2017
Intern at the digital marketing team


Publications


StairWave Transformer: For Fast Utilization of Recognition Function in Various Unmanned Vehicles
Donggyu Choi, Chang-eun Lee, Jaeuk Baek, Seungwon Do, Sungwoo Jun, Kwang-yong Kim, and Young-guk Ha
Machines 2023, 11(12), 1068
Paper


Speeding up Inference with User Simulators through Policy Modulation
Heeseung Moon, Seungwon Do, Wonjae Kim, Minsuk Chang, Jiwon Seo, and Byungjoo Lee
2022 CHI Conference on Human Factors in Computing Systems (CHI’ 22)
Paper | Talk | Page | Data


KLUE: Korean Language Understanding Evaluation
Sungjoon Park, Jihyung Moon, Sungdong Kim, Won Ik Cho, Jiyoon Han, Jangwon Park, Chisung Song, Junseong Kim, Yongsook Song, Taehwan Oh, Joohong Lee, Juhyun Oh, Sungwon Lyu, Younghoon Jeong, Inkwon Lee, Sangwoo Seo, Dongjun Lee, Hyunwoo Kim, Myeonghwa Lee, Seongbo Jang, Seungwon Do, Sunkyoung Kim, Kyungtae Lim, Jongwon Lee, Kyumin Park, Jamin Shin, Seonghyun Kim, Lucy Park, Alice Oh, Jungwoo Ha, and Kyunghyun Cho
Conference on Neural Information Processing Systems 2021 Datasets and Benchmarks Track (NeurIPS' 21)
Paper | Benchmark | Code


A Simulation Model of Intermittently Controlled Point-and-Click Behaviour
Seungwon Do, Minsuk Chang, and Byungjoo Lee
2021 CHI Conference on Human Factors in Computing Systems (CHI’ 21)
Paper | Talk | Code | Honorable Mention Award (Top 5%) | 26.3% Acceptance Rate


Improving Reliability of Virtual Collision Responses: A Cue Integration Technique
Seungwon Do and Byungjoo Lee
2020 CHI Conference on Human Factors in Computing Systems (CHI’ 20)
Paper | Talk | 24.3% Acceptance Rate



Fingering Augmentation System for Guitar Learning
Seungwon Do, Hyungil Kim, and Woontack Woo
Korea Computer Congress 2018



Honors and Awards


ACM CHI 2021 Honorable Mention Award | 2021
SK Creative Challenge 2nd Prize | 2018
KAIST Invention Award 2nd Prize | 2018
Paper Contest of Korea Computer Congress 1st Prize | 2018
Graduation Exhibition in Dept. of Electrical Engineering 1st Prize | 2017

KAIST Alumni Association Scholarship | 2020
SAMSUNG Oh-Heon Kwon Scholarship | 2015-2016
National Excellence Scholarship (Natural Science and Engineering) | 2015-2016
POSTECH Jigok Scholarship | 2013-2014

Patent

Domestic

System and Method for Hypergraph-based Multi-agent Battlefield Situation Awareness Doc | 2023
Guitar Learning System Using Augmented Reality Doc | 2021

Services

Reviewing

CHI | 2025 2024 2023 2022 2021
CHI PLAY WIP | 2022 2020

Seminar

EIRIC | 2021



Projects

Work Projects

Development of Explainable Spatio-temporal Complex Battlefield Situation Awareness Technology | 2023-2027
This project, funded by the Korean Defense Acquisition Program Administration, aims to develop a battlefield situation awareness system that analyzes battlefield information collected from a virtual battlefield simulator using artificial intelligence technologies. The system enhances battlefield analysis through multiple hypothesis generation, object interaction analysis, and scene graph generation.

Realtime Complex Battlefield Situation Awareness Technology | 2022-2026
This project, funded by the Korean Defense Acquisition Program Administration, aims to develop a battlefield situation awareness system that leverages Manned-Unmanned Teaming (MUM-T) systems to analyze battlefield information collected by UAVs using artificial intelligence technologies. The system enhances real-time situational awareness and prediction to support strategic decision-making through video image quality enhancement, object semantic segmentation, object recognition and reconstruction, scene graph generation, and knowledge analysis.

Situation Awareness Technology using Swarm Ultra-small Robots | 2022-2027
This project, funded by the Korean Defense Acquisition Program Administration, aims to develop a battlefield situation awareness system utilizing swarm ultra-small ground robots to analyze battlefield information collected by the robots using artificial intelligence technologies. The system enhances real-time situational awareness and prediction to support strategic decision-making through cooperative object recognition, tracking and dynamic behavior inference, place recognition, and model optimization.

A Study on Realtime Multi-Layer Battle Situation Awareness in Time and Space for AI Military Staff | 2021-2022
This project, funded by ETRI, aims to develop a battlefield situation awareness system that analyzes unstructured battlefield information, including video and text data collected by combat assets, using artificial intelligence technologies. The system enhances battlefield analysis through battlefield data generation, cooperative object recognition, automatic labeling, and scene graph generation.

Pol-Bot Development for Conversational Police Knowledge Services | 2020-2021
This project, funded by the Korean National Police Agency, aims to develop an interactive knowledge service system that analyzes voice and text data collected from police and public security services using artificial intelligence technologies. The system provides security-related information through natural language processing-based question-answering, speech recognition and conversion, and automated legal information retrieval.

Personal Projects

Hand Interfaces using Hand Detection Model
Software engineer for a hand interfaces model | 2023
#ComputerVision #SupervisedLearning
Reference Paper


3D Objects Visualization Tool
Software engineer for a 3d visualization tool | 2022
#OpenGL #GUI



Two Thumbs Typing Simulation
Software engineer for a two thumbs typing simulation | 2021
#ComputationalUserModeling #ReinforcementLearning



Museum Collection Voting System on Kiosk
Software engineer for a system displaying museum collection information
National Museum of Modern and Contemporary Art | 2019
#Unity
Video

YelLouder: Shouting Game using Human Voice Pitch and Volume
Software engineer for a media art using a human voice
PlaceMak gallery | 2019
#Unity #MediaArt
Video

PathGuider: Exploration Assistance System for Virtual Reality Environment
Software engineer for a path-guiding system in virtual reality
Korea Advanced Institute of Science and Technology | 2018
#Unity #HTCVive #VR


Intuitive Guitar Musical Note Indicator
Software engineer for a guitar musical note indicator program
Pohang University of Science and Technology | 2017
#OpenGL #AR


Intuitive Drone Control using Leap Motion
UX designer for a drone control system using leap motion
Seoul National University | 2016
#Drone #LeapMotion


Yut-marble: Multiplayer Game for Korean Blue Marble
Project manager and software engineer for a customized blue marble game
Pohang University of Science and Technology | 2015
#QT #C++ #Game



Skills


Programming C, C++, C#, Java, and Python
Application Development Including VR and AR Unity
Data Analysis and Visualization Matlab and R
Handling Motion Capture Data Optitrack
Robotics ROS1 and ROS2



Curriculum Vitae


CV | Mar 23, 2023



updated on Feb 13, 2025