TokyoDev Talks Vol. 8: Test Automation with LLMs / Testing Critical Systems
イベント説明
Join us for the eight instalment of TokyoDev Talks, where we have presentations that cut across the stack from engineers working at some of the most interesting tech companies in Japan.
Note that attendance for this event is limited to software developers, those aspiring to become one, or working in an adjacent position (e.g. Product Managers, UI/UX Designers, Security Engineers, QA Engineers, etc). If you're unsure whether you're qualified to attend, please get in touch.
This event is being held at Tokyo Innovation Base (TiB). When attending it, you'll also need to complete the free registration process with TiB if you have not already done so. You are strongly encouraged to complete this in advance, as otherwise you'll need to complete it on site before you're allowed into the venue.
Agenda
18:30 〜 19:00 Doors open
Enjoy talking with the other participants before the presentations begin. Drinks and a light meal will be provided by TokyoDev.
19:00 〜 19:05 Opening - Paul McMahon
We'll kick things off by welcoming everyone and giving a short introduction of the event.
19:05 〜 19:30 No Scripts, No Problem: Test automation with LLMs — Marc Lihan
This presentation explores how we rewrote test automation with LLMs. Traditional native and Appium frameworks offered limited coverage and required high maintenance, so we turned to LLMs to determine how to perform user behaviors in testing.
Using this approach, our Test Automation Regression System (TARS) achieved 60% coverage in three months with almost no maintenance. Early versions faced hallucinations and automation errors, resulting in only a 45% accuracy. Through prompt tuning, experimentation, and the addition of an Auditor agent, we raised coverage to 95% and accuracy to 80%.
About Marc Lihan (QA Engineering Manager at SmartNews)
Marc Lihan graduated from Waseda University and started his career at NEC in Tokyo, where he witnessed the March 11 earthquake. He then relocated to Taiwan to work at HTC and LINE, and later returned to Tokyo as an Engineering Manager overseeing QA at SmartNews.
19:40 〜 20:05 Multi-Environment Testing for Critical Systems — Marius-Mihail Gurgu
When deploying software for critical systems in fields like robotics or fintech, relying on a single staging environment for testing rarely provides sufficient reliability. This talk explores the unique QA lifecycle that supports such systems, emphasizing the layered safety nets that protect both users and infrastructure. From simulation environments to controlled staging setups and finally on-site validation, each phase is designed to catch issues before they escalate.
Equally important is the discipline of balancing thorough testing with development speed—a crucial requirement for any software project where delays can ripple across teams and impact delivery. The talk also covers how QA professionals navigate this tension, optimizing test coverage without compromising velocity.
Marius-Mihail Gurgu (QA Engineer @ KOMOJU)
I'm a QA engineer with experience in robotics and fintech systems, applying what I learned from
academic research in autonomous drones to real-world testing. With a background in embedded
systems and dual MSc degrees, I build testing frameworks to ensure reliability in complex, real-
time environments.
20:05 〜 21:00 Open Networking
Discuss the presentation or anything else with the other attendees.
Want to speak at a future event?
We're looking for speakers. You can find more details and submit a proposal here.
About TokyoDev
TokyoDev's job board is filled with software developer positions at Japanese companies whose engineering team’s primary language is English. From the big companies you’ve already heard of, to smaller up-and-coming startups, our positions offer you the chance to live in Japan but work in an international environment.
Code of Conduct
All attendees, speakers, sponsors and volunteers at our event are required to agree with the following code of conduct. Organisers will enforce this code throughout the event. We expect cooperation from all participants to help ensure a safe environment for everybody.
TokyoDev is dedicated to providing a harassment-free experience for everyone, regardless of gender, gender identity and expression, age, sexual orientation, disability, physical appearance, body size, race, ethnicity, religion (or lack thereof), or technology choices.
We do not tolerate harassment of event participants in any form. Sexual language and imagery is not appropriate for any venue, including at the event itself and other online media.
Participants violating these rules may be sanctioned or expelled from the event at the discretion of the organisers.
If you are being harassed, notice that someone else is being harassed, or have any other concerns, please contact a organizer immediately. Alternatively, you may contact us via our contact page.
開催日
2025年12月17日18:30 ~ 2025年12月17日21:00
主催者・問い合わせ先
TokyoDev
開催場所
| 項目 | 内容 |
|---|---|
| 場所 | Tokyo Innovation Base |
| 住所 | 東京都千代田区丸の内3-8-3 |
開催場所の地図
SNS・Bookmark
近隣のイベント
- 2025年12月14日 - 第3回「仏教精神に学ぶ経営者の集い」大聖堂4階ホール現地参加
- 2025年12月13日 - 【JS祭2025
- 2025年12月12日 - 【会場開催】JJUGナイトセミナー「Context Engineering × Young Coders:AIと未来をつくる力」12/12(金) 開催
- 2025年12月12日 - 【12/12開催】KUSANAGIコミュニティミートアップ!2025 in 大手町
- 2025年12月12日 - The Next Generation of Web3 Data Infra
- 2025年12月11日 - mitaka.rb 2025-12-11木
- 2025年12月11日 - 【シェアリング特集】ビジネスマッチング部会
- 2025年12月11日 - 不動産テック協会協会会員限定イベント「マンション管理DX部会」第6回会合
- 2025年12月11日 - GENIAC採択企業に学ぶ、GPU活用実践セミナー LLM開発を支える、支援体制から運用までのリアル
近隣の場所 (直線距離)
- さくらインターネット東京支社32階セミナールーム (6.6km)
- 3F TIME SHARING 銀座 GFビル (687m)
- セミナー室A/D (4.3km)
- 集合場所: 桔梗門警備派出所(丸の内) (714m)
- 産総研臨海副都心センター別館11階 第1会議室 (6.4km)
- ザ ストリングス 表参道 B1F 「ウエストスイート 」 (5km)
- Bar7557 (六本木) (3.4km)
- ハック 東京校 (7.5km)
- TIME SHARING 五反田プラザスクエアビル (6.9km)
- アンドパッド東京オフィス (4km)
- 慶應義塾大学 三田キャンパス 南校舎7F473教室 (3.6km)
- KINTOテクノロジーズ 室町オフィス (1.5km)
- PRONTO 大手町店 (1.1km)
- 永和システムマネジメント東京支社 (329m)
- 鉄板焼 香味由 (3km)
- 新宿近郊のレンタルスペース(調整中) (5.9km)
- 東京会場 IREM JAPAN セミナールーム (5km)
- IZAKAYA BAR おためし屋 (7.1km)
- レッドハット株式会社 (5.9km)