TokyoDev Talks Vol. 8: Test Automation with LLMs / Testing Critical Systems
イベント説明
Join us for the eight instalment of TokyoDev Talks, where we have presentations that cut across the stack from engineers working at some of the most interesting tech companies in Japan.
Note that attendance for this event is limited to software developers, those aspiring to become one, or working in an adjacent position (e.g. Product Managers, UI/UX Designers, Security Engineers, QA Engineers, etc). If you're unsure whether you're qualified to attend, please get in touch.
This event is being held at Tokyo Innovation Base (TiB). When attending it, you'll also need to complete the free registration process with TiB if you have not already done so. You are strongly encouraged to complete this in advance, as otherwise you'll need to complete it on site before you're allowed into the venue.
Agenda
18:30 〜 19:00 Doors open
Enjoy talking with the other participants before the presentations begin. Drinks and a light meal will be provided by TokyoDev.
19:00 〜 19:05 Opening - Paul McMahon
We'll kick things off by welcoming everyone and giving a short introduction of the event.
19:05 〜 19:30 No Scripts, No Problem: Test automation with LLMs — Marc Lihan
This presentation explores how we rewrote test automation with LLMs. Traditional native and Appium frameworks offered limited coverage and required high maintenance, so we turned to LLMs to determine how to perform user behaviors in testing.
Using this approach, our Test Automation Regression System (TARS) achieved 60% coverage in three months with almost no maintenance. Early versions faced hallucinations and automation errors, resulting in only a 45% accuracy. Through prompt tuning, experimentation, and the addition of an Auditor agent, we raised coverage to 95% and accuracy to 80%.
About Marc Lihan (QA Engineering Manager at SmartNews)
Marc Lihan graduated from Waseda University and started his career at NEC in Tokyo, where he witnessed the March 11 earthquake. He then relocated to Taiwan to work at HTC and LINE, and later returned to Tokyo as an Engineering Manager overseeing QA at SmartNews.
19:40 〜 20:05 Multi-Environment Testing for Critical Systems — Marius-Mihail Gurgu
When deploying software for critical systems in fields like robotics or fintech, relying on a single staging environment for testing rarely provides sufficient reliability. This talk explores the unique QA lifecycle that supports such systems, emphasizing the layered safety nets that protect both users and infrastructure. From simulation environments to controlled staging setups and finally on-site validation, each phase is designed to catch issues before they escalate.
Equally important is the discipline of balancing thorough testing with development speed—a crucial requirement for any software project where delays can ripple across teams and impact delivery. The talk also covers how QA professionals navigate this tension, optimizing test coverage without compromising velocity.
Marius-Mihail Gurgu (QA Engineer @ KOMOJU)
I'm a QA engineer with experience in robotics and fintech systems, applying what I learned from
academic research in autonomous drones to real-world testing. With a background in embedded
systems and dual MSc degrees, I build testing frameworks to ensure reliability in complex, real-
time environments.
20:05 〜 21:00 Open Networking
Discuss the presentation or anything else with the other attendees.
Want to speak at a future event?
We're looking for speakers. You can find more details and submit a proposal here.
About TokyoDev
TokyoDev's job board is filled with software developer positions at Japanese companies whose engineering team’s primary language is English. From the big companies you’ve already heard of, to smaller up-and-coming startups, our positions offer you the chance to live in Japan but work in an international environment.
Code of Conduct
All attendees, speakers, sponsors and volunteers at our event are required to agree with the following code of conduct. Organisers will enforce this code throughout the event. We expect cooperation from all participants to help ensure a safe environment for everybody.
TokyoDev is dedicated to providing a harassment-free experience for everyone, regardless of gender, gender identity and expression, age, sexual orientation, disability, physical appearance, body size, race, ethnicity, religion (or lack thereof), or technology choices.
We do not tolerate harassment of event participants in any form. Sexual language and imagery is not appropriate for any venue, including at the event itself and other online media.
Participants violating these rules may be sanctioned or expelled from the event at the discretion of the organisers.
If you are being harassed, notice that someone else is being harassed, or have any other concerns, please contact a organizer immediately. Alternatively, you may contact us via our contact page.
開催日
2025年12月17日18:30 ~ 2025年12月17日21:00
主催者・問い合わせ先
TokyoDev
開催場所
| 項目 | 内容 |
|---|---|
| 場所 | Tokyo Innovation Base |
| 住所 | 東京都千代田区丸の内3-8-3 |
開催場所の地図
SNS・Bookmark
近隣のイベント
- 2025年6月16日 - 【※開催見送り】GVA主催 士業、金融・不動産業界交流飲み会
- 2025年6月15日 - 放送作家による映像ディレクター養成講座 第2回「ナレーション&テロップの上手な使い方」
- 2025年6月15日 - [秋葉原] テーマ自由もくもく会 (初参加・初心者大歓迎!)
- 2025年6月15日 - 【あみだす発酵アカデミー】梅しごと日和〜季節を仕込む、私時間〜【梅干し作り講座】
- 2025年6月15日 - 【猛暑対策】ピーエスエス皇居健康ランニング令和7年6月15日大会
- 2025年6月14日 - 【渋谷開催】データサイエンス異職種勉強会vol.5★データ×HR~人事データについて語ろう
- 2025年6月14日 - 実践で学ぶPython速習講座【初心者を3.5時間で卒業せよ!!】
- 2025年6月14日 - [秋葉原] AI駆動開発もくもく会 (初参加・初心者大歓迎!)
- 2025年6月14日 - 関数型まつり2025
近隣の場所 (直線距離)
- THEATER WWW (2.4km)
- ちばチャン池袋本店 (7.5km)
- 株式会社SHIFT (2.7km)
- IREM JAPAN セミナールーム (5km)
- 渋谷 ジェイフィール ホール (5.7km)
- 株式会社ヌーラボ 東京事務所 (2.4km)
- NETGEAR Japan (481m)
- 虎ノ門ヒルズフォーラム(ホールB)- Breakout Room A / トラック:Into Tokyo (1.8km)
- TENCUPS (5.9km)
- 株式会社KDDIウェブコミュニケーションズ本社 KDDI Digital Divergenceカンファレンスルーム (2km)
- モスバーガー 東武池袋店 (MOS BURGER) (7.8km)
- GMO Yours・フクラス (6.2km)
- 渋谷駅か、恵比寿駅から徒歩10分 (6.1km)
- アットビジネスセンター八重洲通り会議室501 (1.1km)
- テックジム東京本校 (2.3km)
- 青山学院大学 青山キャンパス 10号館 地下1階 (つくまなラボ) (5.2km)
- DDS社セミナールーム (3.7km)
- 東京支社(東京スクエアガーデン14F) (333m)
- 東京カルチャーカルチャー (5.9km)