TokyoDev Talks Vol. 8: Test Automation with LLMs / Testing Critical Systems
イベント説明
Join us for the eight instalment of TokyoDev Talks, where we have presentations that cut across the stack from engineers working at some of the most interesting tech companies in Japan.
Note that attendance for this event is limited to software developers, those aspiring to become one, or working in an adjacent position (e.g. Product Managers, UI/UX Designers, Security Engineers, QA Engineers, etc). If you're unsure whether you're qualified to attend, please get in touch.
This event is being held at Tokyo Innovation Base (TiB). When attending it, you'll also need to complete the free registration process with TiB if you have not already done so. You are strongly encouraged to complete this in advance, as otherwise you'll need to complete it on site before you're allowed into the venue.
Agenda
18:30 〜 19:00 Doors open
Enjoy talking with the other participants before the presentations begin. Drinks and a light meal will be provided by TokyoDev.
19:00 〜 19:05 Opening - Paul McMahon
We'll kick things off by welcoming everyone and giving a short introduction of the event.
19:05 〜 19:30 No Scripts, No Problem: Test automation with LLMs — Marc Lihan
This presentation explores how we rewrote test automation with LLMs. Traditional native and Appium frameworks offered limited coverage and required high maintenance, so we turned to LLMs to determine how to perform user behaviors in testing.
Using this approach, our Test Automation Regression System (TARS) achieved 60% coverage in three months with almost no maintenance. Early versions faced hallucinations and automation errors, resulting in only a 45% accuracy. Through prompt tuning, experimentation, and the addition of an Auditor agent, we raised coverage to 95% and accuracy to 80%.
About Marc Lihan (QA Engineering Manager at SmartNews)
Marc Lihan graduated from Waseda University and started his career at NEC in Tokyo, where he witnessed the March 11 earthquake. He then relocated to Taiwan to work at HTC and LINE, and later returned to Tokyo as an Engineering Manager overseeing QA at SmartNews.
19:40 〜 20:05 Multi-Environment Testing for Critical Systems — Marius-Mihail Gurgu
When deploying software for critical systems in fields like robotics or fintech, relying on a single staging environment for testing rarely provides sufficient reliability. This talk explores the unique QA lifecycle that supports such systems, emphasizing the layered safety nets that protect both users and infrastructure. From simulation environments to controlled staging setups and finally on-site validation, each phase is designed to catch issues before they escalate.
Equally important is the discipline of balancing thorough testing with development speed—a crucial requirement for any software project where delays can ripple across teams and impact delivery. The talk also covers how QA professionals navigate this tension, optimizing test coverage without compromising velocity.
Marius-Mihail Gurgu (QA Engineer @ KOMOJU)
I'm a QA engineer with experience in robotics and fintech systems, applying what I learned from
academic research in autonomous drones to real-world testing. With a background in embedded
systems and dual MSc degrees, I build testing frameworks to ensure reliability in complex, real-
time environments.
20:05 〜 21:00 Open Networking
Discuss the presentation or anything else with the other attendees.
Want to speak at a future event?
We're looking for speakers. You can find more details and submit a proposal here.
About TokyoDev
TokyoDev's job board is filled with software developer positions at Japanese companies whose engineering team’s primary language is English. From the big companies you’ve already heard of, to smaller up-and-coming startups, our positions offer you the chance to live in Japan but work in an international environment.
Code of Conduct
All attendees, speakers, sponsors and volunteers at our event are required to agree with the following code of conduct. Organisers will enforce this code throughout the event. We expect cooperation from all participants to help ensure a safe environment for everybody.
TokyoDev is dedicated to providing a harassment-free experience for everyone, regardless of gender, gender identity and expression, age, sexual orientation, disability, physical appearance, body size, race, ethnicity, religion (or lack thereof), or technology choices.
We do not tolerate harassment of event participants in any form. Sexual language and imagery is not appropriate for any venue, including at the event itself and other online media.
Participants violating these rules may be sanctioned or expelled from the event at the discretion of the organisers.
If you are being harassed, notice that someone else is being harassed, or have any other concerns, please contact a organizer immediately. Alternatively, you may contact us via our contact page.
開催日
2025年12月17日18:30 ~ 2025年12月17日21:00
主催者・問い合わせ先
TokyoDev
開催場所
| 項目 | 内容 |
|---|---|
| 場所 | Tokyo Innovation Base |
| 住所 | 東京都千代田区丸の内3-8-3 |
開催場所の地図
SNS・Bookmark
近隣のイベント
- 2026年1月22日 - 【1/22開催】AIは半導体産業の“頭脳”になるか? 国家競争力を左右する、日本半導体AXの最前線「AIエージェント×AXフォーラム 半導体AI」【オンライン参加あり】
- 2026年1月21日 - January Coding Challenge!
- 2026年1月19日 - アジャイルカフェ新春特別企画@ハイブリット 第86回(※Zoom&オンサイト開催 耳だけ参加もOK)
- 2026年1月18日 - [秋葉原] 個人開発・自社アプリ開発 もくもく+LT会 (初参加・初心者大歓迎!)
- 2026年1月18日 - 【あみだす発酵アカデミー】白菜キムチ(キムジャン)作りクラス
- 2026年1月17日 - [秋葉原] テーマ自由もくもく会 (初参加・初心者大歓迎!)
- 2026年1月16日 - Startup Weekend Tokyo Robotics 3rd
- 2026年1月15日 - mitaka.rb 2026-01-15木
- 2026年1月15日 - 【東京ブロック主催セミナー】 管理受託3000戸の驚異的な実績に隠された『基本のキ』と『CPM®』
近隣の場所 (直線距離)
- あみだすセミナールーム/キッチンスタジオKitchen Bee (3km)
- コングレスクエア日本橋 (1.1km)
- PHONE APPLI CaMPⅠ(本社8F) (2.3km)
- 大手町フィナンシャルシティ カンファレンスセンター (1.3km)
- 一橋大学一橋講堂 (2km)
- マーケティングアソシエーション株式会社 (6.4km)
- ザ・プリンス パークタワー東京 (2.8km)
- 南欧バル Ichigo (3km)
- ROE Visual Japan ショールーム (1.1km)
- ベルサール芝公園 Room5 (2.9km)
- ファインディ株式会社 (6.8km)
- SAPジャパン 東京オフィス内 (1.4km)
- 東京会場 IREM JAPAN セミナールーム (5km)
- 都築電気株式会社 カンファレンスルーム (2km)
- フィレンツェ (6.4km)
- TKP御茶ノ水会議室(5階) (2.8km)
- 日比谷フォートタワー 11階 『日比谷スカイカンファレンス』Room A (1.3km)
- SmartHR Space (2.8km)
- ザ・プリンス パークタワー東京 (2.8km)