test add tokenizer

This commit is contained in:
polv committed 2026-08-28 00:54:20 +07:00
1 parent 7e8c38a80f
commit 9dfae88805
11 files changed
+233 -20

No files matched your search

@@ -197,7 +197,7 @@ vocabulary:
examples:
- ko: 저는 어렸을 때부터 **야구**를 좋아했어요
en: I've liked **baseball** since I was young
- ko: "**야구선수**는 공을 세게 던졌어요"
- ko: "**야구**선수는 공을 세게 던졌어요"
en: The **baseball** player threw the ball hard
- ko: 저는 **야구**를 잘해요
en: I play **baseball** well
@@ -1162,7 +1162,7 @@ Common Usages:
Example:
- 저는 어렸을 때부터 **야구**를 좋아했어요 = <span class="md spoiler">I’ve liked **baseball** since I was young</span>
- **야구선수**는 공을 세게 던졌어요 = <span class="md spoiler">The **baseball** player threw the ball hard</span>
- **야구**선수는 공을 세게 던졌어요 = <span class="md spoiler">The **baseball** player threw the ball hard</span>
- 저는 **야구**를 잘해요 = <span class="md spoiler">I play **baseball** well</span>
- **야구**는 좋은 스포츠야 = <span class="md spoiler">**Baseball** is a good sport</span>
- 우리는 **야구**를 1시에 할 거예요 = <span class="md spoiler">We will play **baseball** at 1:00</span>