ROM Hack Help Creating a tbl for Japanese Character in UTF-8

[HeyImAmethyst]

I'm trying to make a table for the Japanese text in the ds game Tongari Boushi to Mahou no Omise. The text encoding is in UTF-8 and for the English letters I have them like this:

41=A
42=B
43=C
44=D
45=E
46=F
47=G
48=H
49=I
4A=J
4B=K
4C=L
4D=M
4E=N
4F=O
50=P
51=Q
52=R
53=S
54=T
55=U
56=V
57=W
58=X
59=Y
5A=Z

61=a
62=b
63=c
64=d
65=e
66=f
67=g
68=h
69=i
6A=j
6B=k
6C=l
6D=m
6E=n
6F=o
70=p
71=q
72=r
73=s
74=t
75=u
76=v
77=w
78=x
79=y
7A=z

but for the Japanese hiragana characters the hex is like e3 81 81 or e3 81 83 and so on. How do I format the table for these?

 

[FAST6191]

You have a 3 byte/24 bit encoding for the Japanese on the DS? Very strange. It has happened before but it is super rare. Are you sure it is 24bit and not 16 and some kind of markup as the need for 24 is normally only a very specific case I would not expect to see in a handheld game.

Anyway that will depend upon your table program and its preferred encoding. Most will have the option to do 16 bit but I am not sure from what among the normal set is going to play nicely with 24bit. I know crystaltile2 has something ( https://www.romhacking.net/utilities/818/ ) but have not had cause to play much with it. If you can get it to add a character in that regime you can open it up and figure out how it likes its encoding to happen.

Getting from characters to hex is easy enough ( https://www.romhacking.net/utilities/504/ ), though going the other way might be harder, especially for Japanese.

 

[HeyImAmethyst]

You have a 3 byte/24 bit encoding for the Japanese on the DS? Very strange. It has happened before but it is super rare. Are you sure it is 24bit and not 16 and some kind of markup as the need for 24 is normally only a very specific case I would not expect to see in a handheld game.

Anyway that will depend upon your table program and its preferred encoding. Most will have the option to do 16 bit but I am not sure from what among the normal set is going to play nicely with 24bit. I know crystaltile2 has something ( https://www.romhacking.net/utilities/818/ ) but have not had cause to play much with it. If you can get it to add a character in that regime you can open it up and figure out how it likes its encoding to happen.

Getting from characters to hex is easy enough ( https://www.romhacking.net/utilities/504/ ), though going the other way might be harder, especially for Japanese.

I'm not really sure about the bit size, when I was trying to find the text for this game I was trying different encodings on files that I suspected held the text until I found it. I even tried translating some text by manually editing the hex values and it showed up in game.

This is what it looks like in crystaltile2:



and getmyhex shows the same thing