Updating GameTZ to UTF-8
14-Feb-23 11:08am
#1 bill
I'm planning to update GameTZ to use UTF-8 character encoding on Monday, February 20th.
It will probably happen in late morning or early afternoon (US/Eastern time). The site will be down for about 10 minutes while I convert the database to UTF-8. Then, I'll release the software changes I made and restart the site.
If all goes well, it will just work and you won't even notice a difference. If you do notice problems (especially garbled characters), please let me know.
I have been evaluating this change to UTF-8 on my test server, but you never know with something like this once it hits the live site with lots of people using it doing different things. I plan to make a backup of the database beforehand, just in case things go very badly.
I'll post again on Monday before I start.
GameTZ is running on fairly old technology. While this change won't fix that, it will help modernize it a bit.
History that led to me realizing I needed to do this UTF-8 upgrade :
https://gametz.com/S...
https://gametz.com/S...
#1 bill
I'm planning to update GameTZ to use UTF-8 character encoding on Monday, February 20th.
It will probably happen in late morning or early afternoon (US/Eastern time). The site will be down for about 10 minutes while I convert the database to UTF-8. Then, I'll release the software changes I made and restart the site.
If all goes well, it will just work and you won't even notice a difference. If you do notice problems (especially garbled characters), please let me know.
I have been evaluating this change to UTF-8 on my test server, but you never know with something like this once it hits the live site with lots of people using it doing different things. I plan to make a backup of the database beforehand, just in case things go very badly.
I'll post again on Monday before I start.
GameTZ is running on fairly old technology. While this change won't fix that, it will help modernize it a bit.
History that led to me realizing I needed to do this UTF-8 upgrade :
https://gametz.com/S...
https://gametz.com/S...
14-Feb-23 7:24pm
#5 nonamesleft
I already noticed some changes on the non mobile site. I'm guessing they're related to the current transition?
#5 nonamesleft
I already noticed some changes on the non mobile site. I'm guessing they're related to the current transition?
14-Feb-23 8:12pm
#7 nonamesleft
bill wrote:
what changes?When you send an offer, you fill in the boxes of what you're sending and what gets sent to you. Those boxes used to have a clear outline. Now the outline isn't nearly as noticeable as it used to be. (On the PC site, old layout)
#7 nonamesleft
bill wrote:
what changes?When you send an offer, you fill in the boxes of what you're sending and what gets sent to you. Those boxes used to have a clear outline. Now the outline isn't nearly as noticeable as it used to be. (On the PC site, old layout)
15-Feb-23 7:15am
#9 bill
@nonamesleft I didn't intentionally change that. I don't think it could be character set related (what I've been working on [though I mostly haven't released it]).
Checking the offer creation page myself now, I don't see what you mean about it being more or less noticeable. I see that if I click on a text-entry box, it gains a blacker outline. Could that be it? Otherwise, I don't know what to make of what you're saying.
#9 bill
@nonamesleft I didn't intentionally change that. I don't think it could be character set related (what I've been working on [though I mostly haven't released it]).
Checking the offer creation page myself now, I don't see what you mean about it being more or less noticeable. I see that if I click on a text-entry box, it gains a blacker outline. Could that be it? Otherwise, I don't know what to make of what you're saying.
15-Feb-23 8:41am
#10 nonamesleft
bill wrote:
@nonamesleft I didn't intentionally change that. I don't think it could be character set related (what I've been working on [though I mostly haven't released it]). Checking the offer creation page myself now, I don't see what you mean about it being more or less noticeable. I see that if I click on a text-entry box, it gains a blacker outline. Could that be it? Otherwise, I don't know what to make of what you're saying.Maybe it is that. I went back and checked. I did update my browser very recently though. Could a browser update have an effect on how a page is presented?
#10 nonamesleft
bill wrote:
@nonamesleft I didn't intentionally change that. I don't think it could be character set related (what I've been working on [though I mostly haven't released it]). Checking the offer creation page myself now, I don't see what you mean about it being more or less noticeable. I see that if I click on a text-entry box, it gains a blacker outline. Could that be it? Otherwise, I don't know what to make of what you're saying.Maybe it is that. I went back and checked. I did update my browser very recently though. Could a browser update have an effect on how a page is presented?
15-Feb-23 9:14am
#11 bill
Possible but not likely. Maybe you could pm me with the specific page you are using and how it looks off? Whatever it is, I don't think it's related to the UTF-8 stuff.
#11 bill
Possible but not likely. Maybe you could pm me with the specific page you are using and how it looks off? Whatever it is, I don't think it's related to the UTF-8 stuff.
15-Feb-23 2:07pm
#12 nonamesleft
bill wrote:
Possible but not likely. Maybe you could pm me with the specific page you are using and how it looks off? Whatever it is, I don't think it's related to the UTF-8 stuff.It's really not a big deal at all. Not even a small deal. It's just something I noticed, and I was wondering if it was related to the change.
Sure. I'll PM some details.
#12 nonamesleft
bill wrote:
Possible but not likely. Maybe you could pm me with the specific page you are using and how it looks off? Whatever it is, I don't think it's related to the UTF-8 stuff.It's really not a big deal at all. Not even a small deal. It's just something I noticed, and I was wondering if it was related to the change.
Sure. I'll PM some details.
20-Feb-23 7:32am
#13 bill
Today is the day that I'll do this UTF-8 update.
I'll start in an hour or two. You may notice the site being down. I'll post when I'm done or if I have problems, etc.
#13 bill
Today is the day that I'll do this UTF-8 update.
I'll start in an hour or two. You may notice the site being down. I'll post when I'm done or if I have problems, etc.
20-Feb-23 9:34am
#15 bill
It is done.
Let me know if you notice any problems (especially garbled characters).
#15 bill
It is done.
Let me know if you notice any problems (especially garbled characters).
20-Feb-23 5:03pm
#16 Foxhack
Not sure if this is a bug or if something happened on the other trader's end: I just pended a trade with Snappy, I got a message from them and the email I got had garbled text. The text said,
> Hey m8, I’ll go for the 8.30 and PayPal you
But on the site, it said this:
> Hey m8, I’ll go for the 8.30 and PayPal you
Seems the email encoded the character he used in the offer incorrectly. It seems it's supposed to be this: https://www.compart....
#16 Foxhack
Not sure if this is a bug or if something happened on the other trader's end: I just pended a trade with Snappy, I got a message from them and the email I got had garbled text. The text said,
> Hey m8, I’ll go for the 8.30 and PayPal you
But on the site, it said this:
> Hey m8, I’ll go for the 8.30 and PayPal you
Seems the email encoded the character he used in the offer incorrectly. It seems it's supposed to be this: https://www.compart....
20-Feb-23 5:52pm
#17 bill
Thanks for letting me know. I think it may be a bug or at least something I may be able to fix. It definitely seems related to the UTF-8 changes too.
I was able to easily reproduce this. So, that should help me fix it as well.
#17 bill
Thanks for letting me know. I think it may be a bug or at least something I may be able to fix. It definitely seems related to the UTF-8 changes too.
I was able to easily reproduce this. So, that should help me fix it as well.
20-Feb-23 6:01pm
#18 bill
I should note that the app is also garbling special characters badly (worse, I think). I'm looking into that as well.
#18 bill
I should note that the app is also garbling special characters badly (worse, I think). I'm looking into that as well.
20-Feb-23 6:18pm
#19 bill
Hm, yeah... email notifications may not work well until I fix this. I'm seeing cases of email just not going out because of it. The module I use to send email does not seem to be utf8 aware...
#19 bill
Hm, yeah... email notifications may not work well until I fix this. I'm seeing cases of email just not going out because of it. The module I use to send email does not seem to be utf8 aware...
21-Feb-23 7:27am
#20 bill
I think I have that email garbling of special characters fixed.
I sent you a test message @Foxhack...
#20 bill
I think I have that email garbling of special characters fixed.
I sent you a test message @Foxhack...
21-Feb-23 8:04am
#21 Foxhack
The message looked fine here! I'm on mobile so I'm not sure what you did, but it wasn't garbled.
#21 Foxhack
The message looked fine here! I'm on mobile so I'm not sure what you did, but it wasn't garbled.
21-Feb-23 10:18am
#22 bill
I was hoping you'd get an email notification for the pm I sent. I'm pretty sure it's fixed now (from my own testing). You may not have email notifications on for pms, though.
#22 bill
I was hoping you'd get an email notification for the pm I sent. I'm pretty sure it's fixed now (from my own testing). You may not have email notifications on for pms, though.
21-Feb-23 10:52am
#23 Foxhack
Yes I got the email, and it wasn't garbled. I meant that I can't check the exact characters you sent because I'm on my phone and not my desktop. It's cool.
#23 Foxhack
Yes I got the email, and it wasn't garbled. I meant that I can't check the exact characters you sent because I'm on my phone and not my desktop. It's cool.
21-Feb-23 2:05pm
#28 nonamesleft
bill wrote:
those look right to meYeah, they do. Strange thing happened though. When I posted them, the input and output was the same, but then when I tried to edit and repost, odd things happened. I'll try to replicate and screenshot it.
#28 nonamesleft
bill wrote:
those look right to meYeah, they do. Strange thing happened though. When I posted them, the input and output was the same, but then when I tried to edit and repost, odd things happened. I'll try to replicate and screenshot it.
21-Feb-23 2:08pm
#31 bill
oh yeah, I think I just saw it. After the edit, it showed wrong, but refresh fixed it. ... looking into it... running out of steam today, though. maybe tomorrow... I think we're close, though. I just need to fix the update after edit part
#31 bill
oh yeah, I think I just saw it. After the edit, it showed wrong, but refresh fixed it. ... looking into it... running out of steam today, though. maybe tomorrow... I think we're close, though. I just need to fix the update after edit part
21-Feb-23 2:11pm
#32 nonamesleft
Thanks for doing all of this to improve the GTZ experience. Much appreciated!
#32 nonamesleft
Thanks for doing all of this to improve the GTZ experience. Much appreciated!
21-Feb-23 3:34pm
#36 nonamesleft
bill wrote:
I think I fixed that edit case. Is it better?Yeah, the input and output are the same now. Cool. What'd you have to do to fix that?
#36 nonamesleft
bill wrote:
I think I fixed that edit case. Is it better?Yeah, the input and output are the same now. Cool. What'd you have to do to fix that?
21-Feb-23 3:52pm
#38 bill
I think emojis have worked before too, mostly... but it was by using a kind of trick (browsers translate them into html codes).
Now, I think, they are supported directly (no tricks).
#38 bill
I think emojis have worked before too, mostly... but it was by using a kind of trick (browsers translate them into html codes).
Now, I think, they are supported directly (no tricks).
21-Feb-23 5:31pm
#40 John
This still work...
I̷̠̞̘͕̞̓̐̽̔̄ͦ͂͡ ̸̨̲̜̃̇͂̑͜å͚͕͓̮̘ͥ̔͒ͪͥ͠m̮͍͕̭̍̃ͥ͆̾̋͆ͤ ͙̪̖͓̫͎͔̘̬̾ͭ̄ͥ́̂̔́Ğ̞̠̠̲̯̪̳͈̄̇͐̒̆̍́o̵̟ͮ̍̐ͭẓ̈̚ě͓̬̬̯̘̓ͪ̇̊ͪͮř̸̛̭̬͈͉̩̗̺͈̱ͮ͟,̲͇͚̌͐̕ ͐̇̾̔̔͒̾͠͏̙̫̪͜D͎ͦ̈̂͒̈̚͢ę͇̥͐͋̌ͣ́͜s̗̣̫̟̞̰͂̋̈́̄ͅţ̡̣̯͊ͭ͆̔̚ͅr̷̜̤̎͂̑ͯ̓ͮ̆̀ő̿͒͒́̾ͭ̀̚҉͇̮̮̺̞͎͖ͅy͓̺̰̖̠̋̈͗̃̈́̀̓̋̀̚ẽ̹̋̑͜r̗͍̗̼͔͙̘ͨ͛̀͘͝ ̨̝̗̼͔͋͞ͅo̸̷̮̞̣̜̺̮̪̊̉͠f̨ͣͥ̔͋͗͛̉̚҉̷̦̳̪̳ ̝ͤ̀͝Ŵ̛̞̺̈́ͦ͜ǒͦ̑̌̉̾̿̚͏̜̹͎͚̺̳r̴̟̳̂̓͊̓͂̀̎͠l̴̵͎̞̈́̿͗ͦd̡̜̬͔̹ͭ͌̽̆̔͒ͣͧs̀͂̇͂ͮ̄̊͘҉̥̤̱͎.̠ͤ̒̐̓ͥ
Edit: Yup.
#40 John
This still work...
I̷̠̞̘͕̞̓̐̽̔̄ͦ͂͡ ̸̨̲̜̃̇͂̑͜å͚͕͓̮̘ͥ̔͒ͪͥ͠m̮͍͕̭̍̃ͥ͆̾̋͆ͤ ͙̪̖͓̫͎͔̘̬̾ͭ̄ͥ́̂̔́Ğ̞̠̠̲̯̪̳͈̄̇͐̒̆̍́o̵̟ͮ̍̐ͭẓ̈̚ě͓̬̬̯̘̓ͪ̇̊ͪͮř̸̛̭̬͈͉̩̗̺͈̱ͮ͟,̲͇͚̌͐̕ ͐̇̾̔̔͒̾͠͏̙̫̪͜D͎ͦ̈̂͒̈̚͢ę͇̥͐͋̌ͣ́͜s̗̣̫̟̞̰͂̋̈́̄ͅţ̡̣̯͊ͭ͆̔̚ͅr̷̜̤̎͂̑ͯ̓ͮ̆̀ő̿͒͒́̾ͭ̀̚҉͇̮̮̺̞͎͖ͅy͓̺̰̖̠̋̈͗̃̈́̀̓̋̀̚ẽ̹̋̑͜r̗͍̗̼͔͙̘ͨ͛̀͘͝ ̨̝̗̼͔͋͞ͅo̸̷̮̞̣̜̺̮̪̊̉͠f̨ͣͥ̔͋͗͛̉̚҉̷̦̳̪̳ ̝ͤ̀͝Ŵ̛̞̺̈́ͦ͜ǒͦ̑̌̉̾̿̚͏̜̹͎͚̺̳r̴̟̳̂̓͊̓͂̀̎͠l̴̵͎̞̈́̿͗ͦd̡̜̬͔̹ͭ͌̽̆̔͒ͣͧs̀͂̇͂ͮ̄̊͘҉̥̤̱͎.̠ͤ̒̐̓ͥ
Edit: Yup.
21-Feb-23 5:32pm
#41 John
John wrote:
This still work... I̷̠̞̘͕̞̓̐̽̔̄ͦ͂͡ ̸̨̲̜̃̇͂̑͜å͚͕͓̮̘ͥ̔͒ͪͥ͠m̮͍͕̭̍̃ͥ͆̾̋͆ͤ ͙̪̖͓̫͎͔̘̬̾ͭ̄ͥ́̂̔́Ğ̞̠̠̲̯̪̳͈̄̇͐̒̆̍́o̵̟ͮ̍̐ͭẓ̈̚ě͓̬̬̯̘̓ͪ̇̊ͪͮř̸̛̭̬͈͉̩̗̺͈̱ͮ͟,̲͇͚̌͐̕ ͐̇̾̔̔͒̾͠͏̙̫̪͜D͎ͦ̈̂͒̈̚͢ę͇̥͐͋̌ͣ́͜s̗̣̫̟̞̰͂̋̈́̄ͅţ̡̣̯͊ͭ͆̔̚ͅr̷̜̤̎͂̑ͯ̓ͮ̆̀ő̿͒͒́̾ͭ̀̚҉͇̮̮̺̞͎͖ͅy͓̺̰̖̠̋̈͗̃̈́̀̓̋̀̚ẽ̹̋̑͜r̗͍̗̼͔͙̘ͨ͛̀͘͝ ̨̝̗̼͔͋͞ͅo̸̷̮̞̣̜̺̮̪̊̉͠f̨ͣͥ̔͋͗͛̉̚҉̷̦̳̪̳ ̝ͤ̀͝Ŵ̛̞̺̈́ͦ͜ǒͦ̑̌̉̾̿̚͏̜̹͎͚̺̳r̴̟̳̂̓͊̓͂̀̎͠l̴̵͎̞̈́̿͗ͦd̡̜̬͔̹ͭ͌̽̆̔͒ͣͧs̀͂̇͂ͮ̄̊͘҉̥̤̱͎.̠ͤ̒̐̓ͥ Edit: Yup.
Quoting that for a reply is fun.
#41 John
John wrote:
This still work... I̷̠̞̘͕̞̓̐̽̔̄ͦ͂͡ ̸̨̲̜̃̇͂̑͜å͚͕͓̮̘ͥ̔͒ͪͥ͠m̮͍͕̭̍̃ͥ͆̾̋͆ͤ ͙̪̖͓̫͎͔̘̬̾ͭ̄ͥ́̂̔́Ğ̞̠̠̲̯̪̳͈̄̇͐̒̆̍́o̵̟ͮ̍̐ͭẓ̈̚ě͓̬̬̯̘̓ͪ̇̊ͪͮř̸̛̭̬͈͉̩̗̺͈̱ͮ͟,̲͇͚̌͐̕ ͐̇̾̔̔͒̾͠͏̙̫̪͜D͎ͦ̈̂͒̈̚͢ę͇̥͐͋̌ͣ́͜s̗̣̫̟̞̰͂̋̈́̄ͅţ̡̣̯͊ͭ͆̔̚ͅr̷̜̤̎͂̑ͯ̓ͮ̆̀ő̿͒͒́̾ͭ̀̚҉͇̮̮̺̞͎͖ͅy͓̺̰̖̠̋̈͗̃̈́̀̓̋̀̚ẽ̹̋̑͜r̗͍̗̼͔͙̘ͨ͛̀͘͝ ̨̝̗̼͔͋͞ͅo̸̷̮̞̣̜̺̮̪̊̉͠f̨ͣͥ̔͋͗͛̉̚҉̷̦̳̪̳ ̝ͤ̀͝Ŵ̛̞̺̈́ͦ͜ǒͦ̑̌̉̾̿̚͏̜̹͎͚̺̳r̴̟̳̂̓͊̓͂̀̎͠l̴̵͎̞̈́̿͗ͦd̡̜̬͔̹ͭ͌̽̆̔͒ͣͧs̀͂̇͂ͮ̄̊͘҉̥̤̱͎.̠ͤ̒̐̓ͥ Edit: Yup.
Quoting that for a reply is fun.
21-Feb-23 7:52pm
#42 nonamesleft
Foxhack wrote:
Wait does this mean we can see emojis on desktop nowThere used to be an issue where if you tried using emojis or certain special characters, at least via the app, the result would be an odd mix of characters instead.
#42 nonamesleft
Foxhack wrote:
Wait does this mean we can see emojis on desktop nowThere used to be an issue where if you tried using emojis or certain special characters, at least via the app, the result would be an odd mix of characters instead.
21-Feb-23 7:52pm
#43 nonamesleft
John wrote:
This still work... I̷̠̞̘͕̞̓̐̽̔̄ͦ͂͡ ̸̨̲̜̃̇͂̑͜å͚͕͓̮̘ͥ̔͒ͪͥ͠m̮͍͕̭̍̃ͥ͆̾̋͆ͤ ͙̪̖͓̫͎͔̘̬̾ͭ̄ͥ́̂̔́Ğ̞̠̠̲̯̪̳͈̄̇͐̒̆̍́o̵̟ͮ̍̐ͭẓ̈̚ě͓̬̬̯̘̓ͪ̇̊ͪͮř̸̛̭̬͈͉̩̗̺͈̱ͮ͟,̲͇͚̌͐̕ ͐̇̾̔̔͒̾͠͏̙̫̪͜D͎ͦ̈̂͒̈̚͢ę͇̥͐͋̌ͣ́͜s̗̣̫̟̞̰͂̋̈́̄ͅţ̡̣̯͊ͭ͆̔̚ͅr̷̜̤̎͂̑ͯ̓ͮ̆̀ő̿͒͒́̾ͭ̀̚҉͇̮̮̺̞͎͖ͅy͓̺̰̖̠̋̈͗̃̈́̀̓̋̀̚ẽ̹̋̑͜r̗͍̗̼͔͙̘ͨ͛̀͘͝ ̨̝̗̼͔͋͞ͅo̸̷̮̞̣̜̺̮̪̊̉͠f̨ͣͥ̔͋͗͛̉̚҉̷̦̳̪̳ ̝ͤ̀͝Ŵ̛̞̺̈́ͦ͜ǒͦ̑̌̉̾̿̚͏̜̹͎͚̺̳r̴̟̳̂̓͊̓͂̀̎͠l̴̵͎̞̈́̿͗ͦd̡̜̬͔̹ͭ͌̽̆̔͒ͣͧs̀͂̇͂ͮ̄̊͘҉̥̤̱͎.̠ͤ̒̐̓ͥ Edit: Yup.What in the world? How'd you do that?
#43 nonamesleft
John wrote:
This still work... I̷̠̞̘͕̞̓̐̽̔̄ͦ͂͡ ̸̨̲̜̃̇͂̑͜å͚͕͓̮̘ͥ̔͒ͪͥ͠m̮͍͕̭̍̃ͥ͆̾̋͆ͤ ͙̪̖͓̫͎͔̘̬̾ͭ̄ͥ́̂̔́Ğ̞̠̠̲̯̪̳͈̄̇͐̒̆̍́o̵̟ͮ̍̐ͭẓ̈̚ě͓̬̬̯̘̓ͪ̇̊ͪͮř̸̛̭̬͈͉̩̗̺͈̱ͮ͟,̲͇͚̌͐̕ ͐̇̾̔̔͒̾͠͏̙̫̪͜D͎ͦ̈̂͒̈̚͢ę͇̥͐͋̌ͣ́͜s̗̣̫̟̞̰͂̋̈́̄ͅţ̡̣̯͊ͭ͆̔̚ͅr̷̜̤̎͂̑ͯ̓ͮ̆̀ő̿͒͒́̾ͭ̀̚҉͇̮̮̺̞͎͖ͅy͓̺̰̖̠̋̈͗̃̈́̀̓̋̀̚ẽ̹̋̑͜r̗͍̗̼͔͙̘ͨ͛̀͘͝ ̨̝̗̼͔͋͞ͅo̸̷̮̞̣̜̺̮̪̊̉͠f̨ͣͥ̔͋͗͛̉̚҉̷̦̳̪̳ ̝ͤ̀͝Ŵ̛̞̺̈́ͦ͜ǒͦ̑̌̉̾̿̚͏̜̹͎͚̺̳r̴̟̳̂̓͊̓͂̀̎͠l̴̵͎̞̈́̿͗ͦd̡̜̬͔̹ͭ͌̽̆̔͒ͣͧs̀͂̇͂ͮ̄̊͘҉̥̤̱͎.̠ͤ̒̐̓ͥ Edit: Yup.What in the world? How'd you do that?
21-Feb-23 10:11pm
#44 John
It's actually just a weird side effect of using letter accents. You can actually use (many) more than one per letter -- and get crazy stuff like that.
#44 John
It's actually just a weird side effect of using letter accents. You can actually use (many) more than one per letter -- and get crazy stuff like that.
22-Feb-23 10:39am
#45 bill
Here's a summary of issues since the UTF-8 upgrade.
o The app was garbling special characters.
- I think this is now fixed (thanks again, nonamesleft )
o Emails had garbled special characters
- Fixed, (thanks again, Foxhack)
o Images on the site were a bit wonky. For example, games with names that end in '?' didn't allow for an image to be uploaded for the item page.
- I tracked this down to an image system I've used for decades. I'm not sure why, but it was unable to open files reliably. This morning, I switched it to an alternate image system that works fine. So, I think this is now fixed too.
Current Issues
o Server is getting wedged
- This is tricky to understand and I'm not sure it's even because of utf8, but the server has been getting into a state where it doesn't serve pages. I have a system in place that will restart it automatically after 5 minutes, so it's not terrible, but not as good as it was before. I don't see how this could be utf8 related, but it started since I went to utf8.
- I'm trying various changes to the server configuration to try to eliminate this.
o Some of the tables didn't convert to utf8. These were not important things, but I'd like to be 100% utf8.
- The tables are storing IP addresses as strings, and utf8 strings have some effects on them that prevent the conversion.
- I can store the IP addresses as an integer instead, though. So, that should get around utf8 and may even result in faster tables. But, it will take some work to convert over to using the integer-format ip addresses in my code.
#45 bill
Here's a summary of issues since the UTF-8 upgrade.
o The app was garbling special characters.
- I think this is now fixed (thanks again, nonamesleft )
o Emails had garbled special characters
- Fixed, (thanks again, Foxhack)
o Images on the site were a bit wonky. For example, games with names that end in '?' didn't allow for an image to be uploaded for the item page.
- I tracked this down to an image system I've used for decades. I'm not sure why, but it was unable to open files reliably. This morning, I switched it to an alternate image system that works fine. So, I think this is now fixed too.
Current Issues
o Server is getting wedged
- This is tricky to understand and I'm not sure it's even because of utf8, but the server has been getting into a state where it doesn't serve pages. I have a system in place that will restart it automatically after 5 minutes, so it's not terrible, but not as good as it was before. I don't see how this could be utf8 related, but it started since I went to utf8.
- I'm trying various changes to the server configuration to try to eliminate this.
o Some of the tables didn't convert to utf8. These were not important things, but I'd like to be 100% utf8.
- The tables are storing IP addresses as strings, and utf8 strings have some effects on them that prevent the conversion.
- I can store the IP addresses as an integer instead, though. So, that should get around utf8 and may even result in faster tables. But, it will take some work to convert over to using the integer-format ip addresses in my code.
23-Feb-23 10:39am
#46 bill
I'm going to shut the site down for 5-10 minutes in order to update the way IP addresses are stored in the SiteLog (mentioned above).
#46 bill
I'm going to shut the site down for 5-10 minutes in order to update the way IP addresses are stored in the SiteLog (mentioned above).
24-Feb-23 12:25pm
#48 bill
Reverting back to the old FastCGI server seems to have resolved the "server getting wedged" issue I was seeing the last couple days.
I don't understand why starman (FastCGI alternative) was getting stuck like that, but I also don't need to use it. Oddly, starman had worked fine for a couple weeks. It only seemed to have trouble since I updated the site to utf8. *shrug*
The tables are all converted and Host-based sorting is faster too.
So, I think I'm done debugging stuff related to the utf8 update. I may still do some code-clean up later (some functions I have that used to translate utf8 can be removed).
In a month or two I will start working on upgrading the OS GameTZ runs on from CentOS to Rocky Linux. That's mostly me setting it up and trying it out on a test server for a while, but eventually migrating the live site to a new server will be potentially disruptive.
#48 bill
Reverting back to the old FastCGI server seems to have resolved the "server getting wedged" issue I was seeing the last couple days.
I don't understand why starman (FastCGI alternative) was getting stuck like that, but I also don't need to use it. Oddly, starman had worked fine for a couple weeks. It only seemed to have trouble since I updated the site to utf8. *shrug*
The tables are all converted and Host-based sorting is faster too.
So, I think I'm done debugging stuff related to the utf8 update. I may still do some code-clean up later (some functions I have that used to translate utf8 can be removed).
In a month or two I will start working on upgrading the OS GameTZ runs on from CentOS to Rocky Linux. That's mostly me setting it up and trying it out on a test server for a while, but eventually migrating the live site to a new server will be potentially disruptive.
9-Apr-23 1:33pm
#49 John
Bill: Couple of posts with weird content in them here: https://gametz.com/G...
Wasn't sure if it was related to the UTF-8 stuff or not? Not sure if you can tell more from your side. If it was just one person, I'd think it was them and a weird copy/paste or something -- but two people are showing odd characters there...
#49 John
Bill: Couple of posts with weird content in them here: https://gametz.com/G...
Wasn't sure if it was related to the UTF-8 stuff or not? Not sure if you can tell more from your side. If it was just one person, I'd think it was them and a weird copy/paste or something -- but two people are showing odd characters there...
9-Apr-23 2:04pm
#50 bill
Thanks for letting me know.
I had made a change this morning related to UTF-8 stuff that seemed to fix another issues.... but, clearly, it's triggering this now too. So, I just reverted it. I think it's OK again.
The issue I was fixing was more or less just a warning in my logs, so I can just ignore that.
I have one more thing I can try... maybe later I will, but I'll recheck that topic if I do.
#50 bill
Thanks for letting me know.
I had made a change this morning related to UTF-8 stuff that seemed to fix another issues.... but, clearly, it's triggering this now too. So, I just reverted it. I think it's OK again.
The issue I was fixing was more or less just a warning in my logs, so I can just ignore that.
I have one more thing I can try... maybe later I will, but I'll recheck that topic if I do.
9-Apr-23 7:06pm
#51 Foxhack
https://gametz.com/G...
Title is glitched when browsing the forum (Pokemon displays as "Pokémon"), but shows up fine when you click on the actual topic.
#51 Foxhack
https://gametz.com/G...
Title is glitched when browsing the forum (Pokemon displays as "Pokémon"), but shows up fine when you click on the actual topic.
10-Apr-23 11:51pm
#54 Foxhack
ryanflucas wrote:
I’m seeing a fish?
That's the April Fools gag for this year. Guess Bill hasn't turned it off. :)
#54 Foxhack
ryanflucas wrote:
I’m seeing a fish?
That's the April Fools gag for this year. Guess Bill hasn't turned it off. :)
11-Apr-23 1:28am
#55 dunno001
Foxhack wrote:
ryanflucas wrote:> I’m seeing a fish? That's the April Fools gag for this year. Guess Bill hasn't turned it off. :)
I'm also guessing they only show up in your own posts?
#55 dunno001
Foxhack wrote:
ryanflucas wrote:> I’m seeing a fish? That's the April Fools gag for this year. Guess Bill hasn't turned it off. :)
I'm also guessing they only show up in your own posts?
11-Apr-23 6:58am
#58 bill
@ryanflucas https://gametz.com/?... ...click a fish to get on the board, find them all! You get an icon with a percent.
Not many people found it on April 1st, so I extended its time on the site. I keep checking to see if people have stopped fishing, but it's still happening. So, I haven't shut it down yet. It will end by the end of the month either way.
Note that you can turn it all off if you click "April Fool's [on]" in the menus/footer.
#58 bill
@ryanflucas https://gametz.com/?... ...click a fish to get on the board, find them all! You get an icon with a percent.
Not many people found it on April 1st, so I extended its time on the site. I keep checking to see if people have stopped fishing, but it's still happening. So, I haven't shut it down yet. It will end by the end of the month either way.
Note that you can turn it all off if you click "April Fool's [on]" in the menus/footer.
11-Apr-23 10:58pm
#60 ryanflucas
Should have said “it’s carp” instead of “it’s crap” in the flow chart.
#60 ryanflucas
Should have said “it’s carp” instead of “it’s crap” in the flow chart.
12-Apr-23 10:23am
#61 bill
Foxhack wrote:
https://gametz.com/G... Title is glitched when browsing the forum (Pokemon displays as "Pokémon"), but shows up fine when you click on the actual topic.
I looked into this and here's where things seem to stand.
The New Layout has a first post preview feature. When you hover over a topic from the forum's list, it shows you a pop-up with the text from the first post previewed.
If the subject or first post contains special characters, they can get garbled (as you showed). There's your case where the subject of the topic has special-chars and they are shown in the list as garbled. Then, the other case I know of is if the post itself has special characters, they get garbled in the preview pop-up. I can fix either case, but it causes the other case to break.
A month or so ago, I "fixed" the case where the preview case garbled chars. But, this caused the topic list garbling you reported. So, I've reverted that (seems more important that the topic list looks right as previews are less seen).
I have no idea why this is happening, which is disturbing, but not the end of the world.
I'm tempted to simply remove post previews entirely. Most people use the Old Layout and Mobile layout anyway. And, I suspect not many New Layout users really care about the feature.
I'm still looking at it, so maybe I'll get a clue and really fix it, but it seems unlikely.
#61 bill
Foxhack wrote:
https://gametz.com/G... Title is glitched when browsing the forum (Pokemon displays as "Pokémon"), but shows up fine when you click on the actual topic.
I looked into this and here's where things seem to stand.
The New Layout has a first post preview feature. When you hover over a topic from the forum's list, it shows you a pop-up with the text from the first post previewed.
If the subject or first post contains special characters, they can get garbled (as you showed). There's your case where the subject of the topic has special-chars and they are shown in the list as garbled. Then, the other case I know of is if the post itself has special characters, they get garbled in the preview pop-up. I can fix either case, but it causes the other case to break.
A month or so ago, I "fixed" the case where the preview case garbled chars. But, this caused the topic list garbling you reported. So, I've reverted that (seems more important that the topic list looks right as previews are less seen).
I have no idea why this is happening, which is disturbing, but not the end of the world.
I'm tempted to simply remove post previews entirely. Most people use the Old Layout and Mobile layout anyway. And, I suspect not many New Layout users really care about the feature.
I'm still looking at it, so maybe I'll get a clue and really fix it, but it seems unlikely.
12-Apr-23 10:39am
#62 bill
Well, just after I wrote that, I tried something that seems to work better. Basically, if the preview is text-only (no HTML), I can avoid using something that messes with the utf-8 characters. Thus, both cases seem to work. But, the preview is plain-looking (seems fine). So, let's run with that for a while.
#62 bill
Well, just after I wrote that, I tried something that seems to work better. Basically, if the preview is text-only (no HTML), I can avoid using something that messes with the utf-8 characters. Thus, both cases seem to work. But, the preview is plain-looking (seems fine). So, let's run with that for a while.
Updating GameTZ to UTF-8