I’m still waiting to hear back from Meta (Facebook) about my application for the llama dataset. I can install all the tools, but the pre-trained model which took months to train is behind an application form. It was leaked online through 4chan with someone then submitting a GitHub pull request to update the AI research… Continue reading ChatGPT programming
Category: Research
HomeGPT, part 1 – PyTorch
3/21 6:48AM. The genie truly is out of the bottle. I am in the process of installing LLaMA on my home mac studio. Here’s the play-by-play. LLaMA is based on PyTorch, so in this part, I install and activate the latest version of pytorch optimized for my M1 Ultra. Some notes … pyenv vs virtualenv… Continue reading HomeGPT, part 1 – PyTorch
Data integrity
There are two kinds of data integrity: there’s the data storage kind where you are concerned that data isn’t accidentally (or maliciously) modified or deleted once it is in the system. This is a problem I am going to tackle in the next few days replacing a failing SSD. But there’s also a second kind… Continue reading Data integrity
Server-Sent Events
One of the HTML5 features introduced that I have not needed until now is something called “server-sent events“. It’s a strange name which I think is derived from the HTTP content-type text/event-stream which must be set on the server side script generating the events. This isn’t quite the same as web push notifications which are… Continue reading Server-Sent Events
MySQL 8.0
I’ve already run into a number of issues with MySQL 8.0. Most of them have been related to the GIS features (e.g., all functions are now named ST_, geometries must exactly match the column type, etc…). One new issue I ran into today is that my spatial indices are being ignored because I didn’t create… Continue reading MySQL 8.0
An epic “merge”
I have a development system which has diverged quite a bit from the corresponding production system. I have deleted, added, tweaked, fixed, edited, and looked at code on both systems separately without committing on either system. This has dragged on for several years now as I dreaded the day I would need to merge the… Continue reading An epic “merge”
Migrating mybiketraffic.com
I saved the hardest for last. While technically not really that hard, I did want to keep the website up and running during as much of the migration as possible. As an extra complicating factor, to ease server space on my server, I stopped storing as much data in the mysql database and was storing… Continue reading Migrating mybiketraffic.com
Trouble in paradise
My migration to a new server for all the web-based projects I’m hosting has been going great … until now. This morning, I woke up and was working on my main computer when I noticed that my server wasn’t kicking up every few minutes to refresh the OSM planet database. I turned on the screen… Continue reading Trouble in paradise
Migrating MySQL5.6 to MySQL8.0
Whew, this turned out to be quite problematic for one of my oldest databases with spatial data. The problem turned out to be that MySQL5.6 was quite flexible with how you used spatial datatypes. I had a table with a POLYGON data type, but I had stored a bunch of LINESTRING geometries instead. MySQL5.6 …… Continue reading Migrating MySQL5.6 to MySQL8.0
di2stats.com migration
One of my longest running projects with many thousands of users now is the website di2stats.com. I just added this message to the import page and disabled the import functionality so that I can migrate the database and file data to a new server. I started the migration process this morning (which I will detail… Continue reading di2stats.com migration