Through my efforts to install the Stanford Alpaca system on my M1 mac studio that I dubbed homeGPT, I discovered that some of the required packages are configured to only use CUDA … in other words I need an NVIDIA graphics card. One of my research computers from school is a Windows 11 system with… Continue reading Win11 officeGPT
Author: Brian Toone
homeGPT, cont’d
Stanford Alpaca takes the LLaMA pre-trained model released by the Meta AI and “fine-tunes” the model to respond better to natural language questions and prompts (exactly what chatGPT does). Note, the screenshot above is from LLaMA, not from Alpaca. This shows you the value that alpaca adds as the output from the example LLaMA is… Continue reading homeGPT, cont’d
ChatGPT programming
I’m still waiting to hear back from Meta (Facebook) about my application for the llama dataset. I can install all the tools, but the pre-trained model which took months to train is behind an application form. It was leaked online through 4chan with someone then submitting a GitHub pull request to update the AI research… Continue reading ChatGPT programming
HomeGPT, part 1 – PyTorch
3/21 6:48AM. The genie truly is out of the bottle. I am in the process of installing LLaMA on my home mac studio. Here’s the play-by-play. LLaMA is based on PyTorch, so in this part, I install and activate the latest version of pytorch optimized for my M1 Ultra. Some notes … pyenv vs virtualenv… Continue reading HomeGPT, part 1 – PyTorch
Improper access control
That’s a lot of duplicates! I’ve written a script to remove duplicates. I’ve run that script multiple times, and every few months when I go to create a new lifetime overlay of all my rides, I’ve noticed the duplicates have reappeared. Well, it’s been a couple months and they are back! My first thought was… Continue reading Improper access control
iMac woes
Early in the summer I found my late 2014 iMac had restarted itself once or twice on its own with “Unexpected Shutdown” messages. One time, it failed to reboot and took me to the Recovery screen with Disk Utility as an option. I ended up “checking” the drives and it reported no errors and so… Continue reading iMac woes
Data integrity
There are two kinds of data integrity: there’s the data storage kind where you are concerned that data isn’t accidentally (or maliciously) modified or deleted once it is in the system. This is a problem I am going to tackle in the next few days replacing a failing SSD. But there’s also a second kind… Continue reading Data integrity
Server-Sent Events
One of the HTML5 features introduced that I have not needed until now is something called “server-sent events“. It’s a strange name which I think is derived from the HTTP content-type text/event-stream which must be set on the server side script generating the events. This isn’t quite the same as web push notifications which are… Continue reading Server-Sent Events
Linux in the classroom
The simple goal was to use Microsoft Azure services to setup a traditional SQL Database (SQL Server) running in the Azure cloud. Students had $100 credit towards the services. The problem we ran into is that by using all the default settings, you end up with $380/month system that was going to blow through the… Continue reading Linux in the classroom
Developing on production?
Let me preface this post by saying this is a bad idea for most true production systems, particularly ones with many hundreds, thousands, or hundreds of thousands of users. But for quiet, independently developed web apps with only a handful of users, I believe this is a viable strategy given the caveats in bold a… Continue reading Developing on production?