I’ve been experimenting with Google Gemini code generation. Similar to ChatGPT, one of the new features is to see a dump of the “thinking” process. Presumably each character output in the “thinking” process is appended to the original prompt and re-run through the transformer? I’m going to research this more, as my speciality is neural… Continue reading I’m thinking…
Tag: ai
Samford Family Academy Online Workshop
Had a great time presenting my overview of AI technology and its impacts. I got a bit too carried away with the technical details, so I didn’t quite make it to all the impacts AI is having on society. See the latter slides in the powerpoint below – Many thanks to all who joined in… Continue reading Samford Family Academy Online Workshop
ChatGPT programming
I’m still waiting to hear back from Meta (Facebook) about my application for the llama dataset. I can install all the tools, but the pre-trained model which took months to train is behind an application form. It was leaked online through 4chan with someone then submitting a GitHub pull request to update the AI research… Continue reading ChatGPT programming
HomeGPT, part 1 – PyTorch
3/21 6:48AM. The genie truly is out of the bottle. I am in the process of installing LLaMA on my home mac studio. Here’s the play-by-play. LLaMA is based on PyTorch, so in this part, I install and activate the latest version of pytorch optimized for my M1 Ultra. Some notes … pyenv vs virtualenv… Continue reading HomeGPT, part 1 – PyTorch