LLM


In an effort to understand something about AI / ML / LLM's, I bought this book. I will never read every page nor understand it completely, but, it does give one lots to think about.

It purports to offer step by step instructions to write a small LLM capable of generating coherent text, "from scratch", without anything other than a compiler, but this already seems to be a lie: it relies on Py Torch, which is some kind of AI tool, as well as others (Word2Vec? BP encoding libraries?)

I think everyone knows that the basic idea of LLMs is to generate word relationship scores, eg. that "Vancouver" and "rain", or "pizza" and "Italy" belong together, but "bicycle" and "cucumber" do not.

How on earth that can be translated into being able to generate such consistently correct text is a mystery, though. This book is full of obscure terms and acronyms.

Comments

Post a Comment

Popular posts from this blog

Change of Venue

Well, I have my doubts that ANYBODY will read this, but here I am: my old blog at progressdeveloper.wordpress.com has become "read only" for reasons that are beyond my control and that I will not bore you with. I might try to scrape it all and stick it somewhere else, but I doubt it. I will probably just let it live in the never-never land of 99.999999% useless information content until someone at Wordpress decides to retire it. (OK, I will bore you just a little. No, I did not lose the password. But they won't let me in anymore because I don't have access to it's registered email address anymore. I am annoyed at Wordpress, enough to try this platform instead [it's part of Google], but not enough to rant about it. These things happen).
Read more

Arrived

 Touchdown in YZP, quick shopping trip in a small Super Valu adjacent to YZP, 20 minute ferry ride (we were 2nd last car on - ferry is tiny and only runs 1x/hour). AirBnb is about 30 seconds drive from Skidegate ferry and is super nice. 3 BR and I think just 1 bath. Huge kitchen. Great view. I think we will be very comfortable. David H is, as expected, unbelievably pleasant and quite fun, but on top of that, seems to know about all sorts of topics that I barely know about and interest me to a greater or lesser extent. How UK's time in India ended. India v Pakistan. Supreme Court in the UK. Whether judges should be elected. He has lived in Africa. He also is super into art as both an observer and a creator. I think the trip will be at least quite good based solely on his involvement!
Read more

Haida Gwaii Part 2

Here I am at YVR Gate C32, waiting for our flight to Sandspit. We're spending 9 nights (7 on HG, one on a ferry, and one in Port Hardy); we being my oldest sister Janet, and a family friend, David (yet another David! Good grief). As you might recall, I went to HG with ex-work-David in May or so of last year. On that trip we were only on the north (Graham) island. I wasn't able to accompany ex-work-David on his zodiac tour of the south (Moresby) island, where, apparently, resides all the "indigenous stuff". (The north island is pleasant but not all that different from "our" gulf islands, at least in my opinion). So I'm going back to fill in the gap of my HG experience with the south island. I'm not hugely interested in Haida art (I think David is, and Janet for sure is), but I'm somewhat interested in FN topics and trying to do my bit to improve my knowledge / empathy towards "them".
Read more