I'm looking forward to reading "Red Team Blues" by Cory Doctorow. If you missed the Kickstarter for the audiobook and/or ebook, here's a handy link: https://us.macmillan.com/books/9781250865847/red-team-blues
@pluralistic
Turns out, I think, that I was thinking of the #Alpaca paper, in which (somewhat more subtly) they show improving the (leaked) #LLaMA 7B model to be close in effectiveness to the GPT-3.5 model, by using black-box API access to the GPT-3.5 model, for just US$500 or so, which is presumably significantly less than the cost-delta between LLaMA 7B and GPT-3.5.
At least that's how I interpret the Alpaca paper ( https://crfm.stanford.edu/2023/03/13/alpaca.html ) and I think that's the thing I was remembering...
Recurrent Memory Transformer (RMT) retains information across up to 2 million tokens (!) ⭐, significantly exceeding the largest input size reported for transformer models (64K tokens) and GPT-4's 32K tokens.
Paper: https://arxiv.org/abs/2304.11062
Code: https://github.com/booydar/t5-experiments/tree/scaling-report
#MachineLearning #ML
#NeuralNetworks #NN
#DeepLearning
#LLM #Transformers #RNN
This is the picture of the collared lizard that my wife took that is currently on my banner / header, and which I reference in my bio. I just realized that on my Chromebook, when using Google Chrome, the lizard doesn't actually appear. I can see the whole pic, including the lizard on my iPhone using the Mastodon app. I wonder if there's something I can / need to do to make the whole picture appear for laptop users?
Going for a night drive
#glitchart #analog #videoart #crt #analogart #analogvideo #glitch #glitchartist #aiart #aiartist
None of this is new. The misunderstanding of the Silicon Valley tech world as liberal and progressive is rooted in the center-left embrace of neoliberalism and the pervasive “end of history” thinking of the post-Cold War moment in the 1990s. 3/
Hot (but correct) Take: at least 99% of the "Advanced Prompt Engineering" things out there are utter bilge.
(Lots of people are getting money / clicks selling shovels to gold miners who aren't finding any gold to speak of.)
So I've apparently gone from bingeing #atheist responses to Christian #apologists on #YouTube (which gets really old after awhile as there are like five arguments total), to bingeing people doing scathing #reviews of extremely bad #books .
That's... an improvement I guess?
Also, why does my brain always want sound (and not just music-sound) going on while I'm working? You'd think it'd be distracting or something. #brains
Posted in the weblog! Just a little technical philosophical musing, mostly just slightly expanding my #phenomenology post here from the other day.
Phenomenology https://ceoln.wordpress.com/2023/04/23/phenomenology/
RT @rudepundit
Seriously one of the most pathetic ads I've ever seen. "Grandson of steel worker" who "stood up to Dr. Fauci"? "Refused to let woke Disney push us around"? That's some punk-ass shit, no matter how tough you say it. "Ron DeSantis: He'll fight an 80 year-old and a cartoon mouse." https://twitter.com/NvrBackDown24/status/1649794955316199425
Soco Falls
Time spent out in nature is always time well spent. One of my favorite things to photograph is waterfalls. This is one right outside Maggie Valley NC
#waterfall #waterfalls #nature #naturephotography #maggievalley #cherokee #asheville #gatlinburg #smokies #smokymountains #blueridgemountains #art #photooftheday #travel #travelphotography #picoftheday #northcarolina #artist #artistoninstagram #photography #explore #AYearForArt #BuyIntoArt
Hey, regarding last boost, here's my own repeat of the idea, it's kindof a #feditips #feditip ...
In the Other Spaces, we obfuscated a contentious key term in order to avoid attracting unsavoury attention in discussing it. eg, Tr*mp, "Melon Husk", tw!tter, etc.
not only is that much, much less necessary here (right now, fingers crossed), it's actually counter-productive as we have better tools for the readers who wish to avoid the topics; we DON'T shove it into "Trending" or whatever for you.
Spam alert: thegx.ca/forum
Dear server admins,
If you see an account named thegx.ca/forum pop up on your servers please suspend it. Some bastard has been setting up spam accounts all over. I’ve lost count of how many I’ve blocked and it’s getting annoying.
Let's talk about influencers.
For-profit social media needs influencers. It needs them bad.
It needs accounts with hundreds of thousands of followers to drive engagement.
Guess what else we actually don't need here?
I often liken influencers leaving Twitter and coming here akin to coming down from heaven and walking among normal mortals again.
The hardest thing for them to accept, I believe, is that there is no way to force their content into as many eyeballs as possible.
They don't get any special privileges, or boost powers.
That's a very hard thing for someone with that much power to accept, who used to be able to move news cycles with a tweet.
A consciousness somehow associated with matter.
Posting about culture, philosophy, politics, AI Art Tools, NaNoWriMo, Software Development occasionally, the relationship of consciousness to matter.
Degrees in Philosophy and Computer Science, once had a US TS/SCI(redacted) clearance, radical-for-the-US politics, ex-Libertarian, zen-buddhist-pantheist-atheist.
Google employee, but I do not speak for Google in any way.
If your profile tells me nothing about you, it's less likely I'll follow you (back).
Header: abstract smoky patterns
pfp: Adorable weird piglet / delirium cultist... thing. In a hoodie.