Singapore is the most boring, sterile place I've ever been. I'd take Tokyo, Taipei, or Hong Kong over it in a heartbeat. The entire country reminds me of a mall. William Gibson's 1993 Wired article "Disneyland with the Death Penalty" (https://www.wired.com/1993/04/gibson-2/) is still as relevant as ever.
I saw a fascinating talk that convincingly argued that the Chinese Communist Party has taken its game plan over the last 30 years from Singapore, a de facto one party state led by the People's Action Party. It's interesting to note that this party was founded on socialist principles but is now firmly capitalist.
I wonder if this might be a preemptive move to stop Google from falling under addictive social media style legislation that would presumably ban infinite scroll.
This is really cool, but I'm left with a lot of questions. Why does the font always generate the same string to replace the exclamation points as he moves from gedit to gimp? Shouldn't the LLM be creating a new "inference"?
As an aside, I originally thought this was going to generate a new font "style" that matched the text. So for example, "once upon a time" would look like a storybook style font or if you wrote something computer science-related, it would look like a tech manual font. I wonder if that's possible.
So, another poster cleared up my first question. It's probably because the seed is the same. I think it would have been a better demo if it hadn't been, though.
You got it, same seed in practice, but also just temperature = 0 for the demo actually. A few things I considered adding for the fun of it were 1) a way to specify a seed in the input text, 2) a way to using a symbol to say "I didn't like that token, try to generate another one", so you could do, say, "!" to generate tokens, "?" to replace the last generated token. So you would end up typing things like
"Once upon a time!!!!!!!!!!!!!!!!!!!!!!!!!!!!!SEED42!!!!!??!!!??!"
and 3) actually just allow you to override the suggestions by typing what letters on your own, to be used in future inferences. At that point it'd be a fairly generic auto-complete kind of thing.
Using the input characters to affect the token selection would increase the ‘magic’ a little.
As it is, if you go back into a string of !!!!!!!!!! That has been turned into ‘upon a time’, and try to delete the ‘a’, you’ll just be deleting an ! And the string will turn into ‘once upon a tim’.
If you could just keyboard mash to pass entropy to the token sampler, deleting a specific character would alter the generation from that point onwards.
I fail to understand how an LLM could produce two different responses from the same seed. Same seed implies all random numbers generated will be the same. So where is the source of nondeterminism?
Barring subtle incompatibilities in underlying implementations on different environments, it does, assuming all other generation settings (temperature, etc.) are held constant.
I like the typeface and concept but I found the site somewhat confusing to use. Also, I feel like it should recommend some difficult vocab words for me to check out, based on say a quiz to get a baseline sense of my current vocabulary.
Features to discover vocabulary are on the drawing board. In the short term, a “word-a-day” feature will recommend five words per week, but the time-tested method for a rich vocabulary is reading, so the long-term ambition is a built-in ebook reader, where saving words would be frictionless and context-aware.
In the meantime, you can browse the index, which is biased toward uncommon words:
Sort of. Researchers were sent in to study it but with no upper boundary and so they kept at it. They went so deep in their research they ended up with the truth of the universe.
It's possible that our next generation advances will be made inside, for example, bioengineering. I'm not super well versed on the topic so this is very speculative, but I've read a lot of cool stuff about DNA-based data storage solutions, and the thought now comes to me that may be that maybe lab-grown brains could achieve some interesting tasks.
The Bible, specifically the New Testament, and more specifically，The Gospels. The reason that it's radical is that Christ overturns traditional notions of morality. Greco-Roman thought saw the rich and powerful as close to the divine but Christ's message is that the meek and poor are prefered by God.
Coming in at #2, I would argue for Marx, maybe Capital. It's radical because it shows that Capitalism is not a "natural" state of affairs (as much as it would like us to believe that it is).
Agreed. I love the Old Testament too, as it is so raw and real. Murder, betrayal, sex, prostitution, and war. Interwoven with the hope of a new start with Christ coming to earth, and a new beginning when he returns.
