Some people don't care and build on top of Linux anyway. This lockdown will accelerate this. At some point a critical mass will eventually be reached, perhaps with the assistance of some corporate entity or organization of some sort that pushes it over the edge. Then there will be a real open competitor. Will take some time though.
Once all the context that a typical human engineer has to "build software" is available to the LLM, I'm not so sure that this statement will hold true.
But it's becoming increasingly clear that LLMs based on the transformer model will never be able to scale their context much further than the current frontier, due mainly to context rot. Taking advantage of greater context will require architectural breakthroughs.
Will it though? The human mind can hold less context at any one time than even a mediocre LLM. The problem isn't architecture. It's capturing context. Most of it is in a bunch of people's heads and encoded in the physical world. Once it's digitized and accessible through search, RAG, or whatever, the LLM will be able to use it effectively.
Sure, but so do LLMs models. They have a huge subconscious (the model itself).
Recording every conversation a single person ever had, every book or text or site ever read, everything ever seen, is not a huge amount of data. Microsoft attempted this with a digital camera lanyard but they were too early.
Yeah, but the models are all based on explicit data. I'm saying humans have prior wiring that allows them to extract and keep context that LLMs do not have access to.
So the suggestion here is that RAG, tools, LLM memory, fine tuning, context management etc are not enough to take advantage of all this context? Is there any evidence that these things aren't on a trajectory to be optimized enough to do the job?
Does general intelligence require awareness though? I think you are talking about consciousness, not intelligence. Though to be frank consciousness and intelligence are not well defined terms either.
I've never used a bad one, although I wouldn't class any of them as anything stellar. All of them have looked like a snake's twisted tongue.
Using them depends on the delicate combination and application of brute force and technique. If your technique and brute force is up to spec, a crowbar works as a makeshift weed puller.
Unfortunately many people don't believe anything or even consider a possibility until some authority/expert figure makes a formal sounding statement about it.
AOSP is used in many contexts like embedded devices where somehow enshackling it would screw up Google's self-interest in other market areas (like ensuring there is a wider population of Android developers).
But regardless, thirdparty ROMs will continue to exist regardless of how much effort it takes because the demand exists and will not merely dissipate.
Demand exists for a lot of things that don't exist. There's no technical reason that the internet couldn't have stayed mostly decentralized, with everyone hosting a node at their house, controlling their own data and feeds, with an experience not much different from current services and social media, and people would absolutely want this if the experience was reliable and had good UX. But so much effort has been shunted to centralized services that it never materialized. The demand is there, I've asked many people. Just one counterexample.
I'm working on a project myself but it's taking forever considering the large scope. Getting close to having it ready for technical individuals to try it out.
reply