Also, not all language models are transformers. You can have language models based on diffusion models or state-space models, or any other model that can be used to model sequences (so all of them, as sequences are just functions).
Transformers are just the ones that are most common and successful today.
When I find articles like these, I remember I haven't watched TV for almost 12 years, except when at someone else's home.
By this, I mean I never turned on the TV to see what's on the television.
I used the TV as a monitor to play games or watch movies from streaming services at times.
Given that I moved to the UK after I stopped watching TV, I barely know which channels even exist on the TV.
I do watch a lot of stuff on YouTube. But it's things I chose to watch because I find them interesting, and I don't find most of the stuff on TV interesting enough.
And the interesting parts, usually, you can find them on streaming services and only watch those whenever you want to watch them. Even scrolling brain rot on Instagram seems less of a waste of time. At least the algorithm knows the type of brain rot I like.
The study seems to be strictly for TV watching. I mostly watch science/math/history/economics related videos on YT. I prefer the more in-depth ones; I also watch gaming/movies related videos sometimes. I don't think it's nearly the same as watching TV. But I don't watch hours a day of those either.
The education system has failed in the EU, but in a different way than it has in the US.
I realised this when people thought mandating the USB-C connections was a good idea because "it is the best standard". I didn't think the mandated connector was a huge deal per se, but it made it clear to me that there is a flawed thought process behind EU regulations. And this is a big deal.
Many things are not really understood in the EU. The majority don't seem to understand free speech.
The EU has an article about free speech that clearly states there is no free speech, but people point to it when they claim there is.
Of all things to criticise, you pick out the one ruling that eventually lead to a consolidation of chargers? Really? I haven't ever met a single person who wasn't grateful of being able to have one cable for all their devices.
This is exactly what I'm talking about. A short-term view of the world, progress and technology.
All my devices supported USB-C before the EU regulation. But if I wanted to buy a device with a new type of connector, I should have been able to. This is how the USB-C came to be and how any new standard in hardware happens. New technologies are made and just sold, and if they are proven to be superior to others in the market, they often become standards.
The USB-C standard is not the best standard that can exist from now to the end of the universe, but if this discovery process is blocked, we will be stuck with it forever, which, of course, will also constrain the design and engineering of devices in other ways.
It's the same fundamental flawed thought process that has made the EU reliant on the US for a lot of services.
> All my devices supported USB-C before the EU regulation.
I don't have this particular problem so it doesn't exist!
It did exist for huge amounts of people. At the time, many manufacturers had proprietary plugs and would still have them if it weren't for this decision.
> The USB-C standard is not the best standard that can exist from now to the end of the universe
Which is why the law can be simply amended as soon as such a standard emerges. If the industry figures out something better than USB-C, pressure will build on the council to do so. This is nothing but a straw man.
> I don't have this particular problem, so it doesn't exist!
No, what I said is that you could find devices with USB-C in all the categories that are now regulated. This means it was pretty easy to find devices like that if you really valued USB-C. Of course, if you wanted an iPhone but you liked USB-C, you would have had a problem. A problem that is much less worse than blocking progress.
> Which is why the law can be simply amended as soon as such a standard emerges. If the industry figures out something better than USB-C, pressure will build on the council to do so. This is nothing but a straw man.
You totally ignored what I wrote, or you didn't understand it. No standard can emerge if you can't test it on the market. You can have a bureaucrat choose the next one from some proposal. It's not the same.
You might have a point. But, at the same time, AFAIK the only manufacturer that complained about USB-C (and, coincidentally, making the exact same argument as you're making) was Apple. And they definitely weren't interested in making the lightning connector an industry standard. Quite the opposite.
It doesn't really matter to me, because even if that's true for Apple (or it was at the time), it still means other companies can't test new technologies. They might as well be OK with that, but it still means that consumers won't get new standards.
The first attempt at enforcing such a standard in the EU was made with mini-USB.
It failed to become a regulation (fortunately), but I have no reason to believe USB-C is different, and no better standards would have been tried by companies if they were allowed to do so.
On the other hand, USB-C wouldn't have become a true standard if no-one forced Apple's hand. It's a compromise and, for the time being, I'm happy with this. As another commenter noted, if we feel the need for a new standard the law can be changed in the future. I concede that, depending on the future's situation, this could be difficult to do. But, without such law we wouldn't have had a standard to begin with.
> On the other hand, USB-C wouldn't have become a true standard if no-one forced Apple's hand
I don't want a state-dictated standard like this. What you're saying is that because some people want iPhones and they want them with USB-C, everyone else must forgo the possibility of having a better type of connetor until "we" (Is it the majority? I don't even think the majority uses iPhones in Europe) feel like having a new one (at which point the progress has been delayed anyway and you'll also get the initial problem again).
I find the premise quite capricious.
> you just have to provide USB-C option as a fallback.
Given you must have a USB-C port, the design would still be limited by the USB-C form factor and adding another port would even further increase the complexity, costs and weight of the design. This will still strongly limit the spread of new designs, and I'm pretty sure it's effectively equivalent to mandating just USB-C for smaller devices.
I see how this could be an issue for small devices, but this wouldn't stop a company from testing a new connector on bigger ones: laptops still have one or more USB-A ports, despite USB-C being common now. So having an additional connector other than USB-C isn't an issue.
The point is, if the regulation works as intended, it consolidates USB-C as the standard and slows or blocks new types of ports from being designed and tested. If it doesn't, then it's useless. You can't have it both ways.
Imagine a company that wants to design the next type of port. Normally, it would just do R&D and engineer the product, then put it on the market with that type of port. If the device only has that type of port, people must use it and provide feedback by choosing to keep buying the product (maybe they'll also make it explicit that they like the new port). If this phase is successful and the company opens the specs and other companies adopt it, it might become a de facto standard.
Now consider doing it with the current regulation. You need to do R&D, but the design will require higher costs because you have to make the device work with the old USB-C, too.
Maybe it's not a high cost for the company, so they do it anyway. People might use the port much less because some may not even try the new port and stick to the USB-C for simplicity, or because they are accustomed to it.
So the company won't have the same strong feedback. But let's assume they manage to make most users happy to use the new one because it's so much better.
Now they open the standard. Other companies have to pay the additional engineering costs to add the other port. Some might be able to afford it just fine, while others might not want to add the complexity and costs of two ports.
Let's say, however, it spreads anyway. Now you hope the EU will accept it as a new standard so you can ditch the now-old USB-C standard. But the EU might just say "NO". It's very hard to predict if the government would be happy with it.
Given the compounding of these effects, the result is most likely that the company won't even think about wanting to develop the next standard.
The probability of a new standard happening is much reduced. And as I said before, if it weren't reduced, then the regulation would be useless to begin with, as people would use and test different connectors regardless of the USB-C support.
As I said in the root comment, I don't care too much about the connectors not evolving, but it just goes to show that people don't realise that there is no free lunch. Add constraints, and you add costs and slow down progress.
You can't force companies to add value with no costs, and value is also subjective, so the government often doesn't know what is valuable to people. At most, the government might know what some people say is valuable to them. But this is not the same thing.
Very few people would have said smartphones were the future, and they would buy one in 2007. Democracy is a very bad way for economic and technological progress to happen - unless it's for some military technology for which the government is the only customer.
> slows or blocks new types of ports from being designed and tested
No
> If the device only has that type of port, people must use it and provide feedback by choosing to keep buying the product (maybe they'll also make it explicit that they like the new port)
When getting something out on the market, they woudn't take this risk and still have a commonly used port on the side. The consumers as well would prefer to not take the risk of buing a device forcing them to use a port no other device is using.
> So the company won't have the same strong feedback
For the above reason, in the situation you describe, the feedback wouldn't be worth much, or at most it would be as worth as the situation with a more common port on the side. In one case, customers may refrain from buying the device with only the new port, because there isn't a wide market of accessories using that port yet (and not because they don't like it). In the other, the signal could be weak as consumers could just ignore the new port and keep buying the device due to the old port still being there.
I apologize, but I only skimmed the rest of your comment, because I believe it rests on a flawed premise in the first line.
> When getting something out on the market, they woudn't take this risk and still have a commonly used port on the side. The consumers as well would prefer to not take the risk of buing a device forcing them to use a port no other device is using.
Like, people didn't buy Apple products before they were forced to use USB-C? So why did Apple not want to use USB-C if that caused them to lose money and sell fewer phones?
Also, if this were true, once most devices support USB-C (like they already did before the regulation), the standard would be self-enforcing and require no additional regulation.
> I apologize, but I only skimmed the rest of your comment, because I believe it rests on a flawed premise in the first line.
EDIT: Your statements seem to be self-contradictory, so it's not even about facts. "We need a regulation because companies make and sell products with different ports" is in contradiction with "Companies wouldn't take the risk of not having a common port, and consumers won't take the risk to buy them".
Also, mine wasn't a premise. My claims are not statements that follow one from the previous, but a conjunction of negated statements laid out in chronological order. So all of them must be false or not relevant for you to be right.
Same as before? A group like Intel, Microsoft and a few more create a new standard and can get the eu to adopt it. Which popular cabling standard wasn't designed by one of the big ones?
Well you are ignoring what I or the other comment replied almost entirely.
There were many competing standards and it took quite a while for the market to converge on usb-c and only then when it was already the most popular connector by far did EU determine it was the “best” standard.
Firewire, Thunderbolt 1, all kinds of different usb type ports where designed by various groups of companies it was not self evident that they will fail in the market at that point.
No industry group let alone an EU committee can know what will fail or succeed in advance its just an absurd assumption that it could ever be otherwise.
That's a good example of the mindset that is turning the EU into a backwater. Paraphrased you're saying there's no problem with the EU banning new technologies because the Americans can always be relied on to make progress anyway, and then Europe can just copy whatever they do.
So there seems to be some confusion over premises in this thread.
The people pointing out the USB-C law as a failure are reasoning from the Golden Rule: what would happen if everyone did this? Nobody would design new connectors because of the catch-22 the law creates. You can't know what the next new connector should be without a competitive market, but governments have ended such a market. Also, to invest in a new technology requires a belief that you can actually launch it and gain profit by outcompeting other technologies, but government mandated monopolies prevent that, so there's just no incentive to do the work anymore.
The people arguing the USB-C law is fine are reasoning from a different and totally local perspective: why shouldn't we implement a command economy in Europe when we'll get the benefits of a free market economy by importing US goods anyway? They assume new tech will be developed for the US market and then all the EU has to do is have a committee that approves it.
The problem with this idea, beyond it being just pathetic, is there's no reason the US has to sell to Europe and the more annoying the EU makes trade the fewer technologies will be available for import. It's already common that new US tech products either don't launch in Europe or launch much later. Now frontier models are being restricted and not made available to European companies, that will make them fall even further behind. And we can assume that when a new connector is designed that's better than USB-C products designed around it will launch everywhere except Europe for a while, as only some products will have enough sales to justify an EU specific variant. So Europeans will eventually get used to not being able to acquire many products at home because import is blocked by the EU.
What's interesting to me is that this is a bit like how the USSR worked.
They were relying on the West for high-tech tractors and even to build factories (I know Ford helped them build some factories for a part of the factory output).
I also know they used to look at the allocation of goods in the US as a starting point to decide what to produce, as they were basically running blind to what people needed or wanted.
> if I wanted to buy a device with a new type of connector, I should have been able to
You are. Nothing prevents the manufacturers to support other better charging solutions than USB-C. In fact many notebooks has their proprietary connectors and some smartphones use custom signaling over custom USB cable to provide better experience while complying with the regulation and support USB-C charging, too.
If I wanted to buy a device with a different type of connector, including a different form factor or a totally different charging mechanism, I should be able to do so without additional costs or additional holes drilled in the case of the device.
This is a very bad analogy. Markets behave like an imperfect optimisation algorithm, and you can prove that, under some conditions which are most often met, they give people what they want.
In fact, you can almost always expect governments to be less effective and less rational than markets in allocating resources to satisfy the desires of people, even when democratic. You can prove it either by using the same logic that tells you when markets fail (externalities, information asymmetry), or empirically by looking at what was basically the most perfect A/B test we had on society over the 20th century. Although it was a comparison between mixed economies and fully centralised ones, there is no reason to expect the optimum mix of centralisation/distribution to be closer to the worst-performing one (the fully centralised one).
You can't prove your free-market theory because it's not falsifiable.
This is why arguments about this go in circles. You either argue from a pure theoretic POV back and forth, or you go off data - at which point, bringing up every failure of free markets (like, obviously, US healthcare) is dismissed as "not really a free market"
Even the theoreticians on the free-market side are far less solid than.. all the other sides (behavioural economics, information asymmetry.. even Marx) but I regard it as deeply unpragmatic when there's so much data out there indicating what actually happens in the real world when you go one way or the other.
> You can't prove your free-market theory because it's not falsifiable.
You can prove the logic part starting from the assumptions. It's also falsifiable. I just mentioned it was literally the most controlled test on human society you could make. We tested by splitting societies at the level of the entire planet, states and cities.
US healthcare is mostly not a free market; by free market, at minimum, I mean that the quantities and prices (ideally even the quality) are not set. The US healthcare system has a fixed number of practitioners who can get a license every year. This is as far as a market can be from being free (together with the case of having price controls). In fact, free market theory predicts that when you restrict quantity, you get higher prices for the same quality.
It literally predicts the US situation.
It's funny you mention Marx, given I regard most of his claims as either unfalsifiable or easily proven false.
at which point, bringing up every failure of free markets (like, obviously, US healthcare) is dismissed as "not really a free market"
I mean, it's not. In a free market you'd have a choice of insurance providers rather than having to take whatever plan your employer offers, and you'd have some idea of what the hospital is going to charge you beforehand rather than receiving random bills for weeks.
Just to be clear, my definition of free-market is just that there is no centralised authority that can use force to set prices/quantities/quality/type of services offered.
Of course, the fact that the employer has to offer health insurance in some cases is part of it not being a free market.
But there are more fundamental things that make the US healthcare very far from being a free market. The first one is that the supply of doctors is capped in quantity, not just in quality.
A more realistic estimate of the total number of addressable things should take into account that for anything to be addressable, its address should be stored somewhere at least once.
If it takes at least Npb particles to store one bit of information, then the number of addressable things would decrease with the number of bits of the address.
So let's call Nthg the number of addressable things, and assume the average number of bits per address grows with Nb = f(Ntng).
Then the maximum number of addressable things is the number that satisfies Nthg = Np/(Npb*f(Ntng)), where Np is the total number of particles.
It's not just about intentions. To convince me that the Government can improve things through regulations, you'd need to do a few things:
1) You must convince me that optimising for some utility function you defined is the right thing to do.
2) You must convince me that the Government can effectively estimate the utility function.
3) Finally, you must convince me that the Government can predict how the utility function will change after the policies are implemented.
For 1) I'd have problems with any utility function you could come up with. If you want to maximise total utility, for instance, does it mean that I get to assault someone as long as I gain more utility than the other person loses? What about the "Utility Monster" thought experiment?
For 2) and 3), I'm pretty sure the Government has no idea of how to measure and/or predict the result.
Does the scrolling addiction of a teenager cause more loss in utility than the loss of friends to a teenager with disabilities?
Because of these basic philosophical principles, the burden of proof that some regulation is required is always on the Government side, and the standard of proof should be much higher than it is today.
I don't believe that the concept of utility is entirely useless, though.
I believe that by respecting people's individual freedoms and allowing for voluntary arrangements, you'll also get more utility in the long term, whereas if you try to force your utility optimisations, you might, maybe, get utility increases in the short term, but much worse utility in the longer term.
There is a problem with this comparison. The agent had access to open-source browsers in its training set.
So you'd need to compare the cost of creating an equivalent browser for a developer who has access to them, too.
If all you need is standard browser functionality, you just use an existing browser.
If you want to change some features or parts of the implementation, you fork it.
A new browser written from scratch would be valuable if it had a novel implementation that resulted in a faster/more secure/robust/memory efficient or simply easier-to-use browser.
So even if this had implemented the standard correctly, it wouldn't be worth more than the time it takes a developer to fork Chromium and change its name.
Don't get me wrong, it's impressive, but not as impressive after you think that an LLM that regurgitates verbatim the code of Chromium when tasked to build a browser would have effectively succeeded at the task.
EDIT: About the rendering speed. It doesn't really make sense to compare it with a fully functioning browser, as you could potentially drop features or make bogus optimisations to go faster.
What I find confusing about this comment is that to me, authoritarian and libertarian are opposites, but have only to do with individual freedoms, not the political system.
With these definitions, you can have a democratic or non-democratic system, and both can give rise to libertarian or authoritarian societies.
Democracies tend to produce more libertarian systems than dictatorships, but only to some extent, and in fact, they are often authoritarian in various aspects. All it takes to oppress some people in a democracy, even when they are not causing harm, is the majority of people wanting to do so.
Vice versa, a dictatorship with some enlightened, incorruptible, and perfectly mentally stable dictator that acts as a night-watchman so that individual freedoms are respected would be more libertarian than a democracy, but it's unlikely you'd get such a dictator.
>What I find confusing about this comment is that to me, authoritarian and libertarian are opposites, but have only to do with individual freedoms, not the political system.
"Do whatever the F you want as long as you don't challenge the state" isn't that incompatible at first glance and might work ok if you have a low touch state. Where it gets obviously incompatible is when you have eastern european style oligarchs and western style administrative state and state favored businesses and industries that leverage state violence to stifle competition.
I don't think it's possible to have an authoritarian government in a modern society that doesn't trend in one of those directions.
There have been such dictators in the past. Singapore is one example. Arguably the British Empire was libertarian by the standards of its time (and empires).
Perhaps the least recognized example is America. The Constitution imposes libertarianism on the population against majority will. You can't change the constitution with a 50%+1 vote, so it forces freedom of speech and other rights on people who might otherwise easily vote to get rid of them. There's no one man enforcing the constitution, just a general agreement to obey SCOTUS.
All of the linked apps look trivial to me.
Also, the first one, the UI has no feedback once you click the answer (plus some questions don't really make sense as they have the answer in them).
There is more on the website, so there could be something interesting, but I'm having trouble finding it among all the noise.
Not saying simple apps have no value. Even simple throwaway UIs can have value, especially if you develop them quickly.
The first one is basically some glue code using pipes.
The ones I'd say are not trivial are the VMs in Python.
However, I'd say they are entirely useless, and not too complex either (although somewhat tedious to implement).
I believe the problem with democracy is that it's affected by various problems analogous to the ones of markets, but often amplified.
In this case, to me, it really seems a matter of extreme information asymmetry as you'd never see in a regular market.
Does he actually mean those things, or is that some sort of joke? How do you even know? BTW, he didn't actually use Nukes, and I don't believe he will. On the other hand, he said he wanted to end wars and sounded like he was against starting new ones.
I've seen people regretting voting for Trump because of tariffs, even though they supported tariffs in the first place.
They had no idea that Trump's "tariff" would mean some blanket tariffs at those rates. They thought it was some small tariffs on "key industries".
A further confirmation of the information asymmetry is that after a year, support for Trump is far below what would be needed to elect him.
