• Let's Know Things

  • 著者: Colin Wright
  • ポッドキャスト

Let's Know Things

著者: Colin Wright
  • サマリー

  • A calm, non-shouty, non-polemical, weekly news analysis podcast for folks of all stripes and leanings who want to know more about what's happening in the world around them. Hosted by analytic journalist Colin Wright since 2016.

    letsknowthings.substack.com
    Colin Wright
    続きを読む 一部表示

あらすじ・解説

A calm, non-shouty, non-polemical, weekly news analysis podcast for folks of all stripes and leanings who want to know more about what's happening in the world around them. Hosted by analytic journalist Colin Wright since 2016.

letsknowthings.substack.com
Colin Wright
エピソード
  • AI Scaling Walls
    2024/11/19
    This week we talk about neural networks, AGI, and scaling laws.We also discuss training data, user acquisition, and energy consumption.Recommended Book: Through the Grapevine by Taylor N. Carlson TranscriptDepending on whose numbers you use, and which industries and types of investment those numbers include, the global AI industry—that is, the industry focused on producing and selling artificial intelligence-based tools—is valued at something like a fifth to a quarter of a trillion dollars, as of halfway through 2024, and is expected to grow to several times that over the next handful of years, that estimate ranging from two or three times, to upward of ten or twenty-times the current value—again, depending on what numbers you track and how you extrapolate outward from those numbers.That existing valuation, and that projected (or in some cases, hoped-for growth) is predicated in part on the explosive success of this industry, already.It went from around $10 billion in global annual revenue in 2018 to nearly $100 billion in global revenue in 2024, and the big players in this space—among them OpenAI, which kicked off the most recent AI-related race, the one focusing on large-language models, or LLMs, when it released its ChatGPT tool at the tail-end of 2022—have been attracting customers at a remarkable rate, OpenAI hitting a million users in just five days, and pulling in more than 100 million monthly users by early 2023; a rate of customer acquisition that broke all sorts of records.This industry’s compound annual growth rate is approaching 40%, and is expected to maintain a rate of something like 37% through 2030, which basically means it has a highly desirable rate of return on investment, especially compared to other potential investment targets.And the market itself, separate from the income derived from that market, is expected to grow astonishingly fast due to the wide variety of applications that’re being found for AI tools; that market expanded by something like 50% year over year for the past five years, and is anticipated to continue growing by about 25% for at least the next several years, as more entities incorporate these tools into their setups, and as more, and more powerful tools are developed.All of which paints a pretty flowery picture for AI-based tools, which justifies, in the minds of some analysts, at least, the high valuations many AI companies are receiving: just like many other types of tech companies, like social networks, crypto startups, and until recently at least, metaverse-oriented entities, AI companies are valued primarily based on their future potential outcomes, not what they’re doing today.So while many such companies are already showing impressive numbers, their numbers five and ten years from now could be even higher, perhaps ridiculously so, if some predictions about their utility and use come to fruition, and that’s a big part of why their valuations are so astronomical compared to their current performance metrics.The idea, then, is that basically every company on the planet, not to mention governments and militaries and other agencies and organizations will be able to amp-up their offerings, and deploy entirely new ones, saving all kinds of money while producing more of whatever it is they produce, by using these AI tools. And that could mean this becomes the industry to replace all other industries, or bare-minimum upon which all other industries become reliant; a bit like power companies, or increasingly, those that build and operate data centers.There’s a burgeoning counter-narrative to this narrative, though, that suggests we might soon run into a wall with all of this, and that, consequently, some of these expectations, and thus, these future-facing valuations, might not be as solid as many players in this space hope or expect.And that’s what I’d like to talk about today: AI scaling walls—what they are, and what they might mean for this industry, and all those other industries and entities that it touches.—In the world of artificial intelligence, artificial general intelligence, or AGI, is considered by many to be the ultimate end-goal of all the investment and application in and of these systems that we’re doing today.The specifics of what AGI means varies based on who you talk to, but the idea is that an artificial general intelligence would be “generally” smart and capable in the same, or in a similar way, to human beings: not just great at doing math and not just great at folding proteins, or folding clothes, but pretty solid at most things, and trainable to be decent, or better than decent at potentially everything.If you could develop such a model, that would allow you, in theory, to push humans out of the loop for just about every job: an AI bot could work the cash register at the grocery store, could drive all the taxis, and could do all of our astronomy research, to name just a few of the great many jobs these ...
    続きを読む 一部表示
    22 分
  • Online Tutoring
    2024/11/12
    This week we talk about the Double Reduction Policy, gaokao, and Chegg.We also discuss GPTs, cheating, and disruption.Recommended Book: Autocracy, Inc by Anne ApplebaumTranscriptIn July of 2021, the Chinese government implemented a new education rule called the Double Reduction Policy.This Policy was meant, among other things, to reduce the stress students in the country felt related to their educational attainment, while also imposing sterner regulations on businesses operating in education and education-adjacent industries.Chinese students spend a lot of time studying—nearly 10 hours per day for kids ages 12-14—and the average weekly study time for students is tallied at 55 hours, which is substantially higher than in most other countries, and quite a lot higher than the international average of 45 hours per week.This fixation on education is partly cultural, but it’s also partly the result of China’s education system, which has long served to train children to take very high-stakes tests, those tests then determining what sorts of educational and, ultimately, employment futures they can expect. These tests are the pathway to a better life, essentially, so the kids face a whole lot of pressure from society and their families to do well, because if they don’t, they’ve sentenced themselves to low-paying jobs and concomitantly low-status lives; it’s a fairly brutal setup, looked at from elsewhere around the world, but it’s something that’s kind of taken for granted in modern China.On top of all that in-class schoolwork, there’s abundant homework, and that’s led to a thriving private tutoring industry. Families invest heavily in ensuring their kids have a leg-up over everyone else, and that often means paying people to prepare them for those tests, even beyond school hours and well into the weekend.Because of all this, kids in China suffer abnormally high levels of physical and mental health issues, many of them directly linked to stress, including a chronic lack of sleep, high levels of anxiety, rampant obesity and everything that comes with that, and high levels of suicide, as well; suicide is actually the most common cause of death amongst Chinese teenagers, and the majority of these suicides occur in the lead-up to the gaokao, or National College Entrance Exam, which is the biggest of big important exams that determine how teens will be economically and socially sorted basically for the rest of their lives.This recent Double Reduction Policy, then, was intended to help temper some of those negative, education-related consequences, reducing the volume of homework kids had to tackle each week, freeing up time for sleep and relaxation, while also putting a cap on the ability of private tutoring companies to influence parents into paying for a bunch of tutoring services; something they’d long done via finger-wagging marketing messages, shaming parents who failed to invest heavily in their child’s educational future, making them feel like they aren’t being good parents because they’re not spending enough on these offerings.This policy pursued these ends, first, by putting a cap on how much homework could be sent home with students, limiting it to 60 minutes for youngsters, and 90 minutes for middle schoolers.It also provided resources and rules for non-homework-related after-school services, did away with bad rankings due to poor test performance that might stigmatize students in the future, and killed off some of those fear-inducing, ever-so-important exams altogether.It also provided some new resources and frameworks for pilot programs that could help their school system evolve in the future, allowing them to try some new things, which could, in theory, then be disseminated to the nation’s larger network of schools if these experiments go well.And then on the tutoring front, they went nuclear on those private tutoring businesses that were shaming parents into paying large sums of money to train their children beyond school hours.The government instituted a new system of regulators for this industry, ceased offering new business licenses for tutoring companies, and forced all existing for-profit businesses in this space to become non-profits.This market was worth about $100 billion when this new policy came into effect, which is a simply staggering sum, but the government basically said you’re not businesses anymore, you can’t operate if you try to make a profit.This is just one of many industries the current Chinese leadership has clamped-down on over the past handful of years, often on cultural grounds, as was the case with limiting the amount of time children can play video games each day. But like that video game ban, which has apparently shown mixed results, the tutoring ban seems to have led to the creation of a flourishing black market for tutoring services, forcing these sorts of business dealings underground, and thus increasing the fee parents pay for them ...
    続きを読む 一部表示
    21 分
  • British Coal
    2024/11/05
    This week we talk about peat, pig iron, and sulphuric acid.We also discuss the Industrial Revolution, natural gas, and offshore wind turbines.Recommended Book: Deep Utopia by Nick BostromTranscriptThis episode is going live on election day here in the US; and this has been quite a remarkable election season for many reasons, among them that there’s been just a boggling amount of money spent on advertisements and events and other efforts to claim attention and mindshare, and in part because the vitriol and tribalism of the past several elections—an evolved, intensified version of those things—has almost completely dominated all those messages.And as someone who’s based in a swing-state, Wisconsin, I can tell you that it’s been a lot. It’s been a lot everywhere, as US elections also claim more than their fair-share of news reportage in other countries, but in the US, and in the relatively few states that are assumed to be the kingmakers in this election, it’s been just overwhelming for months, for basically a year, actually. So instead of doing anything on the election, or anything overtly political—there’ll no doubt be time for that in the coming weeks, once the dust has settled on all this—let’s talk about coal. And more specifically, British coal.Coal has been used throughout the British Isles for a long time, with early groups burning unrefined lumps of the substance to heat their homes, though generally only when their local, close-enough-to-the-surface-to-be-gathered source for the stuff was pure enough to beat-out other options, like peat and wood, which was seldom the case in most of these areas.It was also used to create lime from limestone, the lime used for construction purposes, to make mortar, and it was used for metal-shaping purposes by blacksmiths.Beyond that, though, it was generally avoided in favor of cleaner-burning options, as coal is often accompanied by sulphur and other such substances, which means when burned in its natural form, it absolutely reeks, and it can make anyone unlucky enough to be caught in the smoke it creates tear-up, because the resulting sulfurous gas would react with their eye-moisture to create sulphuric acid; not pleasant, and even though it was generally better than peat and wood in terms of the energy it contained, it was worse in basically every other way.Earlier groups of people had figured out the same: there were folks in China as early as 1000 BC, for instance, who used these rocks as fuel for copper smelting, and people in these same early-use areas, where coal veins were exploitable, were really leaning into the stuff by the 13th century AD, when Marco Polo visited and remarked that the locals were burning these weird black stones, which granted them wild luxuries, like being able to take “three hot baths a week.”Groups in Roman Britain were also surface mining, using, and trading coal at a fairly reasonable level by around 200 AD, though it was still primarily used to process things like grain, which needed to be dried, and to work with iron—as with those Chinese groups, coal has long been appreciated for its smelting capabilities, because of its high energy density compared to other options.In the British Isles, though, coal was largely imported to major cities by sea, until around the 13th century when the easily accessed deposits were used up, and shaft mining, which granted access to deeper deposits via at times long tunnels that had to be dug and reinforced, was developed and became common, including in areas that hadn’t previously had surface sources that could be exploited.In the 16th century, this and similar innovations led to a reliable enough supply of coal that folks living in the city of London were able to largely replace their wood- and peat-burning infrastructure with coal-burning versions of the same.It’s thought that this transition was partly the consequence of widespread deforestation that resulted from a population boom in the city—more lumber was needed to build more buildings, but they also required more burnable wood fuel—though some historians have argued that what actually pushed coal to the forefront, despite its many downsides compared to wood and peat, is the expansion of iron smelting and the increasing necessity of iron for Britain’s many wars during this period, alongside England’s burgeoning glass-making industry.Both of these manufacturing processes, making iron and glass, required just a silly amount of fuel—making just one ton of the lowest-grade cast iron, so-called pig iron, consumed something like 28 tons of seasoned wood, and glass was similarly wood-hungry.What’s more, that combination of city expansion and the King’s desire to massively build-out his Navy meant timber resources were continuously being strained anywhere industry popped up and flourished, so those industries would then expand to areas where wood was still cheap, over time making wood it more ...
    続きを読む 一部表示
    19 分

Let's Know Thingsに寄せられたリスナーの声

カスタマーレビュー:以下のタブを選択することで、他のサイトのレビューをご覧になれます。