How Organizations Use AI: Evidence from ChatGPT [pdf]

(cdn.openai.com)

53 points | by malshe 4 hours ago

9 comments

  • jcims 2 hours ago
    I didn't scour the text but one thing I didn't see as an explanatory consideration in the paper is that the larger companies they talk about having larger adoption are also much more likely to have reasonably robust controls (and consequences) that prevent mixing personal/corporate use of AI tooling. That's my world.

    On the other hand my girlfriend is a teacher and for the past year ChatGPT has allowed her to augment her lesson plans with slides/games/etc that have had a very positive effect on student engagement. She also uses it to help with analysis of testing data against her lesson plans and state standards to find places to shore things up as the year progresses. She runs the english language learning department in her school and also uses it to help ensure that there is representation in her materials for the huge mix of cultural backgrounds of her students.

    It's truly helped her immensely and it's all been on her personal account. The district has no program or budget to guide or support teachers and admin on using these tools in education.

    • dimbletimbers 4 minutes ago
      I think a majority of my friends are teachers and this could not be further opposite their sentiments. They feel strongly that it’s dishonest, nearly akin to plagiarism to use AI output in lesson plans. They don’t use it for grading or data analysis b/c of privacy concerns. They mostly complain that the kids are using it for homework, which makes it hard to grade both because it’s too uniform and because there’s no good faith effort going into the work which makes reading it unrewarding. And the consensus is that test scores are down b/c they’re offloading normal course work to AI. It’s basically the bane of their existence.

      The idea that it’s actually better for diversity feels like a wild reach, almost a canned talking point.

    • almostlit 23 minutes ago
      > my girlfriend is a teacher and for the past year ChatGPT has allowed her to augment her lesson plans with slides/games/etc that have had a very positive effect on student engagement.

      My wife, who is also a teacher, does the same thing. I think this is an underrated use of AI right now. There's also been a new wave of edtech companies focusing on AI as the teacher, which I'm skeptical will reach product market fit. I think AI as the teacher assistant could be interesting though.

    • Alien1Being 2 hours ago
      Such a shame.

      Schools for the poorer segments of society keep adding more and more technology, eroding the analytical skills of their students and staff. But the shiny things keep the poorer parents and mediocre teachers happy while keeping down cost per lesson per child. This keeps the administrators happy.

      Meanwhile ultra-expensive elite private schools for the children of the Zuckerbergs, Al Sauds, Al Nahyans, where the teachers are Ivy and Oxbridge graduates emphasise tradition, classical studies and analytical skills while relegating technology to a minor role

      As always the children of the rich and powerful get bespoke education... You could call it elegant education for a more civilized age...

      • rayiner 55 minutes ago
        > But the shiny things keep the poorer parents and mediocre teachers happy while keeping down cost per lesson per child.

        Baltimore spends more per student than Switzerland.

        > As always the children of the rich and powerful get bespoke education... You could call it elegant education for a more civilized age...

        Education for more affluent people is often cheaper per student. The benefit richer students have is that, on average, their parents are smarter, more conscientious, etc.

        • Alien1Being 19 minutes ago
          Baltimore does not spend more per student than Institut Le Rosey, the school of kings... (alumni include the Rothschilds, Rockefellers, the du Ponts)

          The fees are well over USD $150,000 a year.

          Philips Exeter (Zuckerberg's school ) is a bargain by comparison at $80,000 s year .

          These schools emphasis clear and analytical thinking and traditional education.

          In contrast the unfortunate children of the poor are subjected to everyone technology and education trend of the moment...

          Education in public schools has turned into AI slop being generated by poorly educated teachers.

          • xyzzyz 16 minutes ago
            The Rotchschilds, the Rockefellers, and the Du Ponts would have done very well in life just as well had they went to public schools, while the alumni of Baltimore public school would not become Rotschilds and Rockefellers and Zuckerbergs had they gone to Pillips Exeter.
            • DrewADesign 1 minute ago
              That doesn’t mean their schools aren’t better. Money isn’t the only reason having a thoughtful, rigorous and well-constructed education is important.
      • burningChrome 32 minutes ago
        This was more than a decade ago when we were looking into emersion schools for our daughter. We went to several private schools first and all three were emphasizing ipads as their primary tool for teaching language. The public school our daughter was set to attend had an open house promoting its long running emersion programs.

        Wow. Our public school had native speakers and no ipads. There was a major focus on true emersion. From minute one, they were spoken to in the native language. The teachers were incredible. In the first six months, my daughter was speaking in full sentences and her teachers were praising her pronunciation of certain words.

        The real eye opener came at a local park. My daughter was playing with a boy, speaking to him and his mother. I came over to join the fun and the mother started speaking to me in Spanish. I was like, "Uh, I don't speak Spanish." She looked at me confused and said, "Your daughter, she was speaking fluently to both myself and my son in Spanish."

        It was a pretty jaw dropping moment. One, to think we were blessed to have such a great emersion program at our public school and secondly to see my daughter pick up a language so effortlessly. It really reinforced my idea that its all about the quality of education, not necessarily how much you're paying for it.

      • xyzzyz 19 minutes ago
        Keeping down cost per child? What are you talking about? The cost per child has skyrocketed in the US over last 20 years, particularly among the worst-performing schools. Baltimore spends more per child than Mountain View. NYC spends more per child than Palo Alto.

        There is a certain view, popular among many people, that poor performing schools perform badly because they are underfunded. It has been vigorously spread by politicians, teachers, and activists. Well, we ran the experiment. With enormous federal and state spending, we managed to mostly equalize the spending, and, in many cases, fund the badly performing schools more than the good ones. The results of the experiment are very clear: additional funding, by and large, does not *cause* significantly improved educational outcomes. Any observed correlation between school funding and outcomes is a result of who lives in the area, and who attends the school. The casual arrow does not go from funding to outcomes, but from the school population to both funding, and, in parallel, to outcomes.

        • jasonfarnon 0 minutes ago
          "Well, we ran the experiment."

          Yeah, that's not an experiment. Whatever the spending is, a kid dropped in Paly or Gunn is going to have a very different experience than a kid dropped in a rough NYC school. For an experiment look at places that sends kids by lottery from ghettoes out to suburban schools, usually part of some desegregation court order, and you will find a big gap in test score performance and other metrics.

      • jcims 1 hour ago
        Eh.

        Prior to her current role my gf spent about a decade as the head of a very elite private elementary school (she's been in education for 35 years now). Certainly ten figure families represented in the student body with names you would recognize as such. The school had access to all of the resources they could ask for and they did very well on paper. However, the attitude of the students was qualitatively different (and in my gf's opinion much worse) than those of her current students.

        It's fun to imagine a collection of rock star educators huddled around every child just constantly feeding their intellectual curiosity, but the reality is most of those kids just aren't hungry. They live lives of comfortable inconsequentiality which, on average, seems to rob something from human curiosity and drive.

      • XenophileJKO 1 hour ago
        [flagged]
        • Alien1Being 1 hour ago
          This is the typical response of teachers and parents from poorly funded public schools.

          The poor get machine manufactured education and these days AI generated quasi-educational slop.

          As always the children of the rich and powerful get bespoke education... You could call it elegant education for a more civilized age...

    • goodmythical 26 minutes ago
      >She also uses it to help with analysis of testing data

      >on her personal account

      With all the PII stripped, I hope?

  • mjg2 3 hours ago
    Would it kill these OpenAI guys to learn how to write a white paper? Google's DeepMind did better with their AGI to ASI, though I have qualms on their execution.

    Whenever I see these Frontier Labs "publish a paper" on ArXiv.org the phrase Esse Quam Videri strides past my mind—is this genuine progress or merely a marketing metric for their stakeholders?

    • malshe 3 hours ago
      you are complaining about a problem with this paper without explaining what it is.
      • mjg2 2 hours ago
        When I say “how” I mean like how u/glouwbug mentioned: Formatting. But more so Structure.

        When I read artifacts by Frontier Labs I notice a trend towards deteriorating lexicographic architecture. Like how a textbook or larger tomb is constructed for the reader to navigate.

        Instead, now I see continuous monotonic text. It’s as if the author expects us to chuck the artifact into an LLM in order for it to inform us of meaning.

        • alansaber 1 hour ago
          Single column PDF. This is the frontier.
          • StrauXX 1 hour ago
            I find single column much easier to read than dual. Though the line spacing is too much in this concrete example.
      • jcims 2 hours ago
        Granted I didn't comb over it but to me the big issue was that it was just a big data dump without any material attempt at meaningful analysis.

        That and all the figures were at the bottom which was kind of annoying.

      • glouwbug 3 hours ago
        Likely just formatting
      • paxys 3 hours ago
        Making valid complaints would require actually reading it.
    • esafak 2 hours ago
      This is a typical working paper (preprint) not white paper, for its field. You can wait for the journal publication.
  • marcus_holmes 3 hours ago
    "badly". There, fixed it for you.

    Seriously, the best blog post on this subject has to be Ludicity: https://ludic.mataroa.blog/blog/ai-mania-is-eviscerating-glo...

    • GolfPopper 2 hours ago
      Purely anecdotally, over the last few weeks I've noticed a significant uptick in articles trying to convince me how awesome AI is doing. And that's from a pretty high baseline of articles that were already telling me how I should really appreciate how awesome AI is.

      It's almost as though there's some worry that the wheels are going to come off before the right people are able to cash out.

  • hmokiguess 2 hours ago
    Question: "How"

    Answer: Yes.

  • cess11 2 hours ago
    This reads like some crypto or NFT commodity white paper, i.e. like an ad that says you need to use this now, and more, so that you'll figure out what it's good for.

    A difference is that in those white papers they usually argue that their solution is more perfect in some sense than some more adopted alternative, here they instead claim that their commercial offering is "general purpose".

  • ChrisArchitect 2 hours ago
  • sixtyj 3 hours ago
    69 pages long.
    • malshe 3 hours ago
      The main text is only 23 pages double-spaced. The remaining manuscript comprises images, tables, and references. It's not that long really.
  • dowhatnow332211 3 hours ago
    [flagged]