• Deestan@lemmy.world
    link
    fedilink
    arrow-up
    113
    arrow-down
    13
    ·
    21 days ago

    Training the models is very resource intensive, but after that it’s basically fine. I can run Midjourney image generation on my modest gaming laptop. Takes maybe 30 seconds for a high-resolution image at a laptop’s “gaming mode” power consumption.

    AI image generation is comparable in electric use to e.g. playing Valheim or Elden Ring.

    It’s when it’s scaled up industrially that it becomes a huge waste of electricity. Me playing Valhelm for 5 minutes is nothing. My startup creating 20000 bots playing Valheim 24/7 is a problem for society.

    • PeriodicallyPedantic@lemmy.ca
      link
      fedilink
      arrow-up
      144
      arrow-down
      20
      ·
      21 days ago

      It’s the mining of diamonds that kills all the children. After the diamond is mined, I can use it with almost no child deaths. Diamonds are fine.

      • ayyy@sh.itjust.works
        link
        fedilink
        arrow-up
        31
        arrow-down
        5
        ·
        21 days ago

        No, using an already-trained model doesn’t “use up” the model in exactly the same way that pirating a movie doesn’t steal anything from Hollywood.

        • PeriodicallyPedantic@lemmy.ca
          link
          fedilink
          arrow-up
          8
          arrow-down
          10
          ·
          20 days ago

          Use a diamond doesn’t “use up” that diamond.

          And yet, it’s still unethical to buy already mined blood diamonds from people who continue to mine more blood diamonds. Funny thing about that, huh

          • bob_lemon@feddit.org
            link
            fedilink
            arrow-up
            15
            ·
            20 days ago

            In this analogy, using the diamond does use it up. In the sense that none else can use that diamond concurrently. If someone else wants a diamond, more children must die.

            This is different from the trained AI model, which can concurrently be used by everyone at the same time, at very little extra cost.

            • PeriodicallyPedantic@lemmy.ca
              link
              fedilink
              arrow-up
              3
              arrow-down
              1
              ·
              20 days ago

              Even if the diamond mine owners stop mining, it’s unethical to buy their stockpile of blood diamonds.

              Also, there is a cost besides electricity - the theft of artist’s work is inherent to the use of the model, not just in the training. The artist is not being compensated whenever an AI generates art in their style, and they may in fact lose their job or have their compensation reduced due to artificial supply.

              Finally, this is an analogy, it’s not perfect. Picking apart incidental parts of the analogy doesn’t really prove anything. Use an analogy to explain a problem, but don’t pick apart an analogy as though you’re picking apart the problem.

              • KillingTimeItself@lemmy.dbzer0.com
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                20 days ago

                and they may in fact lose their job or have their compensation reduced due to artificial supply.

                highly doubt. Any artists that do lose their job are probably mostly ok with it anyway, since it’s most likely going to be graphical drivel anyway. In fields like media theres a different argument to be made, but even then it’s iffy sometimes. Also i don’t think this would be considered artificial supply, it would be artificially insisted demand instead no? Or perhaps an inelastic demand side expectation.

                Although, it would be nice to have some actual concrete data on artists and job prospects in relation to AI. Unfortunately it’s probably too early to tell right now, since we’re just out of the Luddite reactionary phase, who knows.

                • PeriodicallyPedantic@lemmy.ca
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  19 days ago

                  Any artists that do lose their job are probably mostly ok with it anyway, since it’s most likely going to be graphical drivel anyway.

                  Replace “artist” and “graphical”, and you just described most jobs. I don’t think most people are ok losing their jobs even if those jobs aren’t especially inherently rewarding; they’re getting paid for their area of training. They’re not just gonna be able to find a new job because in this hypothetical, the demand for it (a living human doing the work) is gone.

                  I consider this an increase in supply because it’s an increase in the potential supply. Productivity increases (which is what this is) mean you can make more, which drives down the price, which means that artists get paid less (or just get replaced).

                  Remember: if you 10x the productivity of an employee, that typically doesn’t mean you produce 10x the product, it typically means you need 1/10th the employees. That payroll saving goes right into the pockets of execs.

                  Also wrt luddites, they weren’t wrong. It did absolutely demolish their industry and devastate the workers. It’s just that the textile industry was only a small part of the economy, and there were other industries who could absorb the displaced workers after they got retrained.
                  LLMs threaten almost every industry, so there is a greater worker impact and fewer places for displaced workers to go. Also now workers are responsible for bearing the costs of their own retraining, unlike back in the day of the luddites.

                  • KillingTimeItself@lemmy.dbzer0.com
                    link
                    fedilink
                    English
                    arrow-up
                    2
                    ·
                    19 days ago

                    Replace “artist” and “graphical”, and you just described most jobs.

                    yeah, it’s a generalized statement, so that makes sense. It’d be weird if my statement only applied to the artist economy, not like, the rest of the economy.

                    I don’t think most people are ok losing their jobs even if those jobs aren’t especially inherently rewarding; they’re getting paid for their area of training.

                    i think this is what most people would say, and i would generally agree, however there is always going to be some level of job market upset, which is a good thing for society, and people, even if they don’t like it. It’s a liquidity thing at the end of the day. If you have no liquidity doing anything other than what you first started doing is going to be really hard, if you have more liquidity, it becomes easier. Although there is a point of diminishing returns where it turns into a revolving door of short term labor.

                    They’re not just gonna be able to find a new job because in this hypothetical, the demand for it (a living human doing the work) is gone.

                    yeah but that’s the thing, i’m not convinced that the entire field is just, gone. Maybe a small portion of it, like 10-20% is less active overall right now. Some art communities are pretty insulated from the broader market as a whole, the furry community being one of them. I think most realistically, AI generated art is going to be used in places where you aren’t actively removing art from the art pool, but adding more art to the already busy art pool.

                    I mean in Hollywood for example, AI is most commonly used to do what, remove mustaches and shit? Replace existing CGI that would need to be done on top of faces? Particularly the really time intensive and tedious parts of it that aren’t cost effective to approach and manage. Otherwise you would just pay a normal artist to do it, because they’re going to be extremely competitive. It’s not like you can just delete an entire production team and smash a movie script through an AI (that was also written by AI) and get a full movie out of it.

                    I think a lot of it is a senseless overreaction, i’m sort of sympathetic to it, but at the end of the day, there hasn’t been an artist famine to my knowledge, so it seems like things are going fine.

                    I consider this an increase in supply because it’s an increase in the potential supply.

                    counter point. It’s not actually an increase in supply potential, it’s both supply and demand. You can’t just look at this like it’s increasing productivity exclusively, although it is in some part, AI simply can’t do certain things that humans can. And you can’t act like an increase in productivity won’t drive in increase in demand either. Because it will. That’s the entire operating principle of the global economy. a steady increase in productivity leads to a steady increase in supply, which leads to a steady increase of demand, which leads to overall growth.

                    You might be paid less as an artist, but unless you get a significant downturn that we would’ve already heard about, things like covid are going to effect you more heavily.

                    if you 10x the productivity of an employee, that typically doesn’t mean you produce 10x the product, it typically means you need 1/10th the employees. That payroll saving goes right into the pockets of execs.

                    but you also need to consider that in the global market, you aren’t just supplying a magical constant of demand, if you can increase demand, you can increase supply. and lower the price of the product as well, making it both more competitive, more accessible, and more productive. Since now you have an incentive to increase the production of that product to meet supply.

                    Of course if people don’t buy things, it doesn’t matter anymore, but i think both of us here can agree that people don’t really seem content to stop spending money on things any time soon.

                    Also wrt luddites, they weren’t wrong. It did absolutely demolish their industry and devastate the workers.

                    isn’t this primarily because they never industrialized/mechanized and then ended up being out competed in the market by people who did? Even if this is a concern, you can always shift focus, and move from making generalized textiles, to more complex, difficult to make, and more expensive textiles. Humans always have an advantage of machines and robots, we’re smarter. A lot smarter. You can look at other industries like watch making for example, expert watch craftsman could have lost their jobs to mechanized industrial production, but they never did. Hand made watches are still a big deal.

                    LLMs threaten almost every industry

                    i’m not sure how much they threaten every industry collectively, though i’m sure they pose some level of obstacle, at the end of the day i’ve only ever seen AI being used for janitorial tasks in companies, like boiler-plating reports, and categorizing documentation. And also customer support, which is not particularly something i’m a fan of, but there is definitely utility in it. Almost never fully replacing entire positions, that would be too costly.

          • bluewing@lemm.ee
            link
            fedilink
            arrow-up
            3
            ·
            20 days ago

            A very large amount of those dug up diamonds end up as “industrial diamonds.” Because they are far from gemstone quality. And they definitely get used up. I have used up my share of them as cutting tools when I was a toolmaker.

            • PeriodicallyPedantic@lemmy.ca
              link
              fedilink
              arrow-up
              2
              arrow-down
              1
              ·
              20 days ago

              Ok cool, but this is an analogy. Why are you defending the use of AI by megacorps by objecting to irrelevant parts of an analogy on technicality?

                • PeriodicallyPedantic@lemmy.ca
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  edit-2
                  19 days ago

                  You’re insufferable.

                  I know the analogy isn’t a perfect fit for LLMs in general. Analogies never come close to describing the entire thing they’re analogs of, they don’t need to.

                  It doesn’t matter because this is a suitable analogy for the argument. This is how analogies work.

                  The argument is that because the harm has already been done, it’s fine to use LLMs.
                  That same argument can be made for blood diamonds, and it’s untrue for exactly the same reason:
                  Because buying the use of LLMs (which is mostly how they’re used, even if you pay in data instead of money) is funding the continued harmful actions of the producer.

                  I can’t believe I have to explain how analogies are used to a grown ass adult.

          • KillingTimeItself@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            20 days ago

            this is actually a really debatable argument. If you’re buying it first hand, from somebody trying to make money, yes it could arguably be unethical, but if you’re buying it second hand, i.e. someone who just doesn’t want it anymore, you could make the argument that it’s an ethically net positive transaction. Since they no longer want the diamond, and wish to have money instead, and you wish to have the diamond, and less money. Everybody wins in 2nd hand deals, weirdly enough.

            • PeriodicallyPedantic@lemmy.ca
              link
              fedilink
              arrow-up
              1
              ·
              19 days ago

              Setting aside “there is no ethical consumption under capitalism”, which is a debatable for another time:

              I don’t totally agree with your assessment of 2nd hand sales: it’s not ethical positive, at best it’s ethically neutral, because demand trickles up the market. I could go into this more, but ultimately it it’s irrelevant:

              The 2nd hand LLM market doesn’t work like that because LLMs are sold as a service. The LLM producers take a cut from all LLM resellers.

              You could make a case that self hosting a free open source LLM like OLlama is ok, but that’s not how most LLMs are distributed.

              • KillingTimeItself@lemmy.dbzer0.com
                link
                fedilink
                English
                arrow-up
                1
                ·
                19 days ago

                Setting aside “there is no ethical consumption under capitalism”, which is a debatable for another time:

                the simple answer is yes and no, there is both ethical, and unethical consumption under capitalism. As there is in any society throughout human history.

                I don’t totally agree with your assessment of 2nd hand sales: it’s not ethical positive, at best it’s ethically neutral, because demand trickles up the market. I could go into this more, but ultimately it it’s irrelevant:

                if we start from a basis of ethical neutrality, ignoring the parties as a baseline, i included the parties because i would consider two parties who wish to do business, successfully doing business, to be an ethically positive thing, as two people have had their needs/wants more closely met by this deal. Therefore making it ethically positive.

                If you’re starting from an ethically negative point, you need some sort of inherent negative value to exist within that relationship. Perhaps the guy who is selling was hitler for example, that would make it an ethically negative scenario. Maybe after he sold it, he would’ve donated the money or given it to someone who can do something more useful with it, making it even more ethically positive.

                there’s an argument to be made for something with perceived value and static supply to have an upwards trajectory in the market going forward, for something like blood diamonds this is unlikely, but assuming it did happen, this should actually be an ethically positive thing assuming that the families of the original diamonds ended up getting their hands on them for example. If they weren’t given back to the family then it doesn’t really matter since you’re back to the baseline anyway. Prospective investments aren’t a real tangible asset, so we can’t forsee that.

                although to be clear, i wasn’t talking about LLMs, this is a much harder thing to do with LLMs, although the argument here is that the training has already been done, the power has already been consumed, you can’t unconsume that power, so therefore whatever potential future consumption that could happen, is based off of the existing consumption already. Unless of course you did more training in the future, but that’s a different story. Just boycott AI or something at that point lol.

                • PeriodicallyPedantic@lemmy.ca
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  18 days ago

                  In both your examples, you seem to assume that the harm is already done and that there is no continued harm.

                  But in both cases the harm isn’t finished; the blood diamond mine owners use the continued sale of blood diamonds to fund their continued mining operations, and LLM providers use the sale of LLM use to fund the continued training of new LLM models.

                  Regardless of if you think that buying second hand blood diamonds increases overall demand in the market (which blood diamonds sellers benefit from); it is clearly the case that selling (and reselling) LLM services benefit the LLM providers, and we can trivially see that they’re training new models and not making amends.

                  • KillingTimeItself@lemmy.dbzer0.com
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    18 days ago

                    But in both cases the harm isn’t finished;

                    says who? In my example i assumed that the blood mined diamonds had already ceased production, because obviously if they haven’t theres no point in talking about market forces at all. The more pressing concern would be the literal blood diamonds. I was talking about the second hand market for what were previously blood diamonds, and technically still are, just without the active cost associated.

                    And again, what funds, there are no funds, this is a purely second hand sale. The seller is not giving a percent back to the diamond mining company that no longer exists here.

                    and LLM providers use the sale of LLM use to fund the continued training of new LLM models.

                    i would agree with this, but it seems like we very quickly hit a new technical limitation as of the last few years. The pace has drastically slowed, the technical nature of the AIs have improved less, the broad suitability has improved more. And it’s also worth noting that this is an itemized cost. Not a whole static cost. Just saying “but but, ai consumes lots of energies” is meaningless, unless you can demonstrate that it’s significant, and actually matters. I think there is definitely an argument to be made here, but unfortunately, i have yet to see anyone actually argue it.

                    and we can trivially see that they’re training new models and not making amends.

                    what do you mean when you say amends? Carbon capture? Paying off artists so they can "steal their jobs? This is meaningless to me without an actual practical example.

      • huginn@feddit.it
        link
        fedilink
        arrow-up
        25
        arrow-down
        2
        ·
        21 days ago

        I mean yeah: if we went and killed every person who benefits from conflict diamonds and closed all blood diamond mines why wouldn’t you be cool with using the resources? Their evil origin has little to do with their practical utility and if the original sin is expiated there’s no reason not to?

        Like yeah conflict diamonds have basically no purpose because we can make diamonds cheaper and better in labs but in a situation where there are more practical uses (cobalt, LLMs) once we cleanse the land of the sinners why wouldn’t we use their ill gotten gains for good?

        • PeriodicallyPedantic@lemmy.ca
          link
          fedilink
          arrow-up
          4
          ·
          edit-2
          20 days ago

          But we’re not “killing” every person who benefits, literally or figuratively. We’re continuing to buy their diamonds (pay them in money and data) while they continue to mine (train new models, use copyrighted material).

          • huginn@feddit.it
            link
            fedilink
            arrow-up
            1
            ·
            20 days ago

            Agreed.

            But the entire point I’m making is there’s nothing wrong with the diamonds, the problem is with the method and the people profiting from it.

            You were saying the diamonds were not fine by dint of origin. I’m saying let’s right the wrong and then use the diamonds.

            • PeriodicallyPedantic@lemmy.ca
              link
              fedilink
              arrow-up
              3
              ·
              20 days ago

              It’s not a perfect analogy, models ape the work of artists and take their jobs; it’s like if the diamond was bloody, and as long as it existed, the miner’s family not only didn’t get compensated for the loss but we’re also prevented from getting jobs themselves.

              We’re not righting the wrong, were making the wrongs even worse. At some point you have to just burn the whole thing down.

            • Jtotheb@lemmy.world
              link
              fedilink
              arrow-up
              2
              ·
              edit-2
              20 days ago

              Okay, so again, no new machine learning ever, unless you can prove it’s done without environmental impact or affecting peoples’ right to a dignified existence. That’s the wrong righted. That’s what you’re advocating. Am I misunderstanding?

        • queermunist she/her@lemmy.ml
          link
          fedilink
          arrow-up
          3
          arrow-down
          10
          ·
          edit-2
          21 days ago

          Do the concepts “reparations” or “compensation for loss and damage” mean anything to you?

          The people who were exploited should be the ones to benefit from those diamonds.

            • queermunist she/her@lemmy.ml
              link
              fedilink
              arrow-up
              2
              arrow-down
              3
              ·
              21 days ago

              Sounds like you think we should use the diamonds. I wouldn’t be cool with using those diamonds because they belong to the people who were forced to mine them, not me.

              • KillingTimeItself@lemmy.dbzer0.com
                link
                fedilink
                English
                arrow-up
                1
                ·
                20 days ago

                I wouldn’t be cool with using those diamonds because they belong to the people who were forced to mine them

                well most of them are dead aren’t they? Are we going to put them back into their coffins? Or, how are we planning on redistributing these?

                Dead people can’t own things, so that seems like an illogical conclusion, perhaps their estate or family? They didn’t do the work, but they would arguably be most entitled to it.

          • KillingTimeItself@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            1
            ·
            20 days ago

            The people who were exploited should be the ones to benefit from those diamonds.

            i mean probably, but this would be a question of what the law says. If we’re talking philosophy that’s irrelevant here, but to include it anyway, it would be something like “the most ethical source of any given item should be most preferred over any other source of said item” or if we’re operating under an ideology of anti-human exploitation idk where we would even start. You need a really concrete definition of exploitation, and how to combat it effectively, without just exploiting more people.

      • Deestan@lemmy.world
        link
        fedilink
        arrow-up
        8
        ·
        21 days ago

        I see your point and agree with it, but I believe you read more defense in my comment than I tried to put in.

        I’m not in favor of this waste.

      • KillingTimeItself@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        20 days ago

        i mean yeah, statistically, an already mined diamond is a child already dead. you would just stop new diamond mining, or move away from child consumptory diamond mining, you aren’t going to completely demolish every child diamond in existence though, there’s no point, harms already done. Might as well leave them in the market.

        • PeriodicallyPedantic@lemmy.ca
          link
          fedilink
          arrow-up
          1
          ·
          19 days ago

          But buying them funds the diamond miners to mine more. That’s the point.

          By participating in the market, you’re perpetuating blood diamonds.

          • KillingTimeItself@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            1
            ·
            19 days ago

            only if they existed actively. And when it comes to the secondhand market, someone who no longer wants a product, and someone who wants that product, who can buy it from the person who no longer wants it, effectively means that two people get the same value from one singular product, essentially creating value from thin air.

            The point i’m making, is that as long as you have diamond mining that requires killing people to produce diamonds, those diamonds are an ethically negative commodity, however if you are no longer killing people, those diamonds are already out there, those people have already been killed, there is nothing you can do to undead those people. So you might as well leave it in market circulation at that point.

            You could argue that it would incentivize more illegal mining, but i would argue that bad regulations and enforcement incentivize illegal mining instead.

            • PeriodicallyPedantic@lemmy.ca
              link
              fedilink
              arrow-up
              1
              ·
              18 days ago

              I think that the market (profit) incentives the mining, and that lax regulations simply fail to curb that incentive. We can see from the war on drugs that simply regulating or criminalizing something won’t stop it if there is a market, it just drives up prices.

              But in any case, this aspect is a lot less ambiguous for LLMs because selling the use of an LLM is legal, and the sellers use the money to train new LLMs.

              So let’s create regulations around LLMs and enforce those regulations, before it starts to really affect the job market and environment.

              • KillingTimeItself@lemmy.dbzer0.com
                link
                fedilink
                English
                arrow-up
                1
                ·
                18 days ago

                i definitely agree that there needs to be some rewriting of law, specifically copyright, which will inevitably be relevant to AI. But i’m still not convinced it’s a massive market black hole or anything.

                Unless you want to be cucked like farmers in the US who take in massive subsidies and cry and moan everytime something moderately inconveniences them.

                  • KillingTimeItself@lemmy.dbzer0.com
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    16 days ago

                    shouldn’t this be the default position of the economy though? Especially in a democratic society, where voters are actually educated.

                    The workforce is your primary labor pool, so assuming enough governmentally enforced labor protections, and significant drawbacks in more exploitation, it will inevitably trend towards less.

    • The Octonaut@mander.xyz
      link
      fedilink
      arrow-up
      18
      arrow-down
      1
      ·
      21 days ago

      Is Midjourney available for use locally now? Or have you misunderstood Midjourney taking 30 seconds to generate from their server as happening locally?

      • Gutek8134@lemmy.world
        link
        fedilink
        arrow-up
        15
        ·
        21 days ago

        I know a guy that uses Stable Diffusion XL locally with a few LORAs, last time I’ve heard one 2k image took 2 minutes on RTX 30 or 40 something

        IDK how expensive is Midjourney in comparison, but running it locally doesn’t sound impossible

        • herrvogel@lemmy.world
          link
          fedilink
          arrow-up
          3
          arrow-down
          1
          ·
          20 days ago

          That sounds a bit too much. Generating an sdxl image and then scaling it up is the common procedure, but that should not take 2 minutes on a 40xx card. For reference I can generate 3 batches of 5 images (without the upscaling step) in less than 2 minutes on my 4070ti. And that’s without using faster sdxl models like lightning or turbo or whatever.

    • TheRealKuni@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      20 days ago

      Yeah. My phone can generate a 512x512 image with Stable Diffusion in like 20 seconds with the right settings.