I’m a maker.
I think you’re putting too much faith in humans here. As best we can tell the only difference between how we compute and what these models do is scale and complexity. Your brain often lies to you and makes up reasoning behind your actions after the fact. We’re just complex networks doing math.
Hate to break it to you, but that’s all you are too.
Nope, you’re looking at it wrong. The Dev got paid to write that code and for all of their 20 years experience. The code was freely given away after that. Nobody loses when knowledge is shared, humanity wins. It gets hairy when you have businesses whose model relies on giving some content away for free and locking some behind a pay wall. Obviously using all of that to train a model without paying anything implies that they never had a subscription, but if they did have one and gave the model access? What’s the difference between that and paying someone to read all those articles? What’s the difference between training a model and paying an employee while training them to expertise? We’re acting like these models are some kind of machine that chops up text and regurgitates it, but that could describe your average college freshman just as well. We’re fast approaching the point where the distinction is meaningless. We can’t treat model training any different from teaching a student.
I subscribe to [email protected] which helps. Other than that I look for mentions of other communities in comments, similar to how I used to on reddit.
You can hear James’ voice in some of the more heinous quotes :(
Loved it too. It’s been a year or so but I feel like this was a two day read for me. I couldn’t put it down.