Dennis Hackethal’s Blog
My blog about philosophy, coding, and anything else that interests me.
Tweets
An archive of my tweets and retweets through . They may be formatted slightly differently than on Twitter. API access has since gotten prohibitively expensive – I don't know whether or when I'll be able to update this archive.
But in case I will, you can subscribe via RSS – without a Twitter account. Rationale
Google the term "knowledge" and you'll get:
"facts, information, and skills acquired by a person through experience or education [...]"
😭😭😭
I was worried you’d say that. Will skip this one, thanks :)
@zombieinjeans @DavidDeutschOxf
Blind evolution often finds solutions in the biosphere. But knowledge in humans has the advantage that not every single explanation along the way has to work, so it has more flexibility.
Genetic pluralism may be part of the answer, too.
It doesn’t prove general relativity. Epistemological blunder.
RT @DavidDeutschOxf:
Agreed. (Disturb.) twitter.com/ZachG932/statu…
How was “A New Kind of Science”? It was recommended to me buy an AI person, but I haven’t gotten around to it yet.
@zombieinjeans @DavidDeutschOxf
I go back and forth on this. On the lowest lvl there seems to be blind evolution happening in our minds. In hindsight it looks goal oriented and purposeful, not random. So does biological evolution, though. But yes, things we have learned in the past can help with a new problem.
Got it - are you referring to the part where I invoke the hidden target function to gather return values and then reconstruct the function from those values as “explaining data”?
Got it. I think I understand what you mean by “objective”. And what do you mean by “criterion”?
What do you mean by “mismatch between criterion and current objective”? A mismatch between target function and its replica?
Yes, I think of it this way as well.
@ChristopherCode @DavidDeutschOxf
I know next to nothing about quantum operations, but the laws of epistemology should apply to function implementations on quantum computers as well.
@DavidDeutschOxf would know better.
How do they do this? Do they not implement a function of their own to imitate the other function?
It should apply to all explanations.
I’m not sure yet how to represent more complex functions such as human speech, let alone philosophical theories. But given lambda calculus’ universality, it must be possible.
FWIW functions without parameters are also explanations.
The sixth episode of the podcast on artificial creativity is out. It's another video episode, and as always, heavily inspired by @DavidDeutschOxf:
@madeofmistak3 @ghstgrllll
Not yet - thanks for the recommendation!
@madeofmistak3 @attractfunding
Can I throw “The Babadook” in the ring?
@madeofmistak3 @ghstgrllll
Mother! is unfortunately full of spaceship earth thinking, but good otherwise. I know it splits the crowd because half the movie is supposed to be annoying, but if you can ignore that, you’ll have a great time watching it.
RT @ToKTeacher:
Article summarising the prevailing intellectual view of humanity at a concentration approaching saturation. Unbounded pessi…
RT @davidarredondo:
Popper on Definitions: interesting. youtu.be/fgeMEr16yYk
Just watched it today myself. Love me some Popper.
@Azaeres @onnlucky @SerhiiHavrylov
Yes. I will get into some of that in the next episode. One thing to note is that there are always infinitely many functions that will fit the dataset perfectly. The question is how to find good, i.e. hard to vary, function implementations that match.
@RichardDawkins @center4inquiry
Nice. Add @Target for selling homeopathic eardrops I accidentally bought once thinking they were legitimate.
@Azaeres @onnlucky @SerhiiHavrylov
Ah, got it. Again, I’m hesitant to address problems of scale or performance without first knowing how the creative algorithm works. Only that knowledge would suggest performance problems. But you mentioned you had some background knowledge about this. Care to share?
@Azaeres @onnlucky @SerhiiHavrylov
That is precisely how an AGI does not learn. It’s induction again.
@Azaeres @onnlucky @SerhiiHavrylov
How do you know it will take immense resources without having a good explanation of how the program works first?
@onnlucky @Azaeres @SerhiiHavrylov
Indeed. We already know that modern day computers could run a universal creativity program. What's lacking here is neither hardware nor processing power: we lack a good explanation of how to write the program.
If resources were the problem, we would gladly wait to run it if we had a good explanation of how it works.
Bayesianism is inductivism in a cheap tuxedo. Has nothing to do with creativity. See bretthall.org/bayesian-epist… by @ToKTeacher
The problem with inductive processes is that they don’t exist.
Re intractable: I don’t know what you mean by “holistic nature”, but our minds are creative somehow, so it can’t be intractable. We just don’t yet know how.
I skimmed it. The causal approach is the right one. Also reading up on program synthesis now.
@SpaceTime_A @DavidDeutschOxf @ToKTeacher
Great question - I have no idea :)
It is creativity. And we are beginning to understand it. Baby steps :)
@ChristopherCode @dela3499 @DavidDeutschOxf
I responded in the document in purple.
@ChristopherCode @dela3499 @DavidDeutschOxf
Indeed. E.g. for objects in JS, Clojure etc one first needs an explanation of how to map keys reliably to values: a hash function. We know from lambda calculus that any such concepts can be built from pure, single parameter functions, because it is Turing complete.
Yeah, that’d be pretty neat. Being a universal explainer, the creative algorithm could do so.
@Doxosophoi
What do you mean by “epistemological facts”? Do you mean rules such as hard to vary? If so, my guess is knowledge of those rules is the result of the creative algorithm as well. If your question is how the creative algorithm creates new explanations, I haven’t covered that yet.
First time reading about this, too. First impression: Sounds like Occam’s razor applied to functions. I’m after good function implementations, which need not be the shortest. The best implementation of multiplication in this episode only happens to be the shortest, IIRC.
First time reading about Solomonoff’s inductive inference, so may be missing something. Wikipedia says it “is a theory of prediction based on logical observations”. Sounds inductive to me. Too focused on observation. No mention of knowledge creation as far as I can tell.
The podcast is now available on Apple Podcasts:
Thank you for reminding me. Episode 5 you will probably want to watch on YouTube since it heavily relies on video, but all others so far you can now listen to on Apple Podcasts as well: podcasts.apple.com/us/podcast/pod…
Today I learned that some recursive functions cannot be written in iterative form:
The fifth episode of the podcast on artificial creativity is out. This time it's a video episode. As always, heavily inspired by @DavidDeutschOxf.
@krazyander @ToKTeacher @RealtimeAI @DoqxaScott
One of the points of h2v is that you don’t even need to bother testing e2v theories.
@krazyander @ToKTeacher @RealtimeAI @DoqxaScott
You observe a conjuring trick and want to explain how it’s done. The explanation “the conjurer did something” has a lot of “evidential support” - you saw him doing something - but that’s a bad explanation b/c easy to vary. Doesn’t explain what he did and applies to any trick.
Glad to hear! Currently working on episode five, which will be about how the epistemological concepts we covered in episode four apply to computer programs and what that means. Hopefully ready to release soon!
@RealtimeAI @krazyander @ToKTeacher @DoqxaScott
You can tell an explanation is a hard to vary if you try to change parts of it and you end up diminishing its ability to fulfill its purpose. I.e. an explanation is hard to vary vis-a-vis a problem it purports to solve. Pick any theory and try changing parts; if difficult, h2v.
I guess that the flaws you mention are generally the result of irrational memes and/or bad explanations.
In order:
Not generally. A chemistry lab may blow up during an experiment or something, but that’s an exception. Extinction of ideas is fundamentally non violent.
Those may all be drivers but can be overwritten. GPPS still susceptible to irrational memes.
Thanks for listening :) It's part of the appendix of his book "Objective Knowledge": amazon.com/Objective-Know…
Got it. Yes. Two possibilities that could make you correct in the first place:
1) if creativity is solely genetic and requisite knowledge of DNA created (so indirectly caused their own understanding)
2) understanding means replication so genes “understand” themselves in a way.
I watched it on the assumption that that's the one. I can see now how extinction can be seen as a constructor of future possibilities. Still unclear about your remark re DNA/RNA.
RT @fermatslibrary:
B. F. Goodrich Company patented a Möbius strip conveyor belt. It lasts longer since the wear and tear is spread uniform…
Huh, you're right. @DavidDeutschOxf, have you changed your mind on people being universal constructors?
@EvanOLeary do you mean the video on this page? edge.org/conversation/c…
Problems also don't label ideas. If that were the case there'd be information about new knowledge already existing. That'd be induction.
BoI p. 59 "[People] are 'universal constructors'".
p. 76 a constructor is "a device capable of causing other objects to undergo transformations without undergoing any net changes itself".
A problem is a conflict between theories. It doesn't do anything.
People are constructors. I don't think problems are.
Creativity is the only thing I know of capable of creating explanations. As David says in BoI, the creative program may be part genetic, part meme.
Nervous systems on their own don't create explanations. They're just hardware
The podcast is now on YouTube as well. I plan to make a video or two that have screen recordings to show some code, so having all episodes there for context seems to make sense.
Not sure what you mean. Knowledge in DNA not explanatory. At most it explains how to spread through population at expense of rivals.
RT @PessimistsArc:
1981: "If teachers don't stand up to the growing invasion of computers in the classroom, there's a good chance literacy…
Episode 4 of the podcast on artificial creativity is out. Again, heavily inspired by @DavidDeutschOxf.
Sure, if you like. :) That’s more of a science though, since it’s falsifiable by observation.
Many scientists have the wrong PoS (empiricism, instrumentalism, positivism). That can lead them astray since there is no way to do science without PoS. But they all have one. And when they do create knowledge anyway, they’re doing something that’s the object of the study of PoS.
@WiringTheBrain @PrincetonUPress
For the wiring of our brains to shape who we are, it would need to violate the universality of computation.
I haven’t watched it yet, but in case it’s related: I explain in episode three why contributions to AGI based on neuroscience would likely need to violate the universality of computation.
The podcast is now on @Spotify... Approval on Apple podcasts still pending.
It's pending review on Apple Podcasts. Will roll out to more apps as well.
The third episode of the series on artificial creativity is out, again heavily inspired by @DavidDeutschOxf: soundcloud.com/dchacke/artifi…
@thethinkersmith @DavidDeutschOxf
Wow, thank you :) I'm glad you like it!
The second episode of the series on artificial creativity is out: soundcloud.com/dchacke/artifi…
Starting an audio series on artificial creativity, heavily inspired by @DavidDeutschOxf. soundcloud.com/dchacke/artifi…
Do I have your permission to quote some passages from The Beginning of Infinity for a podcast series I am planning to make?
Or rather, their implementation is still “prescribed”, but their output is not exactly predictable. Input/output pairs can’t be reliably reproduced.
I’m not sure. Isn’t creativity encoded in our genes and must therefore be programmable?
Not being able to relate output to input in a prescribed way just means the program isn’t pure. Eg Math.random(), Date.now(), etc. Those functions are impure but programmable.
RT @DavidDeutschOxf:
Foul.
In every "Before allowing them to read"
The mind-forg'd manacles I hear. twitter.com/nfergus/status…
The reason I ask is because I think it means something else - assuming you’re using the term the same way it’s used in “universal explainer” for example - but I want to make sure I understand your position first.
“We cannot get away from the laws of physics. They apply to everything all the time, that’s what “universal” means.” podcasts.apple.com/us/podcast/tok… at 11:15
@ToKTeacher Can you please elaborate on what you think “universal” means?
RT @webdevMason:
Westerners now have such a reflexive tendency to associate having society-level preferences at all with a rapacious colo…
RT @HumanProgress:
The radicalization of the environmentalist movement, as seen on the streets of London over the past week, is acceleratin…
What's the third picture? Presumably Germany minus French occupied land? And something's missing in Silesia there, too?
"The Creative Brain" on Netflix is a great example of the nonsense neuroscientists spew about creativity.
@ReachChristofer @reasonisfun @ToKTeacher @AndrewREsquibel
I wonder if some brains are slower than other solely in terms of hardware. My guess is “no” or “negligibly so” unless there are genetic mutations.