Dennis Hackethal’s Blog
My blog about philosophy, coding, and anything else that interests me.
Tweets
An archive of my tweets and retweets through . They may be formatted slightly differently than on Twitter. API access has since gotten prohibitively expensive – I don't know whether or when I'll be able to update this archive.
But in case I will, you can subscribe via RSS – without a Twitter account. Rationale
- Knowledge is information that is adapted to a purpose.
- Knowledge is information with causal power.
- Knowledge is information that solves a problem.
Those are the three relationships that come to my mind.
RT @DavidDeutschOxf:
@notsurethomas @lynz_h55 @TheHalcyonSavan @PSTaylor13
Explanations never explain why they themselves are true. That wo…
First time I've seen it, but the description sounds promising.
@RealtimeAI @chrisalbon
Hahahaha omg that sounds so disgusting! 😂
Join me for a talk on artificial creativity this Sunday at 8 at Rainbow Mansion in Cupertino, CA:
The chicken's name is Ernie! I had no idea...
He's too invested now. He would probably, as most people, think it a public failure to change his mind about superintelligence.
Deeper reason: pessimism.
Haven’t read his books yet, but some of his papers I’ve read are among the worst “contributions” to the field. Complete nonsense. Will likely never come around.
@zombieinjeans
Don't know.
FWIW, definitions of knowledge I also like include "explanation" and "information that is adapted to a purpose", which latter definition includes being hard to vary.
And yes it has causal power and tends to remain physically instantiated.
Google the term "knowledge" and you'll get:
"facts, information, and skills acquired by a person through experience or education [...]"
😭😭😭
I was worried you’d say that. Will skip this one, thanks :)
@zombieinjeans @DavidDeutschOxf
Blind evolution often finds solutions in the biosphere. But knowledge in humans has the advantage that not every single explanation along the way has to work, so it has more flexibility.
Genetic pluralism may be part of the answer, too.
It doesn’t prove general relativity. Epistemological blunder.
RT @DavidDeutschOxf:
Agreed. (Disturb.) twitter.com/ZachG932/statu…
How was “A New Kind of Science”? It was recommended to me buy an AI person, but I haven’t gotten around to it yet.
@zombieinjeans @DavidDeutschOxf
I go back and forth on this. On the lowest lvl there seems to be blind evolution happening in our minds. In hindsight it looks goal oriented and purposeful, not random. So does biological evolution, though. But yes, things we have learned in the past can help with a new problem.
Got it - are you referring to the part where I invoke the hidden target function to gather return values and then reconstruct the function from those values as “explaining data”?
Got it. I think I understand what you mean by “objective”. And what do you mean by “criterion”?
What do you mean by “mismatch between criterion and current objective”? A mismatch between target function and its replica?
Yes, I think of it this way as well.
@ChristopherCode @DavidDeutschOxf
I know next to nothing about quantum operations, but the laws of epistemology should apply to function implementations on quantum computers as well.
@DavidDeutschOxf would know better.
How do they do this? Do they not implement a function of their own to imitate the other function?
It should apply to all explanations.
I’m not sure yet how to represent more complex functions such as human speech, let alone philosophical theories. But given lambda calculus’ universality, it must be possible.
FWIW functions without parameters are also explanations.
The sixth episode of the podcast on artificial creativity is out. It's another video episode, and as always, heavily inspired by @DavidDeutschOxf:
@madeofmistak3 @ghstgrllll
Not yet - thanks for the recommendation!
@madeofmistak3 @attractfunding
Can I throw “The Babadook” in the ring?
@madeofmistak3 @ghstgrllll
Mother! is unfortunately full of spaceship earth thinking, but good otherwise. I know it splits the crowd because half the movie is supposed to be annoying, but if you can ignore that, you’ll have a great time watching it.
RT @ToKTeacher:
Article summarising the prevailing intellectual view of humanity at a concentration approaching saturation. Unbounded pessi…
RT @davidarredondo:
Popper on Definitions: interesting. youtu.be/fgeMEr16yYk
Just watched it today myself. Love me some Popper.
@Azaeres @onnlucky @SerhiiHavrylov
Yes. I will get into some of that in the next episode. One thing to note is that there are always infinitely many functions that will fit the dataset perfectly. The question is how to find good, i.e. hard to vary, function implementations that match.
@RichardDawkins @center4inquiry
Nice. Add @Target for selling homeopathic eardrops I accidentally bought once thinking they were legitimate.
@Azaeres @onnlucky @SerhiiHavrylov
Ah, got it. Again, I’m hesitant to address problems of scale or performance without first knowing how the creative algorithm works. Only that knowledge would suggest performance problems. But you mentioned you had some background knowledge about this. Care to share?
@Azaeres @onnlucky @SerhiiHavrylov
That is precisely how an AGI does not learn. It’s induction again.
@Azaeres @onnlucky @SerhiiHavrylov
How do you know it will take immense resources without having a good explanation of how the program works first?
@onnlucky @Azaeres @SerhiiHavrylov
Indeed. We already know that modern day computers could run a universal creativity program. What's lacking here is neither hardware nor processing power: we lack a good explanation of how to write the program.
If resources were the problem, we would gladly wait to run it if we had a good explanation of how it works.
Bayesianism is inductivism in a cheap tuxedo. Has nothing to do with creativity. See bretthall.org/bayesian-epist… by @ToKTeacher
The problem with inductive processes is that they don’t exist.
Re intractable: I don’t know what you mean by “holistic nature”, but our minds are creative somehow, so it can’t be intractable. We just don’t yet know how.
I skimmed it. The causal approach is the right one. Also reading up on program synthesis now.
@SpaceTime_A @DavidDeutschOxf @ToKTeacher
Great question - I have no idea :)
It is creativity. And we are beginning to understand it. Baby steps :)
@ChristopherCode @dela3499 @DavidDeutschOxf
I responded in the document in purple.
@ChristopherCode @dela3499 @DavidDeutschOxf
Indeed. E.g. for objects in JS, Clojure etc one first needs an explanation of how to map keys reliably to values: a hash function. We know from lambda calculus that any such concepts can be built from pure, single parameter functions, because it is Turing complete.
Yeah, that’d be pretty neat. Being a universal explainer, the creative algorithm could do so.
@Doxosophoi
What do you mean by “epistemological facts”? Do you mean rules such as hard to vary? If so, my guess is knowledge of those rules is the result of the creative algorithm as well. If your question is how the creative algorithm creates new explanations, I haven’t covered that yet.
First time reading about this, too. First impression: Sounds like Occam’s razor applied to functions. I’m after good function implementations, which need not be the shortest. The best implementation of multiplication in this episode only happens to be the shortest, IIRC.
First time reading about Solomonoff’s inductive inference, so may be missing something. Wikipedia says it “is a theory of prediction based on logical observations”. Sounds inductive to me. Too focused on observation. No mention of knowledge creation as far as I can tell.
The podcast is now available on Apple Podcasts:
Thank you for reminding me. Episode 5 you will probably want to watch on YouTube since it heavily relies on video, but all others so far you can now listen to on Apple Podcasts as well: podcasts.apple.com/us/podcast/pod…
Today I learned that some recursive functions cannot be written in iterative form:
The fifth episode of the podcast on artificial creativity is out. This time it's a video episode. As always, heavily inspired by @DavidDeutschOxf.
@krazyander @ToKTeacher @RealtimeAI @DoqxaScott
One of the points of h2v is that you don’t even need to bother testing e2v theories.
@krazyander @ToKTeacher @RealtimeAI @DoqxaScott
You observe a conjuring trick and want to explain how it’s done. The explanation “the conjurer did something” has a lot of “evidential support” - you saw him doing something - but that’s a bad explanation b/c easy to vary. Doesn’t explain what he did and applies to any trick.
Glad to hear! Currently working on episode five, which will be about how the epistemological concepts we covered in episode four apply to computer programs and what that means. Hopefully ready to release soon!
@RealtimeAI @krazyander @ToKTeacher @DoqxaScott
You can tell an explanation is a hard to vary if you try to change parts of it and you end up diminishing its ability to fulfill its purpose. I.e. an explanation is hard to vary vis-a-vis a problem it purports to solve. Pick any theory and try changing parts; if difficult, h2v.
I guess that the flaws you mention are generally the result of irrational memes and/or bad explanations.
In order:
Not generally. A chemistry lab may blow up during an experiment or something, but that’s an exception. Extinction of ideas is fundamentally non violent.
Those may all be drivers but can be overwritten. GPPS still susceptible to irrational memes.
Thanks for listening :) It's part of the appendix of his book "Objective Knowledge": amazon.com/Objective-Know…
Got it. Yes. Two possibilities that could make you correct in the first place:
1) if creativity is solely genetic and requisite knowledge of DNA created (so indirectly caused their own understanding)
2) understanding means replication so genes “understand” themselves in a way.
I watched it on the assumption that that's the one. I can see now how extinction can be seen as a constructor of future possibilities. Still unclear about your remark re DNA/RNA.
RT @fermatslibrary:
B. F. Goodrich Company patented a Möbius strip conveyor belt. It lasts longer since the wear and tear is spread uniform…
Huh, you're right. @DavidDeutschOxf, have you changed your mind on people being universal constructors?
@EvanOLeary do you mean the video on this page? edge.org/conversation/c…
Problems also don't label ideas. If that were the case there'd be information about new knowledge already existing. That'd be induction.
BoI p. 59 "[People] are 'universal constructors'".
p. 76 a constructor is "a device capable of causing other objects to undergo transformations without undergoing any net changes itself".
A problem is a conflict between theories. It doesn't do anything.
People are constructors. I don't think problems are.
Creativity is the only thing I know of capable of creating explanations. As David says in BoI, the creative program may be part genetic, part meme.
Nervous systems on their own don't create explanations. They're just hardware
The podcast is now on YouTube as well. I plan to make a video or two that have screen recordings to show some code, so having all episodes there for context seems to make sense.
Not sure what you mean. Knowledge in DNA not explanatory. At most it explains how to spread through population at expense of rivals.
RT @PessimistsArc:
1981: "If teachers don't stand up to the growing invasion of computers in the classroom, there's a good chance literacy…
Episode 4 of the podcast on artificial creativity is out. Again, heavily inspired by @DavidDeutschOxf.
Sure, if you like. :) That’s more of a science though, since it’s falsifiable by observation.
Many scientists have the wrong PoS (empiricism, instrumentalism, positivism). That can lead them astray since there is no way to do science without PoS. But they all have one. And when they do create knowledge anyway, they’re doing something that’s the object of the study of PoS.
@WiringTheBrain @PrincetonUPress
For the wiring of our brains to shape who we are, it would need to violate the universality of computation.
I haven’t watched it yet, but in case it’s related: I explain in episode three why contributions to AGI based on neuroscience would likely need to violate the universality of computation.
The podcast is now on @Spotify... Approval on Apple podcasts still pending.