Book Review: Harry Potter and the Methods of Rationality

Harry Potter and the Methods of Rationality is a Harry Potter fanfic written by Eliezer Yudkowsky (which you can find here). Yudkowsky is the creator of LessWrong which I often use as a shorthand for the entire Rationality space. I wasn’t around at the time, but I eventually found Scott Alexander’s work at Slate Star Codex, who is linked in the sidebar and is one of the inspirations for this blog. Through SSC, I found writings by Yudkowsky, mostly about artificial intelligence. Last year I tried to read the essays known as “The Sequences” or Rationality: A-Z at LessWrong. I read the first couple of books, but they’re pretty dense and my interest dropped off.

HPMOR, unlike The Sequences, is fiction, and I found it incredibly easy to read. I assume the project began as a way to teach rationality through a common pop culture phenomenon, and it’s pretty solid at doing that. Concepts like Bayesian updating and evolutionary biology are well explained, but are done so partially as a critique of the Harry Potter universe.

The general premise is that Harry Potter’s Aunt Petunia marries an Oxford professor instead of Vernon Dursley. Thus, Harry is raised with extensive training on the scientific method by his adoptive parents, as well as the latest understanding of probability, physics, biology, chemistry, etc. He comes to Hogwarts armed with the scientific method and sets about trying to understand how magic works.

The Harry Potter universe is an excellent substrate in which to do this, because its world is so creative, popular, and complete. But J.K. Rowling’s world also has glaring problems which can be explored in ways that teach social and physical science, and even philosophy. The wizarding government apparently sends people to Azkaban where they are not only kept separate from other people (as we do in our world with regular prisons), but they are also psychologically tortured in the most horrifying way, with their good memories drained by beings of pure evil. They also apparently have no trials, as Hagrid is sent to be tortured in the second book with no oversight. Additionally, wizards have magical healing capabilities and can magically create copies of food, yet muggles in the non-wizarding world die of malaria, tuberculosis, and starvation all the time, and this is never mentioned in the original source material.

A lot of science fiction has similar problems; in The Matrix, the machines get energy from human beings’ thermal energy, but instead of just putting people in comas, they create a massively complex neural interactive computer simulation. This creates both the ranks from which their enemies recruit and uses tons of additional energy. To be sure, science fiction isn’t necessarily made worse because of these internally inconsistencies, but good science fiction should explore these ideas instead of paper over them with hand-waving.

The writing of HPMOR is delightful. A fanfic that explores Bayesian probability in the Harry Potter universe shouldn’t be this well written, but it really is. It’s creative, funny, intense, emotional, and continually pushed me to want more. The actual size of the six books in the series is gargantuan, somewhere over half a million words, or something like the first four actual Harry Potter books combined. If you read just the first “book”, I think you’ll get a general idea and know if you find it interesting yourself. I couldn’t put it down. It makes me wonder in particular about Eliezer Yudkowsky; I had previously thought of him as an AI alignment research person, so it would appear he is somewhat of a polymath who can both write incredibly amazing and addictive fan fiction and be a leading advocate/researcher for AI alignment.

The exploration of magic is the inspiration for the story, but that’s not where it stops. The plot itself is highly compelling and different enough from the actual book(s) that I wasn’t sure exactly where it was going. It also does a nice job of rebuilding the Harry Potter world in a somewhat internally consistent way after all the criticisms. Yudkowsky comes up with a lot of original ideas here that fit into the pre-existing universe really well. There are also a lot of influences from Ender’s Game, which makes a lot of sense given that is also a story of a young child genius using logic and game theory to make it through a school.

This story also makes me think about intellectual property and copyright lengths again. HPMOR is perhaps the best example I’ve ever seen of someone creating an incredible story in a world that they didn’t have IP rights to, and it makes me wonder how many more stories like this could exist if copyright lengths were shorter. Harry Potter was such a huge phenomenon that it really required the modern world to have that huge impact, like Star Wars or Marvel movies. But were copyrights to only last 30 years, we might be able to see amazing works like HPMOR used to build careers on great franchises in the public domain while those cool franchises were still relevant!

In short, I strongly recommend this fan fiction under the condition that you enjoy Harry Potter. Otherwise, a lot of setting and characters may not make sense and I’m sure all of the jokes will fall flat. Other than that, if you’re already reading this blog, you have some vague enjoyment of rationality, empiricism, systematized thinking, etc and this story is educational, creative, and addictive.

Links 2019-03-07

First links post in a while because I have some housekeeping. After trying to have comments just on reddit, I’ve realized it makes way more sense to just have comments right below the articles again. I really don’t like the WordPress default comment system so I’ve opted instead for Disqus. These have been implemented for a while, but I wanted to bring your attention to them.

I’ve also finally updated the site to default to https. Kind of an embarrassment for a site promoting encryption to not have https defaulted, but this blog is a volunteer project done for personal interest (and personal expense!).

I’ve removed Greg Mankiw’s blog from the sidebar because I realized I wasn’t reading it much anymore and it doesn’t talk about too much interesting econ stuff very often. I also removed Jeffrey Tucker’s blog beautiful anarchy, because I don’t think he posts there anymore now that he’s running aier.org.

I’ve added gwern.net because this past year I’ve realized how much more I’ve been going to his site even though I’ve known about it for a long time. Gwern is a rationalist independent researcher. He doesn’t really write blogs so much as essays on a topic. I recommend his site wholeheartedly. Seriously, his site is the first link on this post for a reason. If you are overwhelmed by the amount of content, see if anything in his “Most Popular” or “Notable” categories jump out at you and start there. I personally found “Embryo Selection For Intelligence” to be quite engrossing.

Slate Star Codex has had some good posts about the importance of OpenAI’s GPT-2. First some background on GPT-2. Next, GPT-2 seems to have learned things haphazardly, in almost a human-like way, to attain its goals of creating good responses to prompts. It connects things in a stream of consciousness reminiscent of a child’s thoughts. As Scott says, simply pattern matching at a high level is literally what humans do.

Also on AI, I found an amazing 2018 AI Alignment Literature Review and Charity Comparison by LessWrong user Larks. It’s a very impressive in depth look at groups concerned about the AI alignment problem.

From Vox: “The case that AI threatens humanity, explained in 500 words”.

Noah Smith writes A Proposal for an Alternative Green New Deal. It makes vastly more sense than the vague, progressive wishlist discussed by current Democratic members of Congress. However, even Smith’s suggestions seem pretty poorly thought out to me; he endorses massive subsidies to green technology, on the order of $30 billion a year, without addressing how the state will know where to invest the money. As I recall, the government isn’t a great central planner. He also just kind of tosses in there universal health insurance, apparently paid for by the government, which sounds like Medicare for all. That seems to both massively politically complicate anything actually trying to fix climate change, and also destroy the entire federal budget, which I think is a national security problem.

Related, on a more nuanced note, John Cochrane discusses a letter signed by many economists endorsing a carbon tax, which seems much more precise and useful to people concerned about climate change. To make it politically palatable, they suggest making a carbon dividend paid to all taxpayers out of this tax. Noah Smith also endorsed this approach as just one piece of his Green New Deal. On brand, The Economist endorses carbon taxes as well.

Bitcoin Hivemind developer Paul Sztorc writes about Bitcoin’s future security budget. It’s a really good technical discussion of how Bitcoin can be funded in the future, and why we need sidechains to help pay for the cost of keeping Bitcoin secure.

Bruce Schneier writes about the need for Public Interest Cybersecurity, envisioning it as a parallel to public interest legal work. It’s an interesting take, and I’m not sure how I feel about it. On the one hand, he’s right that lawmakers know little about the technologies they are supposed to regulated, but that’s also true of literally every industry. Sure it would be great if we had more things like the EFF, but I’m have to ask 80,000 Hours if they thought people going into charity work should work for the EFF or AI Alignment research or other existential risk. I’m also not sure I agree that there aren’t enough incentives to invent new security protocols. Google is taking security very seriously on their own, but so are tons of Bitcoin and cryptocurrency developers who are constantly seeking ways to make their projects more secure and do more creative things with crypto.

The U.S. trade deficit hit a 10 year high. Here is the actual Bloomberg article. This is silly political bickering, so I won’t spend much time on it, but it reflects just how the president fails to grasp very simple economics. The trade deficit doesn’t mean anything by itself, it’s just a measure of the goods traded, and it’s not even very good at that (goods designed here but manufactured in another country see their whole value “subtracted” in the trade deficit despite American labor inputs). The drivers of the trade deficit are things like relative values of currencies and national savings rates, not the levels of tariffs. Meanwhile, Trump’s tax cuts have spurred U.S. growth while the rest of the world has been sluggish, leading to higher trade deficits because Americans are relatively more wealthy. This flurry of economic activity prompted the Fed to raise rates to stave off inflation, which also drives up the trade deficit, and so Trump has taken the horrible tact of trying to publicly attack the Fed to lower rates, which is terrible for any sort of responsible Fed policy. The whole thing is a ridiculous mess which could have been avoided if Trump had any semblance of economic knowledge.

The Fifth Column podcast is a highly entertaining libertarian politics podcast. Episode 132 is a little different as Michael Moynihan takes the opportunity to interview Mark Weisbrot, Co-Director of the Center for Economic and Policy Research, a left-wing think tank, on the Maduro government in Venezuela. I have a lot of thoughts on this interview, but my foremost is whether Weisbrot counts as an actual representative voice of the Left. I think one of the worst things social media does is to hold up the most controversial person on one side because they generate the most clicks and buzz and force both sides to jump in and flame each other. In an hour long interview, Weisbrot takes, as far as I can tell, no opportunity to criticize the Maduro regime, nor offers any way in which they could have improved their policies. He accepts and touts statistics that support his view, and dismisses, minimizes, or ignores stats that counter him–even if they are all from the same source! Even though he’s a big deal at a left-wing think tank, I have to point out that most left-leaning academics don’t need to be in think tanks because most university politics skew left. This might explain how someone with this level of willful ignoranceg could hold such a key position. I think the interview is worth listening to if you would like to see the extent of what humans can do to put up mental barriers to seeing their own logical inconsistencies and motivated reasoning. Nonetheless, I feel bad about linking to this interview as I think it unfairly represents actual socialists who would like to nationalize all industries and seize the means of production.

2019 Predictions

I’ve made predictions for the past several years, and here are my predictions for 2019, a bit late. I’ve noticed that when discussing politics or difficult subjects with other people with whom I have strong differences, a possible avenue of understanding is to make a prediction about the world with odds. Most people don’t accept these bets or predictions, which I think are one of the best ways to test different models of the world against each other. Nonetheless, I think it’s personally beneficial to list predictions and accompanying odds each year to see test my model of the world.

  1. Trump Approval Rating end of year <50% (Gallup): 95%
  2. Trump Approval Rating end of year <45% (Gallup): 90%
  3. Trump Approval Rating end of year < 40% (Gallup): 70%
  4. US will not get involved in any new major war with death toll of > 100 US soldiers: 60%
  5. No single terrorist attack in the USA will kill > 100 people: 95%
  6. The UK will not leave the EU this year: 80%
  7. North Korea will still be controlled by the Kim dynasty: 95%
  8. North Korea will not conduct a nuclear test this year: 60%
  9. North Korea will not conduct a missile test this year: 60%
  10. North Korea will not agree to give up nuclear weapons entirely, contingent on US troops staying in the Korean peninsula: 99%.
  11. North Korea will not agree to give up nuclear weapons as a result of any negotiations: 90%
  12. Yemeni civil war will still be happening: 70%
  13. S&P 500 2019 >10% growth (from 2506 on Jan 1): 60%
  14. S&P 500 will be between 2400 and 3100: 80% (80% confidence interval)
  15. Unemployment rate December 2019 < 6%: 80%
  16. Unemployment rate December 2019 < 5%: 70%
  17. WTI Crude Oil price up by 10% (from $45.41): 70%
  18. Price of Bitcoin in dollars up over the year (Coinbase – 3823 Jan 1): 70%
  19. Price of Bitcoin < $8,000 (does not double): 60%
  20. Price of Bitcoin > $1900 (does not lose half value): 70%
  21. Price of Bitcoin < $12,000 (does not triple): 70%
  22. Drivechain opcodes not soft-forked into Bitcoin: 80%
  23. No drivechains soft-forked into existence: 99%
  24. US government does not make Bitcoin ownership or exchange illegal: 95%
  25. Self-driving cars will not be available this year for general purchase: 95%
  26. Self-driving cars will not be available this year to purchase / legally operate for < $100k: 99%
  27. I will not be able to buy trips on self-driving cars from Uber/Lyft/Waymo in a location I am living: 95%
  28. I will not be able to order groceries on self-driving cars in a location I am living: 90%
  29. I will not be able to buy a trip on a self-driving car from Uber/Lyft/Waymo without a backup employee in the car anywhere in the US: 80%
  30. The artificial general intelligence alignment problem will not be seen as the most important problem facing humanity: 99%
  31. Humans will not be in lunar orbit in 2018: 99%
  32. SpaceX Falcon Heavy rocket will launch again this year: 90%
  33. SpaceX will bring humans to low earth orbit: 60%
  34. SpaceX will test the “Starship” mock up this year: 70%
  35. Mexican government does not pay for wall: 99% (lol)
  36. Border wall construction not complete by end of 2018: 99%
  37. National Debt increases by >$1 trillion (from
    $21,943,897,000,000): 90%
  38. There will not be a significant decrease in trade barriers between US and China from pre-2017 tariff levels: 90%
  39. Democratic RCP front runner will not be Bernie Sanders: 80%
  40. Democratic RCP front runner will not be Kamala Harris: 80%
  41. Democratic RCP front runner will not be Beto O’Rourke: 80%
  42. Trump not removed from office or resign: 95%
  43. Trump not impeached: 70%
  44. No CRISPR edited babies will be born: 80%
  45. No full year US government budget will be passed (only several months spending): 90%
  46. Some tariffs raised: 90%
  47. Trump administration does not file a lawsuit against any news organization for defamation: 90%

I’d like to comment on every prediction, but I’m afraid it would take too much time. The predictions I find most interesting are whether the UK will leave the EU. I’m going by what predictions markets say, but I’m not really sure it will play out with only a few weeks to go and no deal. I’m also quite interested in the Democratic Presidential primary race, but I’m afraid the nomination will be trending towards someone pretty left wing. I’m also interested in whether Trump will be removed from office. I put the chances of Trump being impeached at 30% to stay in line with prediction markets, but my gut is that I should put that chance even lower.