Knowledge work and stable intermediate structures

There’s a story of the two watchmakers that Herbert Simon tells in The Sciences of the Artificial to illustrate the relevance of intermediate structure and hierarchy. Here’s the story

There once were two watchmakers, named Hora and Tempus, who made very fine watches. The phones in their workshops rang frequently and new customers were constantly calling them. However, Hora prospered while Tempus became poorer and poorer. In the end, Tempus lost his shop. What was the reason behind this?

The watches consisted of about 1000 parts each. The watches that Tempus made were designed such that, when he had to put down a partly assembled watch, it immediately fell into pieces and had to be reassembled from the basic elements. Hora had designed his watches so that he could put together sub-assemblies of about ten components each, and each sub-assembly could be put down without falling apart. Ten of these subassemblies could be put together to make a larger sub-assembly, and ten of the larger sub-assemblies constituted the whole watch

Simon uses the story to illustrate why structure and hierarchy emerge in complex systems. Or why good designers build  intermediate structure into their systems.

One interesting aspect of this fable is that Simon talks of two levels of intermediate structure. This suggests that there are criteria to invoke when making design choices about the size and complexity of intermediate structures.

I’ve been thinking about intermediate structure lately in the context of how to be more effective in doing knowledge work. I’ve touched on working papers recently and I wanted to revisit the topic from the perspective of stability and intermediate structures.

I’ve been blogging for a long time and writing at multiple lengths–blog posts, teaching cases, articles, books. I use or have used all sorts of tools in the process

  • mindmaps (both by hand and by software),
  • outlines (again, both by hand and by software)
  • word processors
  • text editors
  • bibliographic/reference management software
  • wiki software
  • specialized note taking tools (Evernote, nvAlt, etc.)

The space between glimmer of an idea and finished product is what draws my attention now. Although I’ve been nibbling around the ideas of working papers, most of what I’ve discovered and examined has talked about writing process. Freewriting, shitty first drafts, mindmapping techniques. What’s starting to come into view is the structure side of the question.

For the longest time, I’ve worked and thought in terms of deliverables and working backwards from some vision of an end product. That works well enough for blog posts and most client reports. At the longer scales of a book, on the other hand, working backwards breaks down. You know that the outlines and mindmaps are  necessary but they morph as the process unfolds and as your understanding of the deliverable evolves.

The notion of a permanent and evolving collection of notes and treating those notes as “first class objects” that should be designed to stand on their own is a new to me. When I started blogging the idea of a commonplace book was one idea for an organizing container for developing ideas and lines of thinking. Jerry Weinberg’s Weinberg on Writing: The Fieldstone Method is an approach that I’ve worked to understand and adopt. I’ve certainly recommended it to many colleagues. More recently, Sonke Ahrens’s How to Take Smart Notes: One Simple Technique to Boost Writing,  Learning and Thinking drew me into the subculture of Zettelkasten.

All of these new ideas still focused mostly on process advice. They fell short on offering insight into the structure of the data and information that you created through the processes. They slide past the data half of the equation and I’m only know coming to see how that has been holding me back.

A collection of permanent notes is a handy thing to have around. But, without attention to intervening stable structures we are still fighting the problem of building a 1,000 piece watch in a single step.

There are some hints scattered in what I’ve found so far. The Zettelkasten sub-culture references the notion of special forms of structure notes, for example. In my own work. I’ve started to recognize the emergence of recurring themes and am trying to develop techniques to capture and track them.

I feel I am at the stage of recognizing that there’s a problem to be addressed. I can see the gap between a collection of random notes and the organized flow of a final deliverable. Now I’m looking to design or discover stable structures that can serve as waypoints where I can pause before I have worked out what the final deliverables might be. Is this a problem that others have also encountered? Are there concepts and structures I can learn and adapt?

4 thoughts on “Knowledge work and stable intermediate structures”

  1. I found simple collection notes to be useful as a buffer: when I write about a programming topic, I add the note to 1+ relevant lists which may evolve into outlines for longer texts. Some of these notes become blog posts directly. But this makes them much more recycle-able. Instead of needing to find this new note 3 years from now, I prepare my future self for finding it by putting a link to it into collections, outlines, or more general: structure notes.

    Since these lists can be recombined, I though of them as I read your watchmaker example. There are a couple of forms I recognize in my field that lend themselves well for collections: like the form of a Design Pattern. Maybe you can recognize similar repeating forms?

  2. Thanks – these are exactly the things I am starting to look for. The basic Zettelkasten concept is a huge conceptual leap but the initial focus on notes and the mini-case studies of Zettelkasten in use make the other data structures less apparent.

    One of the triggers for this was seeing a copy of Wirth’s classic “Algorithms + Data Strucutures = Programs” on my shelf. It made me think that we’ve been a bit too focused on the algorithms without looking enough at the data structures.

  3. Please share your discoveries! I find note patterns or forma super interesting.

    With all this in mind, a recent blog post link from my RSS feeds pointed me to a list of blog post templates that made me pause.

    If notes are supposed to be as self-contained and readable as blog post, would templates for blogs be helpful in figuring out the intent of a note?

    It’s a paid product, but such lists can be found online. For reference, this sparked the idea:

  4. I agree with you. And think that I have good idea why this is:

    Very few people are familiar with the nature of knowledge itself. So, how could they know on how to create those structures. There are layers and types that are guiding the Zettelkasten Method as I define it. And — in my opinion — they are easy to comprehend for a layman (non-mathematician, non-philosopher etc.)

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.