Welcome to my November 2024 newsletter, this newsletter marks my 16th issue. 16 is a low power of two which saw it used in weighing light objects in several cultures. For instance in the British Imperial system of weights 16 ounces were in one pound. This lived on far longer with British drug dealers who looked to sell cannabis in ‘teenths’ (16ths) or eighths of an ounce. Prior to decimal being implemented in China 16 taels or liǎng equalled one catty or jin. Chinese Taoists counted on their finger times and joints of the fingers with a the tip of the thumb, so 16 can be counted on each hand.
The highlight of November was meeting up for brunch with Calvin who I used to work with in Hong Kong and collaborate with on occasion for projects going in-or-out of China. He was passing through London on his way to Web Congress in Lisbon, supporting one of the burgeoning number of start-ups coming out of Shanghai.
New reader?
If this is the first newsletter, welcome! You can find my regular writings here and more about me here.
Things I’ve written.
Ghost Signs – how legacy signage allows us to peer back into history, camcorders having their ‘lomography’ moment and much more.
Layers of the future – or how innovation doesn’t exist in a fully-formed world, but instead exists within layers of progress over time.
Presidential election beliefs – amongst the autopsies of the campaign that have been discussed, one of the things that struck me was the role of presidential election beliefs that have wrong-footed analysis
Klad & more stuff – a Russian pioneered integration of dark web markets and concealed ‘Amazon locker’ type infrastructure to deliver a new approach to drug dealing. Other items include bottlenecks in gadget manufacturing, internet maturity and more.
Books that I have read.
Dead Calm by Charles Williams – the early 1960s crime novel packs a lot into the story. Trauma, mental illness, murder and intrigue on the high seas. Dead Calm was later made into a film and relocated from the Indian Ocean to the Pacific Ocean.
Jipi and the paranoid chip by Neal Stephenson. A short story that fits into the Cryptonomicon universe of Stephenson’s books – shares the story of Jipi a former flight attendant who works for Mindshare Management Associates Inc. – an agency that distracts tourists to Manila from the rapid construction work taking place during a China-like economic miracle. Because of her personality, Jipi has to track down errant AI powered car alarms fitted with plastic explosives that were designed to deter thieves, but AI happened. If you’ve ever had to write prompts, you’ll likely appreciate it.
Things I have been inspired by.
The fame game
Irish rally driver Rosemary Smith, had the skills but never did get the fame. Smith even got behind the wheel of a Renault formula 1 car to get a test drive at 79 years of age.
I am by no means a sports addict but even in my psyche I know the names and reputations of several famous sports stars across hurling, gaelic football, motorsports rugby league and even soccer. Sid Lee and Appino have raised the issue of how this fame gap is bridged in women’s sports drive into long term mainstream success. Where is the women’s sport equivalent of Stig Blomqvist, Arnold Palmer or Michael Jordan who are hailed in a similar way? Want to know more, reach out to Rory Natkiel.
Yes, Christmas really is getting earlier
My local supermarket started to sell mince pies right after the August bank holiday this year. It had Christmas decorations for sale before the Halloween ones. Christmas seems to be coming earlier this year. The Guardian researched how Christmas was arriving earlier each year, from charting music to mince pies and Christmas puddings going on sale. This year lo-fi girl had their first Christmas soundtrack up on November 4th. If you want a change from the Spotify Christmas list, try this old mix from former streetwear boutique The Hideout.
WARC noted how companies like John Lewis with dedicated Christmas campaigns look to gain a first-mover advantage to aid the talkability around their campaign and gain the full benefit from their emotion driven campaign bedding in and building new memory structures.
WARC predicted that Christmas advertising spend would rise 7.8% to over £10.5 billion. Big growth for search, online display and out of home compared to last year. The biggest losers including TV, direct mail, magazine and print news media.
Things I have watched.
Famous Hong Kong cinema film director Johnnie To criticised Hong Kong’s national security regulation in an interview for the BBC’s Chinese language service. With that in mind, I thought it prudent to buy up as much of his back catalogue as possible because the classics amongst them may be harder to get hold of in the future.
PTU – PTU starts in a similar way to Akira Kurosawa’s Stray Dog with a policeman losing their duty weapon. However that’s where the parallels finish. In Stray Dog the young detective looking for his gun feel empathy at the end with the criminal who used his weapon. The moral being two-fold – crime starts with a few wrong choices, but are still human. In order to deliver law, over time the policeman needs to become less empathetic, losing a bit of their humanity. PTU on the other hand shows how police blurred the line between the law and crime with extra-legal methods to solve crime. It also highlights the complex relationships between criminal gangs and the police. To keeps the tension going with PTU throughout the film. The ambiguity between police and criminals would not be allowed in future Hong Kong films thanks to the National Security laws that have come into force.
Election – The literal Cantonese title for this film is ‘Black Society’ – which as a term covers all kinds of organised crime groups. Two members of the Wo Lin Shing are up for election become leader (aka chairman or dragonhead) of the organised crime group. It’s a common trope in Hong Kong cinema that these elections happen on a regular basis. Wo Lin Shing is a stand-in name of the very real Wo Shing Wo – a group that have a side hustle doing wet work for the Beijing forces at work in the city.
The film focuses on the election and immediate fallout. Lok runs a more rational campaign, whereas Big-D runs a showy campaign offering money for votes. The elders appoint Lok and Big-D tries to steal the symbol of power. To moves the tension and action on at a rate of knots. It features many of the heavyweights of Hong Kong cinema including Simon Lam, Louis Koo, ‘Big’ Tony Leung, former policeman Nick Cheung and Lam Suet.
Not a Johnnie To production, but I have been enjoying Detective Chinatown on Amazon Prime. The show is similar to the BBC show Sherlock and CSI in the way its plot devices and how its story arcs work. It has been interesting to watch for a number of reasons. The series was produced for Chinese streaming platform iQiyi – think Chinese Netflix. The series is based in Bangkok, Thailand. The senior Thai police representative is portrayed as dramatic, volatile and religious in nature – interesting stereotyping by the Chinese production team. The plot line has a very supernatural aspect to it, which is generally considered to be a no-no with Chinese censors. I am curious to see where they take the show.
Useful tools.
Mac keyboard shortcuts
Alongside David Pogue’s Missing Manual series of reference books for each version of macOS, MacMost’s videos are a great resource for the Mac user. MacMost now have a free downloadable table of Mac keyboard shortcuts.
AI-powered diagram creation
Ever sat in front of a blank Keynote or PowerPoint slide and wondered how to represent something? I am across the Napkin AI which takes your written text describing something and renders it into a diagram. I don’t use these diagrams as the finished product, but as an inspiration for me then to artwork together in Keynote, OmniGraffle or PowerPoint. You can output from Napkin AI as a PNG file. At the moment it’s free to use as a beta product.
Woznim
Woznim allows you to record the names of people and where you met them to try and aid in recall of of them if you run into them again. It reminds me of Foursquare and social bookmarking. Foursquare because of its where 2.0 location based data and social bookmarking because if you develop the Woznim habit it could be life-changing, but if it doesn’t gel with you it’ll be dropped as a service in no time. At the moment it’s an iPhone-only app.
Bluesky
Bluesky has been having a moment as another tranche of social media users follow The Guardian’s lead to leave Twitter and need a micro-blogging service. Bluesky has got a good deal of attention because of its starter packs and list features. Whether Bluesky will continue to grow into a vibrant post-Twitter place isn’t certain yet. But if you are going to use Bluesky then these two tools might help:
Bluesky tools directory. There is a surprisingly rich set of tools available rather like ‘golden age’ era Twitter.
Starter packs. Starter packs are a set of curated recommended accounts to follow based around interests. This site has a large directory of them covering everything from professional interests to sports passions.
The sales pitch.
I am now taking bookings for strategic engagements from January 2025 onwards; or discussions on permanent roles. Contact me here.
Ok this is the end of my November 2024 newsletter, I hope to see you all back here again in a month. Be excellent to each other and onward into the Christmas season and the rush to complete projects before clients disappear on holiday.
I discovered something at the end of last year. The belatedly missed Yahoo Pipes was, in fact, officially called “Pipes by Yahoo.” I made that mistake, despite being well-versed in the brand guidelines, having spent a year working there with a copy consistently at my side.
Now, why this journey down the memory superhighway? That’s a valid question. The inspiration for this post came from Bradley Horowitz’s initial post on Threads. (I had to go back and re-edit the reference to post from tweet to include it in the previous sentence, force of habit). In his post, Bradley shared the history of Pipes by Yahoo. I’m acquainted with Bradley from my time at Yahoo!. During that period, he was one of the senior executives in Jeff Weiner’s Yahoo! Search and Marketplace team.
Consider this article as complementary to the Pipes by Yahoo history that Bradley pointed out. I will share the link where it makes sense to go over and read it in my depth. My commentary provides context prior to Pipes by Yahoo launching, the impact it had and why it’s pertinent now.
Origins
To comprehend Pipes by Yahoo, a fair amount of scene-setting is necessary. The contemporary web experience is now a world apart from the open web of Pipes, just as Pipes was distant from the pre-web days of the early 1990s.
Boom to bust
During the mid-1990s through the dot-com bust, Yahoo! generated substantial revenue from various sources, with online display advertising being the most pivotal. Launching a blockbuster film from the late 1990s to the early 2010s often involved a page takeover on Yahoo! and featuring the trailer on the Yahoo! Movies channel and Apple’s QuickTime.com. A similar approach applied to major FMCG marketing campaigns, with large display advertising initiatives.
Yahoo! profited significantly during this period, as the internet was the new trend, and display advertising was a cornerstone for brand building. Money was spent generously, akin to contemporary budgets for influencer marketing programmes.
Yahoo! occupied a space between TV, magazine advertising, and newspaper advertising. The design of the My Yahoo! page mirrored the multi-column layout of a traditional newspaper.
Similar to a newspaper, Yahoo! developed various departments and services:
Search
News (including finance)
Music services
Shopping, featuring a store for small businesses, auctions, and a shopping mall-type offering
Sports
Communications (email, instant messaging, voice calls, early video calling)
Web hosting
Then came the dot-com crash. Advertising revenue plummeted by around a third to 40 percent, depending on who you ask. Deals like the acquisition of Broadcast.com shifted from appearing speculative and experimental to extravagant wastes of money as the bust unfolded. This experience left scars on the organization, restraining the size of deals and the scope of ambition. Opportunities were second and third-guessed.
Yahoo! Europe narrowly survived, thanks to a white-label dating product. Love proved to be a more dependable revenue source than display advertising. A new CEO from the media industry was appointed to address shareholder and advertiser concerns.
The advertising industry was in a constant state of learning. Performance marketing emerged as a significant trend, and search advertising gained prominence.
The initial cast in this story
Weiner was hired into Yahoo! by then CEO Terry Semel. Semel knew Weiner from his work getting Warner Brothers into the online space.
Yahoo! had started getting serious about search by acquiring a number of search technology companies and hiring talented people in the field. Bradley Horowitz had found an image and video search startup called Virage and joined Yahoo! (a year before I got there) as director of media search.
There was former Overture executive Tim Mayer who was VP of search products and drove an initiative to blow out Yahoo!’s search index as part of a feature and quality battle with Google, Bing and Ask Jeeves. It was a great product, but with the best effort in the world we didn’t have the heat. The majority of Yahoos internally used Google because of muscle memory.
Vish Makhijani was ex-Inktomi and was VP – international search and has more of a focus on operations. He worked on getting non-US Yahoo! users feature parity – at least in search products.
Former Netscaper, Eckhart Walther was the VP in charge of product management.
Aside: where did Ged sit?
Where did I sit? Low on the totem pole. To understand my position in the organisation, imagine a Venn diagram with two interlocking circles: the European central marketing team and Vish’s team. I would have sat in the interlocking bit. If that all sounds confusing, yes it was.
Search wars and web 2.0
Pipes by Yahoo emerged from the confluence of two technological trends that developed in parallel, extending all the way to early social media platforms.
Search wars
I had been discussing the prospect of working at Yahoo! with a couple of people since around 2003. I had an online and technology brand and product marketing background. I had been blogging regularly since late 2002 / early 2003 and managed to incorporate online reviews and forum seeding into campaigns for the likes of Aljazeera and BT. The business was emerging from survival mode. As an outsider, it wasn’t immediately apparent how precarious Yahoo!’s situation had been. However, the threat posed by Google was undeniable.
At that time, Google didn’t have the extensive workforce it boasts today. One of my friends served as their PR person for Europe. Nevertheless, Google had embedded itself into the zeitgeist, seemingly launching a new product or feature every week. If there wasn’t a new product, stories would sometimes ‘write themselves,’ such as the time the face of Jesus was supposedly found on Google Maps photography of Peruvian sand dunes. The closest contemporary comparison might be the cultural impact of TikTok.
The geographical impact of Google’s cultural dominance was uneven. In the US, Yahoo! was a beloved brand that many netizens were accustomed to using. Yahoo! held double the market share in search there compared to Europe. Part of this discrepancy was due to Europeans coming online a bit later and immediately discovering Google. But Google didn’t do that well with non-Roman derived European languages like Czech. It has similar problems with symbolic languages like Korean, Chinese and Japanese.
Google explosion
I can vividly remember the first time I used Google. At that time I was using a hodge podge of search engines, usually starting with AltaVista and then trying others if I didn’t get what I wanted. This was before tabbed browsers were a thing, so you can imagine how involved the process became.
Google appeared in an online article, which I think was on Hotwired some time during late 1998, less than a year after it had been founded. I clicked on a link to use the search engine. Google looked every different to now. It had a clean page with three boxes beneath. The first one was a few special searches, I think one of them was Linux-related, which tells you a lot about the audience at the time. The second was set of corporate links including a link explaining why you would want to use Google – although experiencing one search was enough for most people that I knew. The final box was to sign up to a monthly newsletter that would give updates on what developments Google was up to.
From then on, I very rarely searched on Alta Vista, though my home page was still My Excite for a long time. This was more because I had my clients news set up on the page already and they had decent finance overage at the time.
The difference in searches was really profound, there were a number of factors at work:
Google’s approach seemed to give consistently better results than the vectored approach taken by Excite or AltaVista.
There was no advertising on the SERP (search engine results page), but that was to soon change.
You could use very directed Boolean search strings, which isn’t possible any more since Google optimised for mobile.
Search engine optimisation wasn’t a thing yet.
The web while seeming vast at the time, was actually small compared to its size now. Web culture at the time was quirky and in aggregate nicer and more useful than it is now. Part of this was was down to the fact that early web had a good deal of 1960s counterculture about it. Wired magazine would write about the latest tech thing and also profile psychedelic experimenters like Alexander Shulgin. Cyberpunk, rave and psychedelic tribes blended and found a place online. You can see the carcass of this today with Silicon Valley’s continued love of Burning Man. (Note: there were rich dark seams if that was the kind of thing you were into. There wasn’t the same degree of social agglomeration that we now have, nor were there algorithms that needed constant new content to feed diverse realities.)
Content creation on the web was harder than it is now. Blogging was at best a marginal interest, the likes of Angelfire, AOL Hometown, Geocities and Tripod provided free hosting, but you couldn’t put up that much content to pollute the search index even if you wanted to.
The impact was instantaneous and by early 1999, it was much a part of the nascent netizen culture as Terence McKenna.
McKenna spent the last bit of his life interrogating the search engine for four to five hours a day. He was convinced that the online world it provided access to represented some sort of global mind.
Sometimes he treats the Net like a crystal ball, entering strange phrases into Google’s search field just to see what comes up. “Without sounding too cliché, the Internet really is the birth of some kind of global mind,” says McKenna. “That’s what a god is. Somebody who knows more than you do about whatever you’re dealing with.”
As our society weaves itself ever more deeply into this colossal thinking machine, McKenna worries that we’ll lose our grasp on the tiller. That’s where psychedelics come in. “I don’t think human beings can keep up with what they’ve set loose unless they augment themselves, chemically, mechanically, or otherwise,” he says. “You can think of psychedelics as enzymes or catalysts for the production of mental structure – without them you can’t understand what you are putting in place. Who would want to do machine architecture or write software without taking psychedelics at some point in the design process?”
A year after that McKenna interview, Google was running over 5,000 Linux servers to power the search engine.
At first, Google also powered search on some of the web portals and saw itself as a competitor to search appliance businesses like Inktomi and Autonomy. The advertising kaiju started operation in 2000 and it was tiny. This violated patents held by GoTo.com – a business subsequently acquired by Yahoo!.
Post-bust
Once Yahoo! had disentangled itself from the carnage of the dot com bust, search was a much bigger deal. And Google had become a behemoth in the space of a few years. In 2002, Google launched Google News – a direct challenge to web portals like Yahoo!, MSN and Excite. Around about this time Google started to be used as a verb for using a web search engine.
While display advertising had taken a dive, search advertising had took off for several reasons:
It was performance marketing, even when a business is just surviving sales are important
Behavioural intent – if you were searching for something you were likely interested in it and may even purchase it
So easy to do at a basic level, even small and medium sized businesses could do it
Advertising dashboard – Google did a good job at helping marketers show where the advertising spend had gone.
We’ll ignore on the difficult facts for the time being, for instance:
The role of brand building versus brand activating media
What attribution might actually look like
That Google advertising is a rentier tax, rather than a business generator
Google listed on the stock market in August 2004. Investors ignored governance red flags like the dual share structure so the founders could retain voting rights.
Yahoo! in the search wars
Yahoo! had come out of the dot com bust battered but largely intact. Yahoo! was scarred in a few important ways.
Identity crisis
Yahoo! came about pre-Judge Jackson trial when Microsoft spread terror and fear into the boardroom of most sensible technology companies. I know that sounds weird in our iPhone and Android world. Rather than the bright cuddly people who give us Xbox, it was a rabid rentier with a penchant for tactics that organised crime bosses would have approved of. It took a long time to work that out of their system.
Another big factor was the fear of Microsoft. If anyone at Yahoo considered the idea that they should be a technology company, the next thought would have been that Microsoft would crush them.
It’s hard for anyone much younger than me to understand the fear Microsoft still inspired in 1995. Imagine a company with several times the power Google has now, but way meaner. It was perfectly reasonable to be afraid of them. Yahoo watched them crush the first hot Internet company, Netscape. It was reasonable to worry that if they tried to be the next Netscape, they’d suffer the same fate. How were they to know that Netscape would turn out to be Microsoft’s last victim?
Paul Taylor – ex Yahoo and founder of Y-Combinator
Yet Yahoo! went on to hire media mogul Terry Semel as it went through the dot com bust, shows that this thinking must have coloured views somewhat.
Cheque book shy
Even Mark Cuban would admit that Broadcast.com was not worth the billion dollar price tag that Yahoo! paid for it. It was a high profile mistake at the wrong point in the economic cycle which haunted Yahoo! acquisition plans for years. Which is one of the reasons why may have Yahoo! dropped the ball when it had the chance to buy Google and Facebook.
The game has changed
But the game had changed. Display advertising was no longer as profitable as it had been. Search advertising was the new hotness, fuelled by online commerce. By early 2004, Yahoo! is confident enough in its own search offering to drop Google who had been providing its search function.
Yahoo! acquired search appliance business Inktomi in 2002 and then Overture Services in 2003. Overture services provides the basic ad buying experience for Yahoo! search advertising.
In 2004, Yahoo! realises having search is not enough, you have to offer at least as good as product as Google, if not better. This is where Tim Mayer comes in and for the next couple of years he leads a project to build and maintain search parity with Google.
You had a corresponding project on the search advertising side to bring the Overture buying experience up to par with Google with a large team of engineers. That became a veritable saga in its own right and the project name ‘Panama‘ became widely known in the online advertising industry before the service launched.
Search differently
Googling is a habit. In order to illicit behavioural change you would have to
Have an alternative
Change what it means to search in a positive way
Yahoo! approached this from two directions:
Allowing different kinds of information to be searched, notably tacit knowledge. I worked on the global launch of what was to become Yahoo! Answers, that was in turn influenced by Asian services notably Naver Knowledge IN. This approach was championed internally by Jerry Yang.
Getting better contextual data to improve search quality providing a more semantic web. This would be done by labels or tags. In bookmarking services they allowed for a folksonomy to be created. In photographs it provided information about what the pictures or video content might be, style or genres, age, location or who might be in them.
Web 2.0
Alongside a search war there was a dramatic change happening in the underpinnings of the web and how it was created. While the dot com bust caused turmoil, it also let loose a stream of creativity:
Office space was reasonably priced in San Francisco only a couple of years after startups and interactive agencies had refurbished former industrial buildings South of Market Street (SoMo).
Office furniture was cheap, there was a surplus of Herman Miller Aeron chairs and assorted desks floating around due to bankruptcies and lay-offs.
IT and networking equipment was available at very reasonable prices on the second hand market for similar reasons. You could buy top of the range Cisco Catalyst routers and Sun Microsystems servers for pennies on the dollar that their former owners had paid for them less than one computing generation before. This surplus of supplies be bought online from eBay or GoIndustry.com.
Just in time for the internet boom wi-fi had started to be adopted in computers. The first wi-fi enabled laptop was the Apple iBook. Soon it became ubiquitous. Co-working spaces and coffee shops started to provide wi-fi access connected to nascent mainstream broadband. Which meant that your neighbourhood coffee shop could be a workspace, a meeting space and a place to collaborate. We take this for granted now, but it was only really in the past 25 years that it became a thing. It also didn’t do Apple’s laptop sales any harm either.
Open source software and standards gave developers the building blocks to build something online at relatively little financial cost. Newspapers like the Financial Times would have spent 100,000s of pounds on software licences to launch the paper online. In 2003, WordPress was released as open source software.
Amazon launched its web services platform that allowed developers a more flexible way for putting a product online.
The corresponding telecoms bust provided access to cheaper bandwidth and data centre capacity.
All of these factors also changed the way people wrote services. They used web APIs building new things, rather than digital versions of offline media. APIs were made increasingly accessible for a few reasons:
Adoption of services was increased if useful stuff was built on top of them. Flickr and Twitter were just two services that benefited from third party applications, integrations and mashups. Mashups were two or more services put together to make something larger than the ingredients. The integration process would be much faster than building something from scratch. It worked well when you wanted to visualise or aggregate inputs together.
Having a core API set allowed a service to quickly build out new things based on common plumbing. Flickr’s APIs were as much for internal development as external development. Another example was the Yahoo! UK’s local search product combining business directory data, location data and mapping.
There was also a mindset shift, you had more real-world conferences facilitating the rapid exchange of ideas, alongside an explosion of technical book publishing. One of the most important nodes in this shift was Tim O’Reilly and business O’Reilly Publishing. Given O’Reilly’s ringside seat to what was happening, he got to name this all web 2.0.
Finally, a lot of the people driving web 2.0 from a technological point of view were seasoned netizens who had been exposed to early web values. The following cohort of founders like Mark Zuckerberg were more yuppie-like in their cultural outlook, as were many of the suits in the online business like Steve Case or Terry Semel. But the suits weren’t jacked into the innovation stream in the way that Zuckerberg and his peers – but that would come later.
This was the zeitgeist that begat Pipes by Yahoo.
The approach to a new type of search needed the foundational skills of web 2.0 and its ‘web of data’ approach. Yahoo! acquired number of companies including Flickr, Upcoming.org and Delicious. At the time developers and engineers were looking to join Yahoo! because they liked what they saw at Flickr, even though the photo service was only a small part of the roles at the business.
Web 2.0 talent
The kind of people who were building new services over APIs were usually more comfortable in a scrappy start-up than the large corporate enterprise that Yahoo! had become. Yet these were the same people that Yahoo! needed to hire to develop new products across knowledge search, social and new services.
There were some exceptions to this, for instance the 26-person team at Whereonearth who operated a global geocoded database and related technology had a number of clients in the insurance sector and Hutchison Telecom prior to being acquired by Yahoo!. The reason why Yahoo! became so interested was a specific Whereonearth product called Location Probability Query Analyser. The technology went on to help both the Panama advertising project and Yahoo! search efforts. George Hadjigeorgiou was tasked with helping them get on board.
I knew some of the first Flickr staff based out of London, they sat alongside technologist Tom Coates who would later work on FireEagle. They all sat in a windowless meeting room on a floor below the European marketing team sat in.
Most people didn’t even know that they were there, working away thinking about thinks like geotagging – a key consideration in where 2.0 services and mobile search.
Going over to the Yahoo! campus in Sunnyvale made it clear to me that the difference in cultural styles was equally different over there, from just one cigarette break with Stewart Butterfield of Flickr.
Secondly, there was the locale. The best way I found to help British and Irish people get the environment of Silicon Valley was to describe it as a more expansive version of Milton Keynes with wider roads and a lot more sunshine. One of the biggest shocks for me on my first visit to the Bay Area was how ordinary Apple and Google’s offices felt. (This was 1 Infinite Loop before Apple Park construction started). The canopy over the main building entrance looked like an airport Novotel, or every shopping centre throughout the UK.
In the same way that Milton Keynes is not London; Silicon Valley’s quintessential campus laden town Sunnyvale is not San Francisco.
This is not the dystopian doom spiral San Francisco city of today with failed governance and pedestrianisation projects. At this time, San Francisco was on the up, having been clobbered by the dot com bust in the early noughties, financial services had kept the city ticking over. Technology was on the rise again. Home town streetwear brand HUF was making a name for itself with its first shop in the Tenderloin, the DNA Lounge had consistently great nights from west coast rave and goth sounds to being a haven for mashup culture with its Bootie nights.
There was great cinemas, vibrant gay night life and the sleaze of the Mitchell Brothers O’Farrell theatre. The Barry Bonds era San Francisco Giants won more than their fair share of baseball matches.
If Yahoo! were going to keep talent, they’d need a place in the city. It makes sense that setting up the San Francisco space fell to Caterina Fake. Fake was co-founder of Flickr and was given a mandate by Jerry Yang to ‘make Yahoo! more like Flickr’. So she decided to set up an accelerator for new products.
Brickhouse
According to Caterina Fake on Threads:
I dug around on the company intranet and exhumed an old deck for an initiative called “Brickhouse” which had been approved by the mgmt, but never launched.
This tracks with my experience in the firm, projects would form make rapid progress and then disappear. And during the first dot com boom, San Francisco was home to online media companies, such as Plastic (Razorfish SF), Organic and Agency.com, many of whom also had offices in New York. Wired magazine had its office there, as did a plethora of start-ups.
Fake goes on to say that Brickhouse managed to use the same office space she had worked in while she had worked at Organic over a decade earlier.
The 60 Minutes episode Dot-com Kids marked an acme in this evolution of San Francisco. At the time Fake was doing this exercise, there was probably a Yahoo! sales team based in San Francisco proper, but that would be it.
Fake cleans up the Brickhouse deck and gets it through the board again with Bradley Horowitz with the then Chief Product Officers Ash Patel and Geoff Ralston, president Sue Decker and chief Yahoo Jerry Yang being the board champions of the project.
Fake hands off to Chad Dickerson to realise Brickhouse as she heads off on maternity leave. Fake, Dickerson and Horowitz assemble the Brickhouse team (aka the TechDev group) and ideas that would eventually build Pipes by Yahoo!, Fire Eagle and other projects.
This is where my origins viewpoint on Pipes by Yahoo finishes. For the download on its creation, go here now; the link should open in a new tab and I will still be here when you get back to discuss the service’s impact.
Pipes by Yahoo was launched to the public as a beta product on February 7 2007. Below is how it was introduced on the first post added to the (now defunct) Yahoo Pipes Blog. At this time product blogs became more important than press releases for product launches as information sources to both tech media and early adopters.
Introducing Pipes
What Is Pipes? Pipes is a hosted service that lets you remix feeds and create new data mashups in a visual programming environment. The name of the service pays tribute to Unix pipes, which let programmers do astonishingly clever things by making it easy to chain simple utilities together on the command line.
Philosophy Behind the Project There is a rapidly-growing body of well-structured data available online in the form of XML feeds. These feeds range from simple lists of blog entries and news stories to more structured, machine-generated data sources like the Yahoo! Maps Traffic RSS feed. Because of the dearth of tools for manipulating these data sources in meaningful ways, their use has so far largely been limited to feed readers.
What Can Pipes Do Today? Pipes’ initial set of modules lets you assemble personalized information sources out of existing Web services and data feeds. Pipes outputs standard RSS 2.0, so you can subscribe to and read your pipes in your favorite aggregator. You can also create pipes that accept user input and run them on our servers as a kind of miniature Web application.
Here are a few example Pipes to give you an idea of what’s possible:
Pasha’s Apartment Search pipe combines Craigslist listings with data from Yahoo! Local to display apartments available for rent near any business.
Daniel’s News Aggregator pipe combines feeds from Bloglines, Findory, Google News, Microsoft Live News, Technorati, and Yahoo! News, letting you subscribe to persistent searches on any topic across all of these data sources.
What’s Coming Soon? Today’s initial release includes a basic set of modules for retrieving and manipulating RSS and Atom feeds. With your help, we hope to identify and add support for many other kinds of data formats, Web services, processing modules and output renderings.
Here are some of the things we’re already got planned for future releases:
Programmatic access to the Pipes engine
Support for additional data sources (such as KML)
More built-in processing modules
The ability to extend Pipes with external, user-contributed modules
More ways to render output (Badges, Maps, etc…)
Pipes is a work in progress and we’ll need your help to make it a success. Try building some simple pipes and advise us what works well and what doesn’t in the online editor. Tell us how you’d like use Pipes, what we can do to make cool things possible, and show us ways you’ve found to use Pipes that never even occurred to us. In return, we promise to do our best to make Pipes a useful and enjoyable platform for creating the next generation of great Web projects.
And please have fun!
The Pipes Development Team
Pipes impact
I had a good, if exhausting time at Yahoo! It was first inhouse role and my part of the central marketing team had an exhausting workload. By the time Pipes by Yahoo launched, I had left Yahoo! Europe. There has been a re-organisation of European arm and the business had been ‘Kelkoo-ised’; a few of us on the European central marketing team took the opportunity to take the money and run.
I remember bringing Salim (who headed the European search team) up to speed and getting his support to push for me getting a payout, rather than fighting my corner.
Peanut Butter Memo
Brad Garlinghouse’s peanut butter manifesto was made public towards the end of the year portraying a game of thrones type power play which would have seen the kind of structures that were put in place in the European organisation rolled out globally.
On the face of it, some of it was pertinent, but it lacked a wider vision.
While Garlinghouse has gone on to have a really successful career at Ripple; the Yahoo! business unit he ran had several problems. He was in charge of Music and the Comms & Community BU. At the time it had a poor record of building products fit for early adopters like music properties that aren’t Mac-compatiable, this was when the iTunes store and Apple iPod springboard off the Mac community and into the mainstream.
The then new Yahoo! Mail which didn’t work on Safari and a Messenger client which was worse to use than third party clients like Trillium or Adium. All of which made it hard to build a buzz that will bridge to mainstream users. Yahoo! Messenger, could have been Skype or WhatsApp. It became neither.
For a more modern example, think about the way Instagram and Threads were Apple iPhone first to build a core audience.
At the time, I was less charitable about the memo. And the memo raised wider questions about the business; like was the CEO facing an executive revolt?
The launch of Pipes by Yahoo helped to inject some more positive energy back into the Yahoo! brand. Remember what I said earlier on how talent wanted to join Yahoo!’s engineering and development teams because of Flickr. They started to want to join Yahoo! because of Pipes.
The outside world
I was back agency side when Pipes launched. I had friends within Yahoo! still and kept an eye on the various product blogs. I got the heads-up on Pipes and put aside an afternoon and an evening to explore it fully. A quick exploration gave one an idea of how powerful Pipes by Yahoo could be. While Pipes was powerful, it was also relatively user friendly, like Lego for data. It was more user friendly than Apple’s Automator, which inspired Pipes by Yahoo! in the first place.
At this time in London the amount of people working on social media and online things was still relatively small. Knowledge was shared rather than hoarded at grassroots events and on an ecosystem of personal blogs. This was a group of eople with enquiring minds, a number of whom I can still call friends.
We shared some of the public recipes on Pipes by Yahoo and learned from them, just as I had learned about Lotus 1-2-3 macros in the early 1990s, by picking through other peoples examples. (I put this to use automating data records in the Corning optical fibre sales support laboratory that I worked in at the time.)
The agency I worked with had a number of large technology clients including AMD, Fujitsu Siemens personal computing devices – notably smartphones, parts of Microsoft and LG.
AMD and Microsoft were keen to keep track on any mention of their brand in a number of priority blogs or news sites at the time. Social listening was in its infancy and there were a number of free tools available, which I got adept at using.
We managed to build and sell both AMD and Microsoft respectively a custom feed which provided them with links to relevant content in near real-time, which they then published on an internal site so that key audiences always had their fingers on the pulse.
This was all built on top of two free Pipes by Yahoo accounts which used a similar but tweaked recipes to make this happen.
On the back of that work, we managed to sell in a couple of small websites to the Microsoft team based on WordPress. I had long moved on to another agency role by the time the Pipes by Yahoo feeds would have died.
Discussing Pipes by Yahoo with friends, they said it had inspired them to learn to code. Pipes by Yahoo spurred creativity and creation in a similar way to HyperCard.
Zeitgeist
While all of this has talked about Pipes by Yahoo! and how great the launch was, the ending of Pipes was much more humdrum. The service had been glitchy at the best of times and wasn’t being maintained in the end. In conversations I had with friends, it was compared to a British sports car: unreliable but loveable. Yahoo! closed it down on September 30, 2015.
Which begs the question, why is Pipes by Yahoo, which was shut down eight and a half years ago being celebrated amongst the digerati?
I think that the answer to this is in the current online zeitgeist. The modern web isn’t something that anyone involved in web 2.0 would have signed up for. Algorithms have fragmented the global town hall archetype envisaged for social. The web no longer makes sense in aggregate, as it’s splintered by design.
The modern web feels ephemeral in nature. This seems to have gone hand-in-hand with a video first web exemplified by TikTok.
The social platforms the fragmentation seem to be declining in relevance and its isn’t clear what’s next. The people-driven web of knowledge search and web 2.0 is under pressure from AI content providing a mass of ‘just good enough’ content. Even influencers are being usurped by digital avatars. Even the audience engagement is often synthetic. All of which leaves the netizen in a state of confusion rather than the control that Pipes by Yahoo offered.
Taylor Lorenz is a journalist who made net culture and platforms her beat. Taylor Lorenz’ book Extremely Online feels like she is reporting from another planet rather than the recent web and it was published in October last year.
KanDenko is a Japanese construction company that specialises in infrastructure. This advert communicates effectively what they do in a creative manner. KanDenko must have spent a good deal of money to have this film produced. But it is well worth it.
Vintage Singapore
Footage of Singapore‘s North Boat Quay circa 1983. This area has now been redeveloped with the shop houses refurbished and now holding cafés, restaurants and bars. What this video shows is traditional Chinese life that would have been similar to the mainland prior to Mao’s ‘new China’ which culminated in the cultural revolution.
Thankfully overseas Chinese and Taiwan had preserved the culture and beliefs.
Stussy x Nike
Nike and Stüssy have collaborated on bringing an old Nike model back to life.
New Order’s Blue Monday on 1930s instruments
The BBC made a video of Orchestra Obsolete using early electronic instruments (including a Thermin) alongside traditional instruments to reproduce New Order’s Blue Monday
Distorted Kowloon City
When I first saw this footage of Distorted Kowloon City, I was reminded of the locative art discussed in William Gibson’s novel Spook Country. I read this shortly after being switched on to where 2.0 services while working at Yahoo! on search and Flickr offerings. Yahoo! bought Whereonearth, to better understand what ‘local’ meant with its InternetLocality product set. At the time Whereonearth worked with Three on local mobile services and was a data provider to the likes of insurance companies and credit reference agencies. Yahoo! engineers like Dan Catt and Paul Hammond worked on projects like ZoneTag and including location data in the EXIF metadata of photography; something we just accept as normal on smartphones now.
Distorted Kowloon City is a piece of immersive digital abstract art. Or according to The Hong Kong Trade Development Council (HKTDC)
Kowloon City is full of collective memories of Hong Kong people. Spanning the old town with restaurants and specialty shops, Checkered Hill (also known as Radar Hill), tree-lined parks, the historical remains of the Kowloon Walled City and the former Kai Tak Airport, Kowloon City is as diverse as Hong Kong.
To re-interpret how we perceive, how we feel and how we see Kowloon City, moon.moon weaved the sensory data elements of the real world into an 360-degree audio-visual experience with the aid of original music and technologies (e.g. Point Cloud Processing and drone photography), allowing the public to re-discover Kowloon City from abstract art perspective.
Design Inspire | HKTDC
From this explanation, its a mix of history, Hong Kong culture and geography blended into the art work.
The work was done by local digital artist Moon Hung.
Fractured markets
The effect of low interest rates in the aftermath of 2008 on financial investors was to encourage increased risk taking and one of the first casualties of interest rate increases were UK pensions under management. The FT goes into more depth in a video documentary.
The Wall Street Journal explores the history and technology behind Google Maps. The mapping equipment decrease in size over time is particularly interesting to see. The origin of Google Maps starts with a PC app developed the Rasmussen brothers. Jens went on to help found Apple’s map application as well. What quickly becomes apparent when you look at the camera and mapping equipment is the lack of designing for operator comfort. Even these are produced in commercial amounts, the Google Maps camera and LIDAR equipment still looks and feels like an engineering student project. Google Maps is now 17 years old from launch. It spurred a large amount of development on what was termed ‘where 2.0‘.
The impact of where 2.0 in our world today can be seen in local recommendations from Siri on your smartphone to the Institute for the Study of War, which has created the defacto map for what’s happening during the Russian war of aggression in Ukraine.
Aquafresh fortune-telling
Grey Japan based the campaign on a behavioural insight. During COVID, Japanese toothbrushing habits changed. While brushing your teeth morning and night was common within the Japanese lifestyle prior to COVID; the emphasis has also slowly shifted to brushing in the night and less in the morning.
The campaign asked Aquafresh users to upload a photo on Twitter showing the toothpaste applied to their toothbrush. They would then receive their fortune-telling results from the famous Japanese fortune teller Johnny Kaede based on the colour and shape of the toothpaste on the brush.
Brabus Invicto
German Mercedes tuner and the sultans of bling Brabus have got into the armoured G-Wagen business with the Invicto. I am not quite sure who it will be marketed to since the security sector is already well catered to by the likes of Alpha Armoring. But if you need a team of armed bodyguards to rollout and deploy rapidly on the Kings Road in Chelsea, be reassured Brabus have the gun truck for your ex-special forces types.
The engineering and manufacturing processes that go into making the vehicle is very interesting. It contrasts with the process that Jankel uses for its Land Cruisers. The main challenge I see is the large number of pieces that Brabus has to use compared to Jankel’s hot forming process.
Lyle Goldstein on U.S. Strategic Challenges
Goldstein is a director at a dovish US think tank and formerly taught as the US Naval War College. I don’t necessarily agree with Goldstein since I view the challenges that the west faces more apropos to the Axis powers, rather than the cold war.
Manulife Hong Kong
Manulife insurance for personal injury and health costs is what this ad is using. The actors are famous in the Hong Kong film industry and the ad uses tropes from police and spy films.
I’ve read a good number of books, but only a subset remain on my bookshelf. For instance, I love graphic novels, but I pass them on to friends. They entertain, but in general they don’t stay on the bookshelf. When I say bookshelf that’s probably inaccurate for a few reasons.
Some of the older books remain in crates at my parents house from my move to Hong Kong, but are still valued. I’ve managed to repurchase some of these again by accident. Others that I tend to use for work are in the bookcase in my living room, so bookshelves rather than a bookshelf. I tried using ebooks. That was fine or entertainment, but for some reason I didn’t retain any of the content on this electronic bookshelf.
I’ll be updating this bookshelf page over time, so think of it as a living document. (Last updated July 4, 2024).
Behaviour change
Behaviour change is important to so many things now: design, new product development, advertising and service provision. This is why it has become a major part of my bookshelf.
Deep Simplicity: Chaos Complexity and the Emergence of Life by John Gribbin I first came across Deep Simplicity from the interest in chaos theory and fractals. This book is one of a number of popular science books which have sold well, providing the answers to big questions for a society that has never been more divorced from both science and religion. I revisited Deep Simplicity because the book shows how small simple rules can develop into complex behaviour. This complex behaviour then provides an analogue to understand the `unforeseen consequences’ that drive a lot of things that currently interest me like behavioural economics. I am careful not to take the conclusions too far as I still believe in free will. Models only work at scale.
Tiny Habits by B.J. Fogg – Fogg wrote this consumer-friendly book on personal behaviour change.
China
East and Southeast Asia went from being the poorest region of the world in the immediate aftermath of world war 2, to the most dynamic region today. China and the overseas Chinese community is a key piece in this puzzle. China makes up a good chunk of my bookshelf.
Hidden Hand by Clive Hamilton and Mareike Ohlberg. Both of them are academics. Their book highlights how China is influencing and reshaping the world outside China. Through engagement with elites, multilateral bodies and its own diaspora with focus and scale. I reviewed it in more depth here.
What Chinese Want by Tom Doctoroff. From 1994 to 2016 Doctoroff worked for J Walter Thompson as a client services lead covering Greater China markets. Initially he was based in Hong Kong and then he moved to Shanghai. What Chinese Want is a distillation of everything Doctoroff learned delivering work in China for the likes of Kraft and Kimberley Clark. Firstly, few people get that opportunity immerse themselves in a market, with one agency in the way that Doctoroff managed to do. Secondly, Doctoroff manages to articulate his thoughts in knowledge in a manner that I would expect from a senior strategist; rather than someone from the client services side of the business. I got this book soon after I started working in Hong Kong and it served me really during my time in China and afterwards when I worked on Huawei’s then fast-growing smartphone business.
Chinese Antitrust Exceptionalism by Angela Zhang sounds exceptionally dry to the uninitiated. But if like me, you’ve worked on brands like Qualcomm, Huawei or GSK you realise how much of an impact China’s regulatory environment can have on your client’s success. Zhang breaks down the history of China’s antitrust regulatory environment, how it works within China’s power structures and how it differs from the US model. What becomes apparent is that Chinese power isn’t monolithic and that China is weaponising antitrust legislation for strategic and policy goals rather than consumer benefit. It is important for everything from technology to the millions of COVID deaths that happened in China due to a lack of effective vaccines. Zhang’s book won awards when it first came out in 2021, and is still valuable now given the relatively static US-China policy views.
Design
Design isn’t just making a thing. But an expression of an idea, a philosophy and an embodiment of quality. Poor design indicates poor thinking, a flawed or lack of philosophy behind the product and goes hand in hand with poor quality. With that in mind, I have always thought that the thinking behind design is similar to the thinking behind strategy. And sometimes we just need nice things around us. That’s why design gets a place on my bookshelf.
8vo On the Outside by Mark Holt and Hamish Muir – 8vo was one of the trendsetting graphic design outfits of the 80s and 1990s. They did a lot of pioneering work on information design pre-internet. If you were an early Orange mobile phone customer – they designed your bill. If you read magazines like iD or other publications that took iD as their role model, then the typography usually owes a debt to 8vo. Both the work the minutiae of running an agency are fascinating.
Creating a brand identity by Catherine Slade-Brooking – although its orientated towards graphic designers this is an excellent guide to process, methodology and avoiding pitfalls in crafting a brand identity.
Less and More: The Design Ethos of Dieter Rams edited by Klaus Klemp and Keiko Ueki-Polet. One of the best works cataloguing the work of Dieter Rams. Rams philosophy of good design does a lot to inform us of what good strategy should exhibit
My Rugged 211 by Minoru Onozato. I consider curation to be a type of design. Onozato-san was the founder and long-time editor of Japanese style magazine Free & Easy. Free & Easy also extended itself into retail. Its impact on the menswear fashion world was as big as Vogue was for womenswear. All of it came from his very particular vision on ‘rugged’ items. A mix of new and vintage things that reflected quality and items imbued with stories. The 211 came from Onozato’s constant pruning and refining of his collection. When he got above 211 items, the excess would be sold or given away. More on the book here. Free & Easy has closed down, but its spirit lives on in HailMary – a magazine set up by many of the editorial staff.
teamLab Continuityedited by Kari G Oen and Clare Jacobson – teamLab is a a Japanese collective that have been going since 2001, they’re work crosses boundaries between art and design. The digital world and the real world. Art often informs the future that we create, which is why I think teamLab’s work is so important.
The Pentagram Papers. Pentagram is a UK-based design agency. They periodically published brochures covering esoteric subjects as a form of inspirational materials. The brochures were collated in this handy volume.
Type Matters by Jim Williams. Typography is under examined in digital design projects. Veteran graphic designer put together an accessible syllabus on typography and graphic design in its purest sense. More here.
Economics / Finance
Panic! edited by Michael Lewis. Michael Lewis became famous when he wrote an account of his career in investment banking in Liar’s Poker. His career overlapped with the 1987 financial crash. Since then he has been a writer who has documented key turns in the economy. Because of this background Lewis was the ideal person to curate a history of financial crisis from contemporary accounts at the time. Panic! covers the 1987 financial crash, the 1998 debt crisis, the dot com bubble, and the subprime mortgage crisis of 2007/8. I read the book in short bursts mainly due to asks on my time, rather than the nature of the book. I didn’t put this in the technology and economics sub-section of this bookshelf because it covered more than technology related market events. But the publication of Pegasus Research’s iconic quantitative research on ‘burn rates’ in March 2000 on dot.com company burn rates makes it highly relevant to revisit when we are in hype cycles such as those surrounding health tech, fintech, crypto and more – if for no other reason than pointing out the folly of trying to pick winners in hype-driven public markets with a high degree of opacity.
Engineering
In an Irish household up until the present you might have come across the phrase ‘calling’. As in ‘Bridget’s older brother had a calling to become a priest’. My Dad’s calling is as an engineer. He grew up as the middle son on a small farm in the west of Ireland. He was never going to inherit the farm. As a small child he took an interest in things, making his own cart to help with chores and tinkering with things to get them working. He never went to university but instead served a four-year apprenticeship working for what was the Irish Sugar Company. He was servicing and making machinery out of parts that they had to hand, and manufactured in their own machine shop. This weird mix of devices were used in an experimental farm in peat land exhausted from harvesting by Bord na Móna. He got seriously ill as a travelling repair man for Massey Ferguson‘s range of industrial and agricultural machinery, living out of a suitcase and a Commer van, while staying in some of Ireland’s best hotels. He went on to help build ballistic missile carrying nuclear submarines, and vessels that served in the Falklands conflict. He maintained at least one car manufacturing plant, a liquid packaging plant and a paper mill during scheduled shutdown. Eventually he ended up working in plant hire.
He fabricated fixes to various machines, the original manufacturers then paid my Dad’s boss and patented those innovations without his name appearing on the patents. He gave me an appreciation (if not the talent) for engineering whether it’s Swiss watches or power stations. My time working in the petrochemical industry was partly down to his influence.
Modern Petroleum Technology by the Institute of Petroleum takes you through all the stages of the oil industry. From understanding the geology, right the way through to refining oil for chemical feedstocks. The engineering solutions outlined in of themselves highlight solutions to future problems that we’ll have with geothermal energy to hydrogen fuel cells. It also brings home the ubiquity of oil in our lives. Oil isn’t just about home heating oil, fuel for the car or the airplane, but the polymer covered batteries and circuit boards in the computer I type this on.
Bomb, Book and Compass: Joseph Needham and The Great Secret of China by Simon Winchester. English academic Needham looked to preserve the history of China’s scientific and inventive accomplishments during world war 2. From his work we get a different narrative about inventions, compared to the one that you and I probably learned at school. It adds evidence to the hypothesis that innovations have their time and the inevitable progression of technology (Kevin Kelly’s technium) almost has a life of its own. More here.
Civilisation: A Personal View by Kenneth Clark – I’ve got a lightly worn soft back edition of the book that mirrored and complemented Clark’s tale of western Europe after the fall of the Roman Empire. It is a beautiful and coherent portrayal of European history. I can also recommend the series which is available on DVD. The BBC revisited this with a portfolio of presenters in the TV series Civilisations – which felt dumbed down for a modern audience.
Fear and Loathing: On The Campaign Trail’72 by Hunter S Thompson. Less well known than Fear and Loathing in Las Vegas or Hells Angels. Thompson embedded with the political media for Rolling Stone magazine. He talks extensively about the Democratic party primaries used to find a candidate to run against Richard Nixon. What results is a classic example of the new journalism pioneered by Tom Wolfe and Thompson. Thompson opening up the inner workings of the body politic for our own amazement and curiosity. Politics doesn’t come off well from the experience.
Ireland by Robert Kee. My Dad bought this book for me. It was designed to give me a sense of my own history. This book was an accompaniment to Ireland – A Television History. A thirteen-part series narrated by Robert Kee. Kee’s TV series isn’t available on Blu-Ray or DVD; but if you poke around on YouTube, you may be in luck. Having the book and the show authored by Kee meant that both worked really well with each other. Despite Kee’s sterling efforts, there is a still a lack of understanding of Irish history in Britain.
Michael Collins by Tim Pat Coogan. Collins is was founding father of modern Ireland. He died at the age of 32 and was a complex person, a polymath and military figure. His actions were subsequently studied by other countries leaders including Yatzik Shamir and Mao Zedong during their fight for change. Coogan provides a comprehensive, authoritative and independent biography of Collins.
Six Days – How the 1967 war shaped the Middle East by Jeremy Bowen. BBC journalist Bowen, provides a well-researched complex recounting of the six-day war that shaped the geography of the modern Middle East. More here.
The Sunday Times Investigates: Reporting That Made History – This is a collection of the biggest stories investigated by the Sunday Times over five decades of the Insights team. Each story has an introduction to the impact that the story had and would have merited a paperback book in itself. They are just a nice length to read before bed each night. There are a wide range of stories covered including the Cambridge Three spy ring focusing on Kim Philly, the Thalidomide scandal. The Thalidomide section shocked me as it demonstrated Grunenthal’s ruthlessness to cover up the scandal, foreshadowing the Sacklers and Purdue Pharma by decades. Their confirmation of the Israeli nuclear weapons programme is the real stand-out piece of reporting. The Cash for Questions sting operation of 1994 helped usher in the first Blair government as John Major’s MPs were implicated in a willingness to take bribes. This was mirrored by the FIFA investigation some 20 years later. Less impactful at the time, but just as important from a historic point of view are investigations in to how the government failed during the COVID epidemic in 2019 and investigation of SAS war crimes sounding the war on terror. The only story I consider not making the cut is their coverage of Colonel Gaddafi’s attempt to help fund the National Union of Mineworkers strike in 1984-85. I didn’t think that it proved anything significant beyond a meeting having taken place between a financier and the union. It also didn’t impact the broader narrative to sway more people to the government’s side. The book makes an interesting historical curio on my bookshelf, what I also found interesting is how the writing becomes more accessible over time. The Cambridge Three story and Thalidomide were both stories for middle brow readers.
The Bhutto Dynasty by Owen Bennett-Jones. I knew very little about Pakistan and for that fact alone, it would have earned a place on my bookshelf. The story of the Bhutto family is a story of fierce ambition with bursts of hubris. But it is also the tale of the moghul empire of pre-Raj India, British rule and post-colonial Pakistan. More here.
The Fifth Risk by Michael Lewis. The author of Liar’s Poker on Donald Trump and the role of government. Lewis’ book is much more than a history, it is a repudiation of neo-liberalism and the Chicago school. More here.
The World At Warby Mark Arnold-Foster – the book accompanied at TV series of the same name that featured real world accounts from people at the time still alive to remember and recall the events. The book tells the story in a balanced way, but with a definite British view point. I read this as a child and recently when I was back at my parents one Christmas.
Management
Good to Great by Jim Collins. Based on research conducted since the late 1980s. Collins earned his place on my bookshelf with its common sense advice backed by research.
Marketing
I’d put some marketing-specific recommendations for reading materials here. It pulled in books from different disciplines that would work to inspire a marketer and provide them with effective tools. There is some overlap with this page. The reality is that that I could write up a bookcase worth of marketing books at the very least rather than having them part of this metaphorical bookshelf.
Buying In by Rob Walker. Walker focuses on what makes a brand. It touches on the product, how consumers use the product. The nature of the product of the business in terms of ‘authenticity’ and lastly the impact of marketing. More on this book.
Consumerology by Philip Graves. Marketing psychology consultant Graves looks at the different marketer and consumer biases that can adversely affect research projects. His AFECT research criteria is a useful way to assess the relative effectiveness of a given research project for marketers. More here.
Decoded by Phil Barden. Barden distills marketing thinking around behavioural change and consumer behaviour into an easy to digest book that is ideal for marketers at the start of their career. It works well as a primer for Phil Graves Consumerology and Sharp’s How Brands Grow. More in my review here.
Eat Your Greensedited by Wiemer Snijders is a series of short essays from well known names in advertising creative, account planning, branding, behavioural science and marketing. Its a good light read for marketers at all experience levels. I reviewed in more depth here.
eMarketing eXcellenceby Dave Chaffey and PR Smith. Like Internet Marketing by Chaffey, this is a good primer on digital marketing for marketers. PR Smith brings his expertise in terms of environment and analysis to this work.
How Brands Growpart 1 and part 2by Byron Sharp is the modern marketers bible for B2C brands of various stripes. Sharp and his colleagues distill down decades of evidence-based research that has been carried out by Ehrensberg-Bass Institute of Marketing Science attached to the University of South Australia. (Reading the books gives you a sense of how marketing technology is often at odds with the task of achieving efficient and effective marketing campaigns. These tools are built and designed by engineers rather than being guided by marketing science.)
The research institute has got a who’s who of corporate sponsors supporting their work and using their data:
General Mills
Grupo Bimbo
Procter & Gamble
Red Bull
Unilever
How To Win Friends And Influence People by Dale Carnegie. This book is a guide to customer relationship management, community management and marketing decades before those terms came into existence.
Internet Marketing: Strategy, Implementation and Practiceby Dave Chaffey, Richard Mayer, Mr Kevin Johnston and Fiona Ellis-Chadwick. Dave Chaffey is a bit of a legend when it comes to internet marketing. This book is a good primer for marketers on digital marketing.
Planners Guide by JWT London. I work as an account planner. A career path that was founded in London sometime in the mid 1960s. Account planning is a role focused on bringing the consumer into creative thinking. UK ad agency Boase Massimi Pollitt (BMP) are credited with having invented account planning. It was J Walter Thompson (JWT) that gave account planning its name later that year. As is true with the story with many innovations, a similar process happened in Australia at the same time. Both were completely unconnected to each other. Planners Guide by JWT London was originally written in March 1974. It codified the planners role and is still very relevant today. It is the ‘Dead Sea Scroll’ of my profession. It was originally typed up and printed out using a plastic ring binder to hold it together. Eventually the guide seems to have escaped the agency as a photocopy of the original printed copy. It circulated around the industry and was eventually scanned and put online in various places. You can find a good copy here.
The Dentsu Way by Kotaro Sugiyama and Tim Andree highlighted Dentsu’s Cross Switch approach. Much of marketing is very much about silos, if someone talks about multichannel it usually means online with a fig leaf of offline brand advertising. Sugiyama-san and Andree outline a long running more integrated approach to marketing communications. It is remarkably different to most agencies who go with ‘digital is the answer, now what’s the question’. Many similar books are self-serving pieces of agency marketing, but this isn’t, which is why it earned a place on my bookshelf.
The Handbook of Online and Social Media Research: Tools and Techniques for Market Researchers by Ray Poynter. I first reviewed Poynter’s book on this blog back in 2010 and it has weathered that time exceptionally well. One of the things that sets it up so well is that Poynter thought about online in a very wide way, rather than falling into the trap of obsessing about insights derived from social media. I still dip back into it on a regular basis. So it goes on and off my bookshelf on a regular basis.
Philosophy
Letters from a Stoic: Epistulae Morales AD Lucilium by Lucius Annaeus Seneca. His letters contain all the wisdom and the poise to enable any inquisitive soul to acquire self control, to endure with dignity the burdens of misfortune, to take success and fame with humbleness and cynicism.
Meditationsby Marcus Aurelius – Aurelius was the only Roman emperor who was also a philosopher. Meditations is a set of reflections and exercises that he developed as he sought to understand himself and the universe around him. They were designed to increase his resilience, providing personal consolation and encouragement. Which is the reason why they have been revisited through the ages.
The Three Pillars of Zen by Philip Kapleau. Despite being over 50 years old as a book, Kapleau still provides the western reader with the best comprehensive yet accessible guide to zen buddhism.
Zen And The Art Of Motorcycle Maintenance by Robert M Pirsig. I’ve reread this book several times and some of the best times I had in college was discussing it with my house mates during the final year of my degree. ‘Zen’ was our shorthand for the book and the way we used it to reflect on the things going on around us. It’s a great read on many levels. My original copy, was held together by sellotape for many years until it could no longer retain the pages. I am now on my third copy. In the book, Pirsig provides a narrative account of his own pursuit to discover the nature of quality. He paid a high price, which is outlined in the book. In a world of iterative builds on products and ‘move fast and break things’; an understanding of quality has never been more important. Pirsig wrote his book when the most complicated objects in people’s homes where the car in the garage, the TV in the lounge. A sowing machine periodically removed from the cupboard and watch on their wrist. But that doesn’t mean the need for quality has diminished, on the contrary it has increased as fewer objects seem to now possess it.
Psychology
The Mind Is Flat by Nick Chater. In this book Chater posits that humans at the bottom of it all ‘story-spinning improvisers. That they interpret and alter their interpretation of the world in the moment. This idea immediately changes our understanding of how our reality, media and advertising work.
Strategy
Blue Ocean Strategy by W Chan Kim and Renée Mauborgne. Back when I read the book I summarised as: The book’s premise is that most business strategy books are about conflict and competition and this is wasteful. Instead it provides a framework for strategists to Think Different and differentiate their businesses instead. What’s interesting, but not discussed by the authors is how their work is received by the kind of type-A personalities typically found at the top of businesses. It is well worth having on your bookshelf though.
Cultural Strategy by Douglas Holt and Douglas Cameron. Holt and Cameron worked at the time of writing for the Cultural Strategy Group. The book posits that a distinctive position can result in a successful company. They look to back this into the company culture itself rather than as a wrapper around a product. More on it here.
Science, Strategy and War – The strategic theory of John Boyd by Frans P.B. Osinga. Osinga provides context of Boyd’s thinking including how it sprang out of his combat experience. He then talks about the meta analysis of other strategists that Boyd undertook and where he learned from other disciplines including social science, philosophy and scientific theory. John Boyd is a largely mis-understood military strategist whose ideas are increasingly being used out of context in the realms of business and marketing. More on Science, Strategy and War here.
The Art of War by Sun Tzu – Yes I know that applying military thinking to business strategy is a dangerous rabbit hole to go down. But I think that this book is powerful because it acts as a framework to think about problems rather than suggesting answers. I go back and re-read this every so often for inspiration, which it has such a prominent place on my bookshelf.
The Manager’s Guide to Systems Practice: Making Sense of Complex Problems by Frank Stowell and Christine Welch – the book outlines a framework for looking at the world that helps in problem solving. It has a good base given that the authors provide a balanced view of different systems thinking approaches. I liked the book as it eases you into systems thinking and then ramps up your learning. That learning curve alone makes this essential for my bookshelf.
Technology library
Over time I have built up a bit of a library that covered the technology sector. I had an interest in innovation in college and technology was changing in obvious ways. I had access to JANET before the internet was a consumer product in the UK. I have broken the technology section of my bookshelf down into more depth below
Technology and economics
Handbook Of The Economics Of Innovation And Technological Change edited by Paul Stoneman. Stoneman curated a selection of essays that are still as relevant today as they were when I bought this book at a discount book store when I was in college. it seems to be very underrated, not even meriting a single Amazon review.
New Rules for the New Economy by Kevin Kelly – this was pretty much a bible-like publication during the dot com boom. It fed of the utopian post-counterculture vision that the hippies brought to Silicon Valley. But of course, there aren’t perfect markets and consumers don’t have perfect knowledge.
The Power Law: Venture Capital and the Art of Disruption by Sebastian Mallaby – this book provides a history of Silicon Valley from the perspective of the venture capital industry that helped finance it. Some of the content is very self congratulatory, such as expansion into China, but overall its a great comprehensive read and an interesting item for the technology section of your bookshelf.
The Rise and Fall of American Growth by Robert J. Gordon. Published as part of the Princeton Economic History of The Western World, it was a surprise breakout hit. It became a New York Times bestseller at the time of its release in 2015 and got awards from the Financial Times. It is a weighty tome that took me longer to read than I care to admit, despite being off my bookshelf and by my bed. In it economist looks at how technology and innovation impacted economic growth since the American civil war. Its an interesting book that provides difficult reading for techno-optimists. TL;DR – modern technology didn’t drive as much growth as we think. Incomes have been stagnant with some noticeable peaks for longer than we thought. I reviewed it in a bit more depth here.
Wall Street Meat by Andy Kessler. Kessler was a peer of Henry Blodget, Mary Meaker and Jack Grubman. He still invests and writes the occasional op-ed for the Wall Street Journal. In Wall Street Meat Kessler tells the insanity of the original internet bubble from the finance side.
Technology and history
Technology and history is what started me on my career journey during my time at college to today. I loved the Apple PowerBook that I used in college and immediately after. I was inspired by reading Byte, Dr Dobbs Journal (DDJ) and Wired magazines in the college library. I was also inspired by books about Silicon Valley. Specifically one book: Accidental Empires by Robert X Cringely was something so different to what I’d been used to. I’d worked in industry, but hadn’t experienced anything like this. Over time, technology and history built up its own section on my bookshelf.
Architects Of The Web by Robert H. Reid. He wrote up the profiles of many of the pioneer web companies including Netscape, Real Networks, Marimba, Yahoo! and Silicon Graphics. It’s helpful to revisit the future the way it was envisaged during the late 1990s and see how the future has changed. Reid wasn’t a technology writer by trade, but seems to have caught the bug. Since writing this, he went on to write three Silicon Valley based novels. I have no idea if they are any good.
Being Digital by Nicholas Negroponte. At the time of writing this book Negroponte was at the top of the digital world. He headed up MIT Media Lab, wrote for Wired and was widely quoted in media around the world. Negroponte did work that foreshadowed in-car sat navigation devices, Google Street View and the modern stylus-less touch screen. Some of the ideas in his book around online media and cord cutting was on the money, at the time it would have been on the bookshelf of politicians, marketers, financiers and technologists. More on Being Digitalhere.
The Big Score by Michael Malone covers a quarter century of Silicon Valley history from the fallout of the traitorous eight who left Shockley Semiconductor to just before the launch of the Apple Macintosh. First published in 1985, it gives a good idea of how the first generation of Silicon Valley movers-and-shakers saw themselves. It is unfiltered by PR people. At the time Malone had been a beat reporter for the San Jose Mercury News and had grown up in the Valley. In his later books he treated people like Bill Hewlett and Dave Packard more like august pillars of the community. In The Big Score, he points out their many good factors, but also the social conservativism – endemic to mid-century America. Malone also touches on the Silicon Valley underbelly of hard drinking, hard drugs, broken marriages and endemic industrial espionage.
Bill and Dave by Michael Malone tells the story of Silicon Valley pioneers Bill Hewlett and Dave Packard. Nowadays people think of them as just a brand of laptops or printers. But Hewlett Packard was much more. They pioneered the Silicon Valley start-up, their successor businesses Agilient, HPE and HP. Bill and Dave’s biggest impact was in Silicon Valley culture and law. They built the company in a garage and started the egalitarian culture with The HP Way. That alone would earn Bill and Dave a space on the bookshelf. More on Bill and Dave here.
Chip War by Chris Miller covers the cold war from the Soviet Union to present-day China through the lens of the semiconductor industry. Unlike most of the other books in this Technology and history section, the author wasn’t a Silicon Valley insider or longtime resident. That distance allowed him to write a vast history that ended up being shortlisted by the FT as one of their business books of the year.
Dogfight – Silicon Valley based journalist Fred Vogelstein was writing for publications like Wired and Fortune at the time Apple launched the iPhone and Google launched Android. He had a front-row seat to the rivalry between the two brands. The book is undemanding to read but doesn’t give insight in the way that other works like Insanely Great, Where Wizards Stay Up Late and Accidental Empires did. Part of this might be down to the highly orchestrated public relations campaigns happening at the time. (Vogelstein wrote about his experiences with Microsoft’s PR machine for Wired back in 2007). Instead Vogelstein documents developments that I had largely forgotten about like music labels launching albums as multimedia apps on the new iPhone ecosystem. It’s a workman-like if uninspiring document.
From Satori to Silicon Valley: San Francisco and the American Counterculture by Theodore Roszak – back in 2008, I wrote a post about a little known 64-page essay pamphlet that outlined the personal memories of a Stanford academic who saw how the counterculture influenced, and gave way to yuppie culture in Silicon Valley. It now costs over £300 on the Amazon UK site.
Google Hacks by by Rael Dornfest, Paul Bausch and Tara Calishain. So five years ago this book would have been in a section called tools. The problem is that a lot of the ‘hacks’ in this book have been shut down by Google as it grew larger and become less Googly. Instead the book has become an artefact of what power netizens have lost. A number of the ideas in there sound like they might make good start-up concepts in themselves; often an idea needs a few attempts before it becomes a business. Skype built on a long line of voice over IP clients, WhatsApp, Signal and Microsoft Teams owe a huge debt to countless IRC and instant messaging clients. Google Talk died in 2013 when they decided to no longer support the XMPP standard. Google Blog Search was shut down in 2011., Google Base was a way of getting documents, images and spreadsheets directly into Google. Google Reader shut down in 2013, after it had devastated the market for RSS readers – RSS newsreaders survive as a cottage industry thanks to the likes of Newsblur. Google Reader had a bookmarking service in it as well, where users lost stored articles when it closed down. Google Desktop provided Google smarts to searching a journaled version of your computer’s hard drive was discontinued by 2011.
The Idea Factory: Bell Labs and the Great Age of American Innovation by Joe Gertner – Before there was Silicon Valley there was Thomas Edison and the Bell Telephone Company. A monopoly on telecommunications allowed Bell Telephone to invest in deep research. Gertner pulls together a history that starts to fall down when covering the break up of AT&T in 1984. More on my initial reading of the book here.
The New, New Thing by Michael Lewis. Pretty much every book that Lewis writes will compare unfavourably to his first book Liar’s Poker, but that book doesn’t mean that The New, New Thing shouldn’t be read. The book profiles Jim Clark, who founded Netscape and Silicon Graphics and aimed at the time to turn the healthcare industry with a new project. Lewis is capturing Clark when he is past his prime from a creative point of view. What Lewis does capture is the optimism and hubris in Silicon Valley that it can change anything.
The Smartest Guys in the Room: The Amazing Rise and Scandalous Fall of Enron by Bethany McLean and Peter Elkind. I used to work on the Enron account at my first agency that I worked at. We were promoting Enron’s broadband exchange offering. They explained it to me. It made no sense. In this book Enron’s forays into the telecoms sector was part of a wider story of technology, financial wizardry and magical thinking. Eventually it all came crashing down. It seems to be ancient history and then you read the FT coverage on Wirecard.
What The Dormouse Said by John Markoff. John Markoff is one of the titans of reporting on the business of technology alongside Steve Lohr and Walt Mossberg. In this book Markoff draws a line between the counterculture of the 1960s and the personal computing revolution through to Web 2.0. In many respects it is complementary to Roszak’s From Satori to Silicon Valley
Technology and ideas
Closing the Innovation Gapby Judy Estrin. Estrin wrote this book in 2008, where she outlined how soft innovation had taken over the hard innovation previously done in Silicon Valley. The idea of soft innovation (like my previous employer Yahoo!) was an interesting concept. We see it playing out today as the world tries to catch up with China and Taiwan in certain technology areas. More here.
Technology and media
It took the best part of a century to refine the art of the cinema from photography to storytelling and everything in between. Silicon Valley itself has evolved from hard technology to a media industry as innovation moved away from base hardware to focus several layers of abstraction higher. That’s why it occupies a section on my bookshelf.
Burn Rate by Michael Wolff. Wolff was a successful publisher who decided to move into new media in the 1990s in ‘Silicon Alley’ era New York. He shares in the who went through the trials and tribulations of getting funding and the eventual demise of Wolff New Media. He has continued to write books and provide commentary in the US media.
MIT’s Henry Jenkins – Convergence: Where new and old media collide talks about how technology is influencing the creation and dissemination of media. He starts by looking at how media has become multichannel, for example Star Wars has been animation, films, books, games and web content. Telling a story has moved to leaving bread crumbs and staying just ahead of audience collaborative discovery. More here.
Tim Hwang puts together what insiders know about the online advertising industry and advertising technology or adtech. Subprime Attention Crisis is more of a long essay than a book per se but it’s built on really well-done desk research. Secondly Hwang has a background in public policy at Google and technology policy related think tanks. You can read more about his book here in my review.
Technology and privacy
In an era where we have seen attitudes change from women being concerned about stalkers using where 2.0 services to young adults wanting connections knowing where they are at all times, I do wonder if the greatest threats to privacy is societal attitudes and if this section of the bookshelf will seem outmoded as a distinction in time?
Crypto by Steven Levy. which charted the development of civilian cryptography. If you’ve ever bought anything online you’ve benefited from cryptography. And the reason why you could do this is due to the determination of hackers, geeks and hippies that fought the government and the intelligence services. Given government’s increasingly authoritarian tone and their new desire to have crackable encryption, this work is more important than ever. More here.
Dark Wire – an interesting counterpoint to Levy’s Crypto, Cox’ Dark Wire tells the tale of how governments subverted the encrypted messaging apps used by criminals and created a legal framework to come after privacy orientated services like Signal and WhatsApp in the future. Joseph Cox was one of the journalists whose work I followed on Vice News. He specialises in information security related journalism and turns out the kind of features that would have been a cover story on Wired magazine back in the day. With the implosion of Vice Media, he now writes for his own publication: 404 Media. Dark Wire follows the story of four encrypted messaging platforms, with the main focus being on Anon. Anon is a digital cuckoo’s egg. An encrypted messaging service designed for criminals, ran as an arms length front company for the FBI. Cox tells the complex story in a taunt in-depth account that brings it all to life.
Books about tools
Books that I have found which aided in personal productivity, getting stuff done or thinking myself out of problems. I don’t necessarily read these books from end-to-end but dip into them which is why they’ve earned a place on my bookshelf.
Mac Hacks – Chris Seibold’s book is a handy primer for newbie Mac users. I’ve given out several copies of this over the years and keep one at home. Unfortunately Seibold no longer seems to be writing books for O’Reilly any more.
Trends old and new
Whilst I am skeptical about a lot of trend forecasters, they are important for the framing that they provide marketers and business thinkers. Here are some of the trend books that were worthwhile reading from my bookshelf.
Megatrends by John Naisbitt. Megatrends was based on ten years of academic research and ended up being the New York Times best-seller list for two years following its publication in 1982. Along with Alvin Toffler, Naisbitt was a centrist voice who looked to remould institutions to allow them to better serve use in the future. It is interesting reading now, given the pervasive nature of technology. More here.
Paradigm Shift by Don Tapscott. Paradigm Shift was required reading when I was in college and was one of the most read books on my bookshelf back then. Many of the important concepts such as enterprise collaboration and the co-opting of consumers in the production process have been amplified by technology. Tapscott earned a permanent place on the bookshelf.
Books that aid writing
Writing is a key part of my job, and of this blog. I won’t say that I am a great writer, or a good writer for that matter. But I have tried to focus on being an effective writer in my professional career. On my bookshelf are some items that have helped me with this process.
How To Write A Thesis by Umberto Eco. Eco’s book is a really good guide to collecting one’s thoughts and presenting facts gained through a comprehensive research process.
The Chicago Manual of Style is a handy resource when writing for American audience. It’s a vast tome and has a useful guide for referencing. The AMA Manual of Style has been useful when I have been writing on healthcare-related projects.
The Yahoo! Style Guide: The Ultimate Sourcebook for Writing, Editing, and Creating Content for the Digital World – when I started off in agency life, there were three main style guides on your bookshelf. The AP Stylebook, which was adhered for copy going into American newspapers. Either of the Economist or FT style guides were used for UK and Irish business writing. When I got to Yahoo! in the spring of 2005 – I was given a ring bound version of what would be later published as The Yahoo! Style Guide. The Yahoo! Style Guide distills the knowledge of editors who had been writing for the web since the mid-1990s and was pitched at a mainstream audience. If you want to talk and pitch the average member of the English speaking public, there is no better guide to writing than this. Given the reference nature of this book, if you have the opportunity; buy a style guide that is spiral bound. It will be more hardwearing than its softbound brethren and sits flat on a desk when open without having to leave it page down. (I also miss old school spiral bound technical manuals for the same reason). At the time of writing only AP provide this option to the general public and it is worth the extra $12 dollar or so, premium you pay to get it on your bookshelf. Especially if you are using the guide day-in, day-out.