Ged Carroll

Search results for: “unix”

  • Pipes by Yahoo

    I discovered something at the end of last year. The belatedly missed Yahoo Pipes was, in fact, officially called “Pipes by Yahoo.” I made that mistake, despite being well-versed in the brand guidelines, having spent a year working there with a copy consistently at my side.

    Now, why this journey down the memory superhighway? That’s a valid question. The inspiration for this post came from Bradley Horowitz’s initial post on Threads. (I had to go back and re-edit the reference to post from tweet to include it in the previous sentence, force of habit). In his post, Bradley shared the history of Pipes by Yahoo. I’m acquainted with Bradley from my time at Yahoo!. During that period, he was one of the senior executives in Jeff Weiner’s Yahoo! Search and Marketplace team.

    Consider this article as complementary to the Pipes by Yahoo history that Bradley pointed out. I will share the link where it makes sense to go over and read it in my depth. My commentary provides context prior to Pipes by Yahoo launching, the impact it had and why it’s pertinent now.

    Origins

    To comprehend Pipes by Yahoo, a fair amount of scene-setting is necessary. The contemporary web experience is now a world apart from the open web of Pipes, just as Pipes was distant from the pre-web days of the early 1990s.

    Boom to bust

    During the mid-1990s through the dot-com bust, Yahoo! generated substantial revenue from various sources, with online display advertising being the most pivotal. Launching a blockbuster film from the late 1990s to the early 2010s often involved a page takeover on Yahoo! and featuring the trailer on the Yahoo! Movies channel and Apple’s QuickTime.com. A similar approach applied to major FMCG marketing campaigns, with large display advertising initiatives.

    San Francisco billboard drive-by

    Yahoo! profited significantly during this period, as the internet was the new trend, and display advertising was a cornerstone for brand building. Money was spent generously, akin to contemporary budgets for influencer marketing programmes.

    Yahoo! occupied a space between TV, magazine advertising, and newspaper advertising. The design of the My Yahoo! page mirrored the multi-column layout of a traditional newspaper.

    Similar to a newspaper, Yahoo! developed various departments and services:

    • Search
    • News (including finance)
    • Music services
    • Shopping, featuring a store for small businesses, auctions, and a shopping mall-type offering
    • Sports
    • Communications (email, instant messaging, voice calls, early video calling)
    • Web hosting

    Then came the dot-com crash. Advertising revenue plummeted by around a third to 40 percent, depending on who you ask. Deals like the acquisition of Broadcast.com shifted from appearing speculative and experimental to extravagant wastes of money as the bust unfolded. This experience left scars on the organization, restraining the size of deals and the scope of ambition. Opportunities were second and third-guessed.

    Yahoo! Europe narrowly survived, thanks to a white-label dating product. Love proved to be a more dependable revenue source than display advertising. A new CEO from the media industry was appointed to address shareholder and advertiser concerns.

    The advertising industry was in a constant state of learning. Performance marketing emerged as a significant trend, and search advertising gained prominence.

    The initial cast in this story

    Jeff explains something to the phone

    Weiner was hired into Yahoo! by then CEO Terry Semel. Semel knew Weiner from his work getting Warner Brothers into the online space.

    Bradley

    Yahoo! had started getting serious about search by acquiring a number of search technology companies and hiring talented people in the field. Bradley Horowitz had found an image and video search startup called Virage and joined Yahoo! (a year before I got there) as director of media search.

    Tim Mayer Yahoo

    There was former Overture executive Tim Mayer who was VP of search products and drove an initiative to blow out Yahoo!’s search index as part of a feature and quality battle with Google, Bing and Ask Jeeves. It was a great product, but with the best effort in the world we didn’t have the heat. The majority of Yahoos internally used Google because of muscle memory.

    how many points for visiting the metro?

    Vish Makhijani was ex-Inktomi and was VP – international search and has more of a focus on operations. He worked on getting non-US Yahoo! users feature parity – at least in search products.

    Former Netscaper, Eckhart Walther was the VP in charge of product management.

    Aside: where did Ged sit?

    Where did I sit? Low on the totem pole. To understand my position in the organisation, imagine a Venn diagram with two interlocking circles: the European central marketing team and Vish’s team. I would have sat in the interlocking bit. If that all sounds confusing, yes it was.

    Downtown San Jose

    Search wars and web 2.0

    Pipes by Yahoo emerged from the confluence of two technological trends that developed in parallel, extending all the way to early social media platforms.

    Search wars

    I had been discussing the prospect of working at Yahoo! with a couple of people since around 2003. I had an online and technology brand and product marketing background. I had been blogging regularly since late 2002 / early 2003 and managed to incorporate online reviews and forum seeding into campaigns for the likes of Aljazeera and BT. The business was emerging from survival mode. As an outsider, it wasn’t immediately apparent how precarious Yahoo!’s situation had been. However, the threat posed by Google was undeniable.

    At that time, Google didn’t have the extensive workforce it boasts today. One of my friends served as their PR person for Europe. Nevertheless, Google had embedded itself into the zeitgeist, seemingly launching a new product or feature every week. If there wasn’t a new product, stories would sometimes ‘write themselves,’ such as the time the face of Jesus was supposedly found on Google Maps photography of Peruvian sand dunes. The closest contemporary comparison might be the cultural impact of TikTok.

    The geographical impact of Google’s cultural dominance was uneven. In the US, Yahoo! was a beloved brand that many netizens were accustomed to using. Yahoo! held double the market share in search there compared to Europe. Part of this discrepancy was due to Europeans coming online a bit later and immediately discovering Google. But Google didn’t do that well with non-Roman derived European languages like Czech. It has similar problems with symbolic languages like Korean, Chinese and Japanese.

    Google explosion

    I can vividly remember the first time I used Google. At that time I was using a hodge podge of search engines, usually starting with AltaVista and then trying others if I didn’t get what I wanted. This was before tabbed browsers were a thing, so you can imagine how involved the process became.

    Google appeared in an online article, which I think was on Hotwired some time during late 1998, less than a year after it had been founded. I clicked on a link to use the search engine. Google looked every different to now. It had a clean page with three boxes beneath. The first one was a few special searches, I think one of them was Linux-related, which tells you a lot about the audience at the time. The second was set of corporate links including a link explaining why you would want to use Google – although experiencing one search was enough for most people that I knew. The final box was to sign up to a monthly newsletter that would give updates on what developments Google was up to.

    From then on, I very rarely searched on Alta Vista, though my home page was still My Excite for a long time. This was more because I had my clients news set up on the page already and they had decent finance overage at the time.

    The difference in searches was really profound, there were a number of factors at work:

    • Google’s approach seemed to give consistently better results than the vectored approach taken by Excite or AltaVista.
    • There was no advertising on the SERP (search engine results page), but that was to soon change.
    • You could use very directed Boolean search strings, which isn’t possible any more since Google optimised for mobile.
    • Search engine optimisation wasn’t a thing yet.
    • The web while seeming vast at the time, was actually small compared to its size now. Web culture at the time was quirky and in aggregate nicer and more useful than it is now. Part of this was was down to the fact that early web had a good deal of 1960s counterculture about it. Wired magazine would write about the latest tech thing and also profile psychedelic experimenters like Alexander Shulgin. Cyberpunk, rave and psychedelic tribes blended and found a place online. You can see the carcass of this today with Silicon Valley’s continued love of Burning Man. (Note: there were rich dark seams if that was the kind of thing you were into. There wasn’t the same degree of social agglomeration that we now have, nor were there algorithms that needed constant new content to feed diverse realities.)
    • Content creation on the web was harder than it is now. Blogging was at best a marginal interest, the likes of Angelfire, AOL Hometown, Geocities and Tripod provided free hosting, but you couldn’t put up that much content to pollute the search index even if you wanted to.

    The impact was instantaneous and by early 1999, it was much a part of the nascent netizen culture as Terence McKenna.

    Homage to Terence McKenna

    McKenna spent the last bit of his life interrogating the search engine for four to five hours a day. He was convinced that the online world it provided access to represented some sort of global mind.

    Sometimes he treats the Net like a crystal ball, entering strange phrases into Google’s search field just to see what comes up. “Without sounding too cliché, the Internet really is the birth of some kind of global mind,” says McKenna. “That’s what a god is. Somebody who knows more than you do about whatever you’re dealing with.”

    As our society weaves itself ever more deeply into this colossal thinking machine, McKenna worries that we’ll lose our grasp on the tiller. That’s where psychedelics come in. “I don’t think human beings can keep up with what they’ve set loose unless they augment themselves, chemically, mechanically, or otherwise,” he says. “You can think of psychedelics as enzymes or catalysts for the production of mental structure – without them you can’t understand what you are putting in place. Who would want to do machine architecture or write software without taking psychedelics at some point in the design process?”

    Terence McKenna’s Last Trip – Wired.com (May 1, 1999)

    A year after that McKenna interview, Google was running over 5,000 Linux servers to power the search engine.

    At first, Google also powered search on some of the web portals and saw itself as a competitor to search appliance businesses like Inktomi and Autonomy. The advertising kaiju started operation in 2000 and it was tiny. This violated patents held by GoTo.com – a business subsequently acquired by Yahoo!.

    Post-bust

    Once Yahoo! had disentangled itself from the carnage of the dot com bust, search was a much bigger deal. And Google had become a behemoth in the space of a few years. In 2002, Google launched Google News – a direct challenge to web portals like Yahoo!, MSN and Excite. Around about this time Google started to be used as a verb for using a web search engine.

    While display advertising had taken a dive, search advertising had took off for several reasons:

    • It was performance marketing, even when a business is just surviving sales are important
    • Behavioural intent – if you were searching for something you were likely interested in it and may even purchase it
    • So easy to do at a basic level, even small and medium sized businesses could do it
    • Advertising dashboard – Google did a good job at helping marketers show where the advertising spend had gone.

    We’ll ignore on the difficult facts for the time being, for instance:

    • The role of brand building versus brand activating media
    • What attribution might actually look like
    • That Google advertising is a rentier tax, rather than a business generator

    Google listed on the stock market in August 2004. Investors ignored governance red flags like the dual share structure so the founders could retain voting rights.

    Yahoo! in the search wars

    Yahoo! had come out of the dot com bust battered but largely intact. Yahoo! was scarred in a few important ways.

    Identity crisis

    Yahoo! came about pre-Judge Jackson trial when Microsoft spread terror and fear into the boardroom of most sensible technology companies. I know that sounds weird in our iPhone and Android world. Rather than the bright cuddly people who give us Xbox, it was a rabid rentier with a penchant for tactics that organised crime bosses would have approved of. It took a long time to work that out of their system.

    Another big factor was the fear of Microsoft. If anyone at Yahoo considered the idea that they should be a technology company, the next thought would have been that Microsoft would crush them.

    It’s hard for anyone much younger than me to understand the fear Microsoft still inspired in 1995. Imagine a company with several times the power Google has now, but way meaner. It was perfectly reasonable to be afraid of them. Yahoo watched them crush the first hot Internet company, Netscape. It was reasonable to worry that if they tried to be the next Netscape, they’d suffer the same fate. How were they to know that Netscape would turn out to be Microsoft’s last victim?

    Paul Taylor – ex Yahoo and founder of Y-Combinator

    Yet Yahoo! went on to hire media mogul Terry Semel as it went through the dot com bust, shows that this thinking must have coloured views somewhat.

    Cheque book shy

    Even Mark Cuban would admit that Broadcast.com was not worth the billion dollar price tag that Yahoo! paid for it. It was a high profile mistake at the wrong point in the economic cycle which haunted Yahoo! acquisition plans for years. Which is one of the reasons why may have Yahoo! dropped the ball when it had the chance to buy Google and Facebook.

    The game has changed

    But the game had changed. Display advertising was no longer as profitable as it had been. Search advertising was the new hotness, fuelled by online commerce. By early 2004, Yahoo! is confident enough in its own search offering to drop Google who had been providing its search function.

    Yahoo! acquired search appliance business Inktomi in 2002 and then Overture Services in 2003. Overture services provides the basic ad buying experience for Yahoo! search advertising.

    In 2004, Yahoo! realises having search is not enough, you have to offer at least as good as product as Google, if not better. This is where Tim Mayer comes in and for the next couple of years he leads a project to build and maintain search parity with Google.

    You had a corresponding project on the search advertising side to bring the Overture buying experience up to par with Google with a large team of engineers. That became a veritable saga in its own right and the project name ‘Panama‘ became widely known in the online advertising industry before the service launched.

    Search differently

    Googling is a habit. In order to illicit behavioural change you would have to

    • Have an alternative
    • Change what it means to search in a positive way

    Yahoo! approached this from two directions:

    • Allowing different kinds of information to be searched, notably tacit knowledge. I worked on the global launch of what was to become Yahoo! Answers, that was in turn influenced by Asian services notably Naver Knowledge IN. This approach was championed internally by Jerry Yang.
    • Getting better contextual data to improve search quality providing a more semantic web. This would be done by labels or tags. In bookmarking services they allowed for a folksonomy to be created. In photographs it provided information about what the pictures or video content might be, style or genres, age, location or who might be in them.

    Web 2.0

    Alongside a search war there was a dramatic change happening in the underpinnings of the web and how it was created. While the dot com bust caused turmoil, it also let loose a stream of creativity:

    • Office space was reasonably priced in San Francisco only a couple of years after startups and interactive agencies had refurbished former industrial buildings South of Market Street (SoMo).
    • Office furniture was cheap, there was a surplus of Herman Miller Aeron chairs and assorted desks floating around due to bankruptcies and lay-offs.
    • IT and networking equipment was available at very reasonable prices on the second hand market for similar reasons. You could buy top of the range Cisco Catalyst routers and Sun Microsystems servers for pennies on the dollar that their former owners had paid for them less than one computing generation before. This surplus of supplies be bought online from eBay or GoIndustry.com.
    • Just in time for the internet boom wi-fi had started to be adopted in computers. The first wi-fi enabled laptop was the Apple iBook. Soon it became ubiquitous. Co-working spaces and coffee shops started to provide wi-fi access connected to nascent mainstream broadband. Which meant that your neighbourhood coffee shop could be a workspace, a meeting space and a place to collaborate. We take this for granted now, but it was only really in the past 25 years that it became a thing. It also didn’t do Apple’s laptop sales any harm either.
    • Open source software and standards gave developers the building blocks to build something online at relatively little financial cost. Newspapers like the Financial Times would have spent 100,000s of pounds on software licences to launch the paper online. In 2003, WordPress was released as open source software.
    • Amazon launched its web services platform that allowed developers a more flexible way for putting a product online.
    • The corresponding telecoms bust provided access to cheaper bandwidth and data centre capacity.

    All of these factors also changed the way people wrote services. They used web APIs building new things, rather than digital versions of offline media. APIs were made increasingly accessible for a few reasons:

    • Adoption of services was increased if useful stuff was built on top of them. Flickr and Twitter were just two services that benefited from third party applications, integrations and mashups. Mashups were two or more services put together to make something larger than the ingredients. The integration process would be much faster than building something from scratch. It worked well when you wanted to visualise or aggregate inputs together.
    • Having a core API set allowed a service to quickly build out new things based on common plumbing. Flickr’s APIs were as much for internal development as external development. Another example was the Yahoo! UK’s local search product combining business directory data, location data and mapping.
    local

    There was also a mindset shift, you had more real-world conferences facilitating the rapid exchange of ideas, alongside an explosion of technical book publishing. One of the most important nodes in this shift was Tim O’Reilly and business O’Reilly Publishing. Given O’Reilly’s ringside seat to what was happening, he got to name this all web 2.0.

    Finally, a lot of the people driving web 2.0 from a technological point of view were seasoned netizens who had been exposed to early web values. The following cohort of founders like Mark Zuckerberg were more yuppie-like in their cultural outlook, as were many of the suits in the online business like Steve Case or Terry Semel. But the suits weren’t jacked into the innovation stream in the way that Zuckerberg and his peers – but that would come later.

    This was the zeitgeist that begat Pipes by Yahoo.

    The approach to a new type of search needed the foundational skills of web 2.0 and its ‘web of data’ approach. Yahoo! acquired number of companies including Flickr, Upcoming.org and Delicious. At the time developers and engineers were looking to join Yahoo! because they liked what they saw at Flickr, even though the photo service was only a small part of the roles at the business.

    Web 2.0 talent

    The kind of people who were building new services over APIs were usually more comfortable in a scrappy start-up than the large corporate enterprise that Yahoo! had become. Yet these were the same people that Yahoo! needed to hire to develop new products across knowledge search, social and new services.

    There were some exceptions to this, for instance the 26-person team at Whereonearth who operated a global geocoded database and related technology had a number of clients in the insurance sector and Hutchison Telecom prior to being acquired by Yahoo!. The reason why Yahoo! became so interested was a specific Whereonearth product called Location Probability Query Analyser. The technology went on to help both the Panama advertising project and Yahoo! search efforts. George Hadjigeorgiou was tasked with helping them get on board.

    I knew some of the first Flickr staff based out of London, they sat alongside technologist Tom Coates who would later work on FireEagle. They all sat in a windowless meeting room on a floor below the European marketing team sat in.

    Most people didn’t even know that they were there, working away thinking about thinks like geotagging – a key consideration in where 2.0 services and mobile search.

    Going over to the Yahoo! campus in Sunnyvale made it clear to me that the difference in cultural styles was equally different over there, from just one cigarette break with Stewart Butterfield of Flickr.

    Secondly, there was the locale. The best way I found to help British and Irish people get the environment of Silicon Valley was to describe it as a more expansive version of Milton Keynes with wider roads and a lot more sunshine. One of the biggest shocks for me on my first visit to the Bay Area was how ordinary Apple and Google’s offices felt. (This was 1 Infinite Loop before Apple Park construction started). The canopy over the main building entrance looked like an airport Novotel, or every shopping centre throughout the UK.

    In the same way that Milton Keynes is not London; Silicon Valley’s quintessential campus laden town Sunnyvale is not San Francisco.

    This is not the dystopian doom spiral San Francisco city of today with failed governance and pedestrianisation projects. At this time, San Francisco was on the up, having been clobbered by the dot com bust in the early noughties, financial services had kept the city ticking over. Technology was on the rise again. Home town streetwear brand HUF was making a name for itself with its first shop in the Tenderloin, the DNA Lounge had consistently great nights from west coast rave and goth sounds to being a haven for mashup culture with its Bootie nights.

    There was great cinemas, vibrant gay night life and the sleaze of the Mitchell Brothers O’Farrell theatre. The Barry Bonds era San Francisco Giants won more than their fair share of baseball matches.

    If Yahoo! were going to keep talent, they’d need a place in the city. It makes sense that setting up the San Francisco space fell to Caterina Fake. Fake was co-founder of Flickr and was given a mandate by Jerry Yang to ‘make Yahoo! more like Flickr’. So she decided to set up an accelerator for new products.

    Brickhouse

    According to Caterina Fake on Threads:

    I dug around on the company intranet and exhumed an old deck for an initiative called “Brickhouse” which had been approved by the mgmt, but never launched.

    Caterina Fake (@cefake on threads)

    This tracks with my experience in the firm, projects would form make rapid progress and then disappear. And during the first dot com boom, San Francisco was home to online media companies, such as Plastic (Razorfish SF), Organic and Agency.com, many of whom also had offices in New York. Wired magazine had its office there, as did a plethora of start-ups.

    Fake goes on to say that Brickhouse managed to use the same office space she had worked in while she had worked at Organic over a decade earlier.

    The 60 Minutes episode Dot-com Kids marked an acme in this evolution of San Francisco. At the time Fake was doing this exercise, there was probably a Yahoo! sales team based in San Francisco proper, but that would be it.

    Fake cleans up the Brickhouse deck and gets it through the board again with Bradley Horowitz with the then Chief Product Officers Ash Patel and Geoff Ralston, president Sue Decker and chief Yahoo Jerry Yang being the board champions of the project.

    Fake hands off to Chad Dickerson to realise Brickhouse as she heads off on maternity leave. Fake, Dickerson and Horowitz assemble the Brickhouse team (aka the TechDev group) and ideas that would eventually build Pipes by Yahoo!, Fire Eagle and other projects.

    This is where my origins viewpoint on Pipes by Yahoo finishes. For the download on its creation, go here now; the link should open in a new tab and I will still be here when you get back to discuss the service’s impact.

    Pipes by Yahoo was launched to the public as a beta product on February 7 2007. Below is how it was introduced on the first post added to the (now defunct) Yahoo Pipes Blog. At this time product blogs became more important than press releases for product launches as information sources to both tech media and early adopters.

    Introducing Pipes

    What Is Pipes?
    Pipes is a hosted service that lets you remix feeds and create new data mashups in a visual programming environment. The name of the service pays tribute to Unix pipes, which let programmers do astonishingly clever things by making it easy to chain simple utilities together on the command line.

    Philosophy Behind the Project
    There is a rapidly-growing body of well-structured data available online in the form of XML feeds. These feeds range from simple lists of blog entries and news stories to more structured, machine-generated data sources like the Yahoo! Maps Traffic RSS feed. Because of the dearth of tools for manipulating these data sources in meaningful ways, their use has so far largely been limited to feed readers.

    What Can Pipes Do Today?
    Pipes’ initial set of modules lets you assemble personalized information sources out of existing Web services and data feeds. Pipes outputs standard RSS 2.0, so you can subscribe to and read your pipes in your favorite aggregator. You can also create pipes that accept user input and run them on our servers as a kind of miniature Web application.

    Here are a few example Pipes to give you an idea of what’s possible:

    • Pasha’s Apartment Search pipe combines Craigslist listings with data from Yahoo! Local to display apartments available for rent near any business.
    • Daniel’s News Aggregator pipe combines feeds from Bloglines, Findory, Google News, Microsoft Live News, Technorati, and Yahoo! News, letting you subscribe to persistent searches on any topic across all of these data sources.

    What’s Coming Soon?
    Today’s initial release includes a basic set of modules for retrieving and manipulating RSS and Atom feeds. With your help, we hope to identify and add support for many other kinds of data formats, Web services, processing modules and output renderings.

    Here are some of the things we’re already got planned for future releases:

    • Programmatic access to the Pipes engine
    • Support for additional data sources (such as KML)
    • More built-in processing modules
    • The ability to extend Pipes with external, user-contributed modules
    • More ways to render output (Badges, Maps, etc…)

    Pipes is a work in progress and we’ll need your help to make it a success. Try building some simple pipes and advise us what works well and what doesn’t in the online editor. Tell us how you’d like use Pipes, what we can do to make cool things possible, and show us ways you’ve found to use Pipes that never even occurred to us. In return, we promise to do our best to make Pipes a useful and enjoyable platform for creating the next generation of great Web projects.

    And please have fun!

    The Pipes Development Team

    Pipes impact

    I had a good, if exhausting time at Yahoo! It was first inhouse role and my part of the central marketing team had an exhausting workload. By the time Pipes by Yahoo launched, I had left Yahoo! Europe. There has been a re-organisation of European arm and the business had been ‘Kelkoo-ised’; a few of us on the European central marketing team took the opportunity to take the money and run.

    I remember bringing Salim (who headed the European search team) up to speed and getting his support to push for me getting a payout, rather than fighting my corner.

    Peanut Butter Memo

    Brad Garlinghouse’s peanut butter manifesto was made public towards the end of the year portraying a game of thrones type power play which would have seen the kind of structures that were put in place in the European organisation rolled out globally.

    On the face of it, some of it was pertinent, but it lacked a wider vision.

    While Garlinghouse has gone on to have a really successful career at Ripple; the Yahoo! business unit he ran had several problems. He was in charge of Music and the Comms & Community BU. At the time it had a poor record of building products fit for early adopters like music properties that aren’t Mac-compatiable, this was when the iTunes store and Apple iPod springboard off the Mac community and into the mainstream.

    The then new Yahoo! Mail which didn’t work on Safari and a Messenger client which was worse to use than third party clients like Trillium or Adium. All of which made it hard to build a buzz that will bridge to mainstream users. Yahoo! Messenger, could have been Skype or WhatsApp. It became neither.

    For a more modern example, think about the way Instagram and Threads were Apple iPhone first to build a core audience.

    At the time, I was less charitable about the memo. And the memo raised wider questions about the business; like was the CEO facing an executive revolt?

    The launch of Pipes by Yahoo helped to inject some more positive energy back into the Yahoo! brand. Remember what I said earlier on how talent wanted to join Yahoo!’s engineering and development teams because of Flickr. They started to want to join Yahoo! because of Pipes.

    The outside world

    I was back agency side when Pipes launched. I had friends within Yahoo! still and kept an eye on the various product blogs. I got the heads-up on Pipes and put aside an afternoon and an evening to explore it fully. A quick exploration gave one an idea of how powerful Pipes by Yahoo could be. While Pipes was powerful, it was also relatively user friendly, like Lego for data. It was more user friendly than Apple’s Automator, which inspired Pipes by Yahoo! in the first place.

    At this time in London the amount of people working on social media and online things was still relatively small. Knowledge was shared rather than hoarded at grassroots events and on an ecosystem of personal blogs. This was a group of eople with enquiring minds, a number of whom I can still call friends.

    We shared some of the public recipes on Pipes by Yahoo and learned from them, just as I had learned about Lotus 1-2-3 macros in the early 1990s, by picking through other peoples examples. (I put this to use automating data records in the Corning optical fibre sales support laboratory that I worked in at the time.)

    The agency I worked with had a number of large technology clients including AMD, Fujitsu Siemens personal computing devices – notably smartphones, parts of Microsoft and LG.

    AMD and Microsoft were keen to keep track on any mention of their brand in a number of priority blogs or news sites at the time. Social listening was in its infancy and there were a number of free tools available, which I got adept at using.

    We managed to build and sell both AMD and Microsoft respectively a custom feed which provided them with links to relevant content in near real-time, which they then published on an internal site so that key audiences always had their fingers on the pulse.

    This was all built on top of two free Pipes by Yahoo accounts which used a similar but tweaked recipes to make this happen.

    On the back of that work, we managed to sell in a couple of small websites to the Microsoft team based on WordPress. I had long moved on to another agency role by the time the Pipes by Yahoo feeds would have died.

    Discussing Pipes by Yahoo with friends, they said it had inspired them to learn to code. Pipes by Yahoo spurred creativity and creation in a similar way to HyperCard.

    Zeitgeist

    While all of this has talked about Pipes by Yahoo! and how great the launch was, the ending of Pipes was much more humdrum. The service had been glitchy at the best of times and wasn’t being maintained in the end. In conversations I had with friends, it was compared to a British sports car: unreliable but loveable. Yahoo! closed it down on September 30, 2015.

    Which begs the question, why is Pipes by Yahoo, which was shut down eight and a half years ago being celebrated amongst the digerati?

    I think that the answer to this is in the current online zeitgeist. The modern web isn’t something that anyone involved in web 2.0 would have signed up for. Algorithms have fragmented the global town hall archetype envisaged for social. The web no longer makes sense in aggregate, as it’s splintered by design.

    The modern web feels ephemeral in nature. This seems to have gone hand-in-hand with a video first web exemplified by TikTok.

    The social platforms the fragmentation seem to be declining in relevance and its isn’t clear what’s next. The people-driven web of knowledge search and web 2.0 is under pressure from AI content providing a mass of ‘just good enough’ content. Even influencers are being usurped by digital avatars. Even the audience engagement is often synthetic. All of which leaves the netizen in a state of confusion rather than the control that Pipes by Yahoo offered.

    Taylor Lorenz is a journalist who made net culture and platforms her beat. Taylor Lorenz’ book Extremely Online feels like she is reporting from another planet rather than the recent web and it was published in October last year.

    More information

    Mediasaurus no more? The Well

    Let’s Get This Straight: Yes, there is a better search engine | Salon.com (December 21, 1998)

    The Original GOOGLE Computer Storage Page and Brin

    Notre histoire en détail | Google

    How Google Became a Verb | TLF Translation

    Facebook Yahoo! patents case | renaissance chambara

    Yahoo! Answers Adoption | renaissance chambara

    Sadowski, J. (2020). “The Internet of Landlords: Digital Platforms and New Mechanisms of Rentier Capitalism.” Antipode 52 (2): 562-580.

    Amazon.com Launches Web Services; Developers Can Now Incorporate Amazon.com Content and Features into Their Own Web Sites; Extends ”Welcome Mat” for Developers | Amazon.com newsroom

    Nobody Knows What’s Happening Online Anymore – The Atlantic

    Extremely Online: The Untold Story of Fame, Influence and Power on the Internet by Taylor Lorenz

    The Age of Social Media Is Ending | The Atlantic

    AI is killing the old web, and the new web struggles to be born | The Verge

    Is the web actually evaporating? | Garbage Day

  • The Power Law by Sebastian Mallaby

    The Power Law lays out VC history

    The Power Law: Venture Capital and the Art of Disruption does for the technology venture capital industry what Accidental Empires and Where Wizards Stay Up Late did for the technologists that they financed.

    The Power Law

    About the author Sebastian Mallaby

    Prior to reading The Power Law Mallaby wasn’t a familiar name to me. Looking into his background I could see why, Mallaby is a Washington Post columnist and specialises in international economics for the Council of Foreign Relations. A perfect CV for a policy wonk. His previous works have included a biography of Alan Greenspan, the World Bank and a book on hedge funds.

    What the book doesn’t cover

    The origins of modern venture capital in the pre-second world war era was through the family offices of people like the Wallenbergs and the Rockefellers. The Power Law only picks up the story post-war and has a distinct US bias in its storytelling.

    Synopsis of The Power Law

    George Doriot

    Mallaby starts the story with Georges Frédéric Doriot and the American Research and Development Corporation (ARDC). What’s interesting Doriot is how he was different from today’s VCs with a focus on patriotism. Doriot is most famous for his funding of Digital Equipment Corporation (DEC), an enterprise computer company whose mini-computers facilitated the early internet and many business computer systems. At the time of DEC, the Boston area seriously rivalled the Bay Area as the technology centre.

    Treacherous eight

    As the book goes into the story of Arthur Rock and his relationship with the treacherous eight who left Bill Shockley’s lab, this is where many Silicon Valley histories start to coalesce with The Power Law. Mallaby adds a little more, such as the 600x return that both the eight and Rock enjoyed from their investment. At 96, Rock is still alive at the time of writing. He is more recently remembered for his involvement of firing of Steve Jobs from Apple in 1985, a good deal of this came down to his distaste for Jobs informal appearance.

    Sandhill Road

    Arthur Rock and former Doriot student Bill Draper benefited from being in the right place and at the right time. The US government looked to spur innovation as part of the cold war and the Bay Area was were much of this innovation would happen. Sequoia and Kleiner Perkins followed soon after, these names are now central to the Sandhill Road venture capital ecosystem, but in 1972 they were just starting off with businesses like Atari. Atari wasn’t started by experienced business professionals, but by a twenty something who thought meetings in the hot tub were a good idea. Atari marked a point in time when VCs had to become the adults in room, or as Mallaby put it ‘active investors’.

    What I didn’t realise at the time was how early in Kleiner Perkin’s history was their engagement with biotech pioneer Genentech. I didn’t realise that Genentech was funded before Apple and was more a peer of Tandem Computers. Much of the early networking was based on a two-way door between established venture funded firms that were descendants of the treacherous eight and early venture capital firms that employed experienced executives as partners.

    Apple was notable for two reasons. Firstly, venture capital firms operated for the first time rather like an insurance syndicate with several funding the business rather than one large investor. Secondly, the returns on Apple seems to have solidified the model and bought niche financing to a wider awareness beyond the geographic pockets of the technology industry. Where many books like Accidental Empires would use this as a jumping off point to tell the story of the PC industry. The Power Law instead talks about computer networking, this makes sense if one thinks of Metcalfe’s Law as the power law that matters the most in the internet age. The early east coast venture capital community were more cautious than their west coast counterparts, partly because the east coast technology corridor had less of a loose network of connections compared to the west coast. I think that the different business culture of the east coast also had an effect.

    Connectors

    Doerr connected Cypress Semiconductor and Sun Microsystems, two companies that Kleiner Perkins funded so that they would make the SPARC RISC microprocessor. You could put this as the starting point for the golden age of UNIX servers and workstations – which we can trace forward to today’s Mac range and modern Google servers.

    Doerr had attempted other alliances before and in this way we see a different way how Metcalfe’s Law was the power law of the title. VCs has access to several nodes that they could connect together to try and build a technical vision. This is different to the idea we’re usually sold of the tech visionary / company founder a la the Google founders, Mark Zuckerberg or Steve Jobs.

    Meanwhile Don Valentine of Sequoia Capital usurped the founders of Cisco Systems and brought in a new team to run the business bilking the founders out of much of their money. Part of this was down to one of the original Cisco founders being a woman.

    Government money

    The VC industry of the early 1990s capitalised on government money. Netscape was a remake of Mosiac which was the first graphic internet browser software developed in the NCSA software design group. This was part of the government-funded National Center for Supercomputing Applications (NCSA) at the University of Illinois. UUNET was a commercial ISP based on the back of the ARPANET email delivery system. As the dotcom boom took off it was the largest ISP and the fastest growing. UUNET eventually became part of MCI WorldCom and then Verizon, where UUNET remains a key part of the Verizon business offering. Both Netscape and UUNET were viewed at VC successes but as The Power Law shows, the reality was more complicated.

    Irrational behaviour

    I thought that the original dot.com boom was irrational behaviour, but I learned from the account of GO Computers a decade or so earlier that irrational behaviour is very much in the blood of venture capital, which explains how we had WeWork and Uber in the 2010s which is where The Power Law finishes its tale. The funny thing about the irrational behaviour is that both the dot com era and the 2010s Softbank appear to have been an accelerant with their late stage momentum approach to venture capital deals which blew valuations on businesses up far beyond what would be reasonably expected otherwise. Softbank gave birth to ‘growth equity’ as a business model that took in many existing and new VC businesses including Russian Israeli Yuri Milner and his DST Ventures business which invested in Facebook, Stripe and GroupOn.

    Paul Graham and Peter Thiel

    Paul Graham was a founder of an ad tech business who then moved over to investing and had a reputation for warning startup founders about the nature of VC funding. It fitted neatly into the ‘John Gaunt’ type narrative that played well with some of his peers like Peter Thiel. The impact of these people setting an ideological agenda of sorts for Silicon Valley founders, together with a plethora of other founders providing seed capital to businesses from Google onwards greatly impacted the freedom of VCs to operate using their previous models and left the industry open for the Softbanks of the world to inflate everything.

    China off-note

    The Power Law offers a largely truimphantist view of the role of VCs such as Sequoia Capital in China. However, this seems to ignore the impact of Chinese VC and angel investors. It also chooses to ignore the negative impact of Xi Jingping.

    Conclusion

    Mallaby illuminates part of Silicon Valley history that I wasn’t familiar with, in particular VCs strategic role in steering technological change during the 1990s. Time has somewhat outpaced the book. The rise of Xi Jingping and the change in attitude towards safety and innovation amongst young Chinese is likely to make the China section look overly optimistic. The end of easy money, at least for the time being will impact the VC industry globally and growth equity looks like a folly during the present time. But if you want to understand how things were The Power Law is the ideal book for you.

  • Measure What Matters by John Doerr

    I was recommended Measure What Matters by my friend and fellow ex-Yahoo Cathy Ma. Cathy found the book useful in her way through managing teams. In Measure What Matters, John Doerr explains the idea of objectives and key results or OKRs.

    Measure What Matters

    About John Doerr

    If you’ve worked in or around the Silicon Valley technology space from the PC age through to the 2010s Doerr’s name will have a passing familiarity to you. Doerr was a salesman at Intel in the 1970s, realised that there were too many good people ahead of him and took an over in venture capital instead. Doerr was involved in funding:

    • Compaq – Compaq kicked off the market for ‘IBM compatible’ PCs and made the first portable ‘IBM compatible’ PC. Soon after IBM was no longer the dominant player in personal computing leading to the Wintel duopoly. Compaq eventually offered a full range of large servers, workstations and PC when it acquired Digital Equipment Corporation and Tandem Computing. Compaq was in turn bought by H-P
    • Netscape – Netscape Communications mainstreamed the internet browser, email client, web servers and email servers. The server software lives on in Oracle’s product line via the Netscape – Sun Microsystems alliance. The browser indirectly carried on through an open source project Mozilla
    • Symantec – Symantec started off as a natural language processing company in the early 1980s, it became famous for its Mac antivirus software and then went into the DOS and Windows market after merging with Peter Norton Computing. It now has a consumer facing business called NortonLifeLock and the business focused software part of the business was sold to Broadcom
    • Sun Microsystems – Sun Microsystems started off as a UNIX workstation manufacturer. Over time they built up a healthy server and software business that supported much of the infrastructure of the web. They were instrumental in the evolution of several key computing technologies, among them Unix – which influenced parts of the macOS that I am typing this post on, RISC processors in your smartphone, thin client computing like Google Docs, and virtualised computing that is instrumental for cloud computing. Sun Microsystems workstations were popular with investment banks, telecoms companies and internet startups bought their servers. The company’s decline can be marked by the dot com crash. Oracle bought Sun Microsystems and their technology lives on
    • drugstore.com – was a first generation e-tailer in health and beauty products. Walgreens bought the business in 2011, and shut down the website five years later.
    • Amazon.com – needs no introduction
    • Intuit – Intuit sells financial software in the US. TurboTax helps Americans do their tax returns, Mint provides a personal finance dashboard for consumers and QuickBooks is accounting software for small and medium sized businesses
    • Macromedia – Macromedia was a software company that developed tools for creatives and programmers. It was eventually acquired by Adobe. Macromedia products live on in the Adobe product range
    • Google – the search engine.

    About OKRs

    For all of the companies that Doerr has funded he has advocated OKRs. The idea of OKRs came from Doerr’s colleague at Intel Andy Grove. OKRs are a collaborative process. The idea is that it is used with teams and the individuals who make up the teams. Management seeks to set challenging, ambitious goals with measurable results. The key results in OKRs are how you track progress towards the objective, create alignment within the team, and encourage engagement around measurable goals. They are also supposed to flex with circumstance, which is one of the key points of separation from Peter Drucker’s management by objectives (MBO).

    The first part of the book Measure What Matters explains the origin and process behind OKRs.

    You can get everything that you need in the first two chapters covering 35 pages.

    The Cult of OKR

    The rest of the book is a series of self aggrandising endorsements of OK from senior executives who are OKR advocates:

    • Larry Page of Alphabet
    • Bill Davidow of Intel
    • Sheryl Sandberg of Facebook
    • Bill Gates on The Gates Foundation

    It crosses the line for me and almost reads like a high water mark for Silicon Valley hubris; Doerr’s book was published in 2018. Three years later and:

    • Bill Gates is in the most trouble he has been in since the Judge Jackson ruling
    • Alphabet and Facebook are being assailed by regulators around the world
    • Intel looks like a shadow of its former self. Its fabrication process are three years behind competitors. Customers are designing their own chips and AMD is eating their lunch in high performance processors

    Secondly, Doerr’s book, whilst acknowledging Andy Groves role of OKR creator; fails to acknowledge that Andy gave a good descriptor of OKRs in his 1983 book High Output Management.

    I think one of the reasons that I am not that keen on Measure What Matters, is that the book doesn’t work for culturally as a non-American. Instead I would recommend Andy Grove’s own book High Output Management. More books that might be of interest here.

  • 25 technologies

    25 technologies that have come to prominence during the past quarter century and have changed the world. CNET came up with their own list. That inspired me to take a run at it and make my own list of 25 technologies.

    CNET’s list

    My list

    Apple iPhone

    SMS and instant messaging

    Wi-Fi

    Wi-Fi

    IoT (internet of things)

    Mobile broadband

    Voice assistants

    DOCSIS & DSL

    Bluetooth

    Bluetooth

    VPN (virtual private network)

    Voice recognition

    Bitcoin

    Search

    Blockchain

    SaaS (Software as a Service)

    MP3

    VoIP (voice (and video) over IP)

    Facial recognition

    Global navigation satellite systems

    Artificial intelligence

    OSS (open source software)

    Drones

    Email

    DNA testing

    XML (eXtensible Markup Language)

    Quantum computing

    JavaScript

    Social networking

    Social networking

    3D printing

    MPEG – (Moving Pictures Experts Group)

    Video streaming

    NFC – (near field communications)

    Apps

    Apps

    Autonomous vehicles

    2FA (2 factor authentication)

    RFID

    RFID

    Virtual reality

    Strong cryptography

    Video conferencing

    OCR

    E-cigarettes

    Machine learning

    Ransomware

    USB

    Music streaming

    CMOS sensors

     

    Looking over the list of things now, I can see that my ideas were about more foundational 25 technologies required to make the modern technology environment. I also have taken a more sanguine view on the 25 technologies.

    Bitcoin and blockchain didn’t make the cut. Most of the applications that people like IBM look at call for a ‘private blockchain’, which negates the distributed ledger benefit. It can’t handle as many transactions as an Oracle database as fast. Digital currency maybe a thing and central banks have been actively thinking about it, but I am less convinced by cryptocurrencies. Secondly, crypto currencies are exceptionally energy inefficient; which is important in a world trying to move towards a low carbon economy.

    With quantum computing it is just too early to tell. The technology is probably only where the digital computer was back in the 1940s. IBM have form in backing alternative forms of computing that haven’t panned out, like Josephson junctions, optical computing and gallium arsenide based computing. None of which have made it into mainstream computing.

    Back in the 1980s progress was made at a furious rate on superconducting materials, with a future promise of room temperature superconductors at some point in the future. Although the research gave use some novel materials, it has mostly made a difference in heavy hospital based medical equipment sensors. Hence my hesitation to get excited about technologies still in their relative infancy.

    Common items in the list of 25 technologies

    Wi-Fi – like many technologies, Wi-Fi didn’t suddenly spring forth from the ether. It was the child of several developments over three decades. The name itself came about in 1999, created by branding agency Interbrand. It meant nothing in and of itself except as a pun on ‘hi-fi’. The name and logo were important at the time as they were signs of compatability. A laptop with wi-fi could log on and use a network with the right security details. This changed IT and buildings dramatically. Before Wi-Fi, you needed ethernet cable, a modem, modem cables and socket adaptors. And you’d still need your laptop power brick as battery life was a lot poorer back then. Wi-Fi was easy to install and changed spaces, at home, at work and in between. If you had internet at home before brandband you were tethered to the telephone port; or the modem tethered to the telephone port. The Internet was used in a fixed space. At work you were tied to your desk and forget about working in a coffee shop if you needed to log on. Even the term log on implies a time when going on the internet was an active thing to do. Wi-Fi redefined all that, you could work wherever you wanted to in the house. Connect whatever devices you wanted. I still use ethernet at home for my computer and Apple TV, but I don’t have to. My laptop switches on to the Wi-Fi network when I move away from my desk. Wi-Fi was also critically important for smartphones. Mobile networks are patchy, even more so indoors, but with smartphones came the ability to route their cellular calls over wi-fi. This was first of use to Blackberry users and is now an option to be turned on with most modern smartphones. Logging on no longer had to be an active state, we became always on, all the time. Along the way Wi-Fi had to see off competition from a European standard called HyperLAN2. I worked on promoting Ericsson’s home hubs for that, lovely product design but it was going nowhere.

    Bluetooth

    While the origins of Bluetooth owe a lot to a couple of Ericsson engineers in the late 1980s. Much of what we now think of Bluetooth is down to a partnership that Ericsson and IBM did in 1997. They looked to incorporate a short link wireless connection between a laptop and a cellular phone. The cellular phone would then be used as a modem for basic email. At the time, the other options were a cable, or IrDA – an infra red connection. IrDA was supposed to have a one metre point-to-point connection. I found in practice that you had to to a third of that distance most of the time. This limitation at least made it secure. Bluetooth eventually made it to phones, laptops and headsets during the dot.com boom. A key driver in this was the more compact nature of lithium ion batteries. People found it disconcerting someone would be next to them apparently talking to no one. So Bluetooth headsets didn’t take off really well until people stopped using voice on phones so much. I was fortunate to go to the US on a business trip in 2006 and picked up a Jawbone headset. This was a major improvement in noise reduction and call quality, but I only ever used for Skype calls at home as I didn’t want to look like a doochebag boiler-room sales professional.

    Jawbone

    What’s amazing now is the sheer ubquity of Bluetooth. Industrial computing networks, medical technology, consumer electronics, gaming and electronic fences.

    Social networking

    Social networking as a concept had existed for as long as consumers had gone online. There was the bulletin board culture, forums, services that helped you build your own sites. Chat rooms kind of served the same role that Twitter hashtags do. 10 years ago, social networking was a place of interesting experiments. Localised solutions for different markets; Japan and Korea were way out in front doing mobile social. Mass adoption changed things. Now social is engrained in the fabric of society, like a bunion. What we didn’t get was the digital utopian dream of a harmonious global village, but the same grubby aspects of society accelerated through using a digital domain. The truth is no longer a universal concept.

    Apps

    Apps or more accurately an online app store and signed apps have changed computing. The app store first appeared in the early 1990s on NeXT computers. It was designed to manage intellectual property rights on digital media and software. The app store built on Unix-like system tools called a package manager. Palmix was an Indian web based app store aimed at PDA users. A year later NTT DoCoMo launched i-mode an online integrated app store for mobile phones. Vodafone, KPN and Nokia followed with stores soon after. Handango released the first on device store similar to the Apple App Store experience now.

    Its often forgotten that the original iPhone launched without an app store. Instead Apple thought the device would run web apps. Unless you were on wi-fi they weren’t great. Everyone had got caught up in web 2.0 fever, where by the miracle of Javascript and XML web pages were no longer catalogues but could do things. Palm made a similar mistake with its WebOS. Fortunately Apple did a pivot with iOS 2 and an app store was launched. But this didn’t stop mobile developers arguing and blogging for years afterwards about which was the best approach native apps or web apps. The thinking moderated a little and now hybrid apps make it into the mix as well.

    iphone

    Apple quickly realised that the app store was a winner and put it front and centre of its marketing.

    RFID

    It was originally used to track boxes in a warehouse and containers in a port. Technology brought the cost down so that it could track most items on a shop, or books in a library. Security guards walking a beat could tap and go at checkpoints and so could credit card payments. Pet could be returned to their owners thanks to an RFID pellet injected below the skin. In a secure lab that I worked in, it took a certain knack to swipe your card through the magnetic stripe reader and open the door. With RFID, it would be tap and go. In a post-9/11 world RFID tags went into every passport, changing immigration experience of air travel forever.

    My Oyster card for LDN & my Octopus card for HKG

    On a more prosaic level it sparked off several stored value transport cards including Oystercards in London and Octopus in Hong Kong. On average, they still get you through the turnstile faster than a phone app and NFC.

    The rest of the 25 technologies

    SMS and instant messaging

    The UK and US developed in very different ways during the late 1990s and into the 2000s. Thanks to the EU spending so much research and development money on getting second generation networks up and running. Meanwhile over the US there was a plethora of cellular network standards and mobile roaming a nightmare. Instead the US established an internet culture earlier. Free local calling made dial up internet popular. This meant that they developed an instant messaging culture, whilst Europe saw a similar surge around SMS messaging. Both provided training wheels for adoption of our current mobile messaging culture. SMS is still used as a lingua franca for smartphone messaging, by everyone from Amazon to airlines. Like email, tales of its demise are premature.

    Mobile broadband

    GSM or 2G democratised mobile phone usage, but it was limited by data bandwidth and data latency. Whilst it was rated as being similar to a dial-up modem it often felt way slower. It was only 2.5G (EDGE or EGPRS), 3 and 4G that made possible what we now take for granted as a mobile experience. With 2G, getting anything done took a real effort. Downloading text emails were painfully slow. And data was expensive. Mobile connections were worthwhile for specialist applications like news and sports photographers needing to get images as fast as possible for sale to picture desks. 3G promised video calls and TikTok-esque sports highlights. The reality was passible email and access to maps. It was around about this time that I no longer carried an A-to-Z atlas of London with me everywhere. You couldn’t have Instagram, WhatsApp, Google Maps, Siri or the weather without mobile broadband. These not only empowered services like downloads, streaming and video, but changed our relationship with the internet. Our relationship with bandwidth and real terms price drops were responsible for our always-on life as much as WhatsApp and Skype.

    Voice recognition

    As with many of our 25 technologies, voice recognition as we understand it now started with work done at Bell Labs. Back in the early 1950s, they managed to train a system to recognise a single voice dictating digits. From there voice recognition evolved in fits and starts. This innovation was predominantly driven by the telephone companies and the defence industry. 1990 was a pivotal year. Dragon Dictate – a personal computer based system was launched. AT&T deployed the Voice Recognition Call Processing service. AT&T service allowed calls to be routed without the involvement of a receptionist. This is usually the first line of a call centre experience, or when phone banking is used to validate online banking payments.

    It has become more important as smartphone interfaces have hidden the number pad on calls. Voice has also been an area where phone interfaces and home devices have tried to tap into. And for many they have worked reasonably well. I have personally found that the results have been more inconsistent for me. My Ericsson T39 from 2001 was able to recognise ‘Call <insert name>’ consistently; associating the name with a person in my speed dial list. Something that Siri struggles to do now. Siri manages to play me the headlines from the BBC and Google doesn’t seem to understand me at all.

    Ericsson T39

    The benefits of speech recognition moves forwards in fits and starts. The UK may prove trickier due to the relative volume of accents compared to the size of the population. And then you have people like me with an accent that has changed over time as I have moved around. Unconsciously adapting to my environment and losing some of the edges of my North of England and Irish upbringing.

    Search

    Like most people who have been using the internet since the mid-1990s, my experience was divided not by before and after Facebook. But before and after Google. Originally the web was so small that the original search engines worked remarkably well. I remember using them as part of my research process during my degree. As the internet grew the original search engines like Hotbot, AltaVista and Excite struggled to keep up. On to the scene came Google.

    Google changed the way that we found things on the web. Concepts like web rings and directories are now ancient history. Our relationship with the web was mediated through its search box and it became our gateway to the web. Search also changed our relationships with our devices. It inspired journaled index of computer drives as consumers expected answers to finding items on their computer with the same ease as the web. Search is now the primary way that I navigate my Mac and my iPhone. It is a design metaphor that will be with us for a long time.

    SaaS (software as a service)

    SaaS actually dates from before the web. IBM used to provide ‘time-sharing’ on mainframe computers, back before PCs were a thing. Supercomputers in many academic institutions still provide the same kind of function for organisations looking to do market or economic modelling. The internet however, provided a new way of connecting with time-shared resources. Eventually virtualisation broke out the major blockage that every user needed a separate instance of a software application to run on. Web 2.0 pioneer Oddpost – a paid for email service offered new levels of functionality. Oddpost used Javascript and XML to provide a desktop like application experience in the browser. Google extensively copied these ideas for Gmail two years later.

    This then opened the door for the modern versions of Salesforce, e-Days, Workday and other SaaS. This software was now available for smaller businesses that couldn’t support running the applications on premises. SaaS, XML and Javascript are intimately connected in my choice of 25 technologies.

    VoIP

    Voice over Internet Protocol (VoIP) was first used in the early 1970s to pipe instructions into a flight simulator over the ARPANet. It really found its feet in 1991 with the first software programme allowing VoIP communications. The following Commuique was released which was like a Zoom analogue. As the commercial internet rolls out in the US, Israeli firm VocalTec releases its ‘Internet Phone’ application. Soon after the ITU looks at VoIP standards. The rise of the internet led to alternative telcos that routed voice minutes over data networks – a mix of old and new telecoms.

    I started my agency career working on one such alternative telco that used technology from Israeli VoIP start-up deltathree. At this time, the price of voice calls declined precipitously; particularly for international calling at the expense of quality. The industry attracted numerous spivs. The SIP standard was developed as an analogue for SS7 in voice and video calls.

    With 3G phones and a modicum of good interface design drove VoIP calls over services like Skype and Vonage. This was displaced in terms of popularity by a new generation of mobile first services like Viber, WhatsApp and FaceTime. Zoom built on this base for its conference call platform. In the meantime, telecoms providers have tried to reinvent themselves. Some with more success than others.

    Global navigation satellite systems

    The US highlighted the impact of global navigation satellite systems with its military’s use of GPS during the first Gulf War.

    After the Gulf War, non-defence usage came into focus. Telematics and navigation. GPS also provided timing to a diverse range of technologies from mobile networks. to ATM machines. In the early 2000s. PDA manufacturers like Fujitsu manage to integrate GPS modules into their PDA (personal digital assistant) devices. Nokia’s N95 smartphone, was the first popular device with a built in GPS receiver and this spurred the adoption of maps on a smartphone.

    Now the use cases are limitless as smartphone apps can tap into location data when a person is outside a building. The next step is accurate indoor location positioning – all be it, no longer relying on satellite signals.

    OSS

    Open Source Software (OSS) is pervasive in the modern day. This blog runs on OSS (Linux, Apache, MySQL and PHP). The Mac that I write this post on is based on OSS (Darwin, Mach microkernel, FreeBSD). The web browser is based on a branch of KDE Conqueror called WebKit and that’s the same with the iPhone and iPad as well. If you’re using an Android phone its based on Linux. Even smart home light bulbs run Linux.

    The rise of OSS went hand-in-hand with the web. Widespread doption started in server software that worked with open standards. Pretty soon you saw attempts to put it elsewhere. Desktop Linux including Netbooks – lightweight low power laptops. Ideal for checking your email or surfing the web. At the same time Apple had transitioned from the ‘Classic’ MacOS to something based on NeXTSTEP – acquired with NeXT Computer. Motorola and other manufacturers put it into mobile phones – as forerunners of the modern smartphone. From there it went into Sony PlayStation 3 console. As globalisation drove electronics manufacturing to China; manufacturers of all kinds of gadgets saw the benefits of Linux – even if they didn’t honour the law and spirit of open source cough, cough Huawei…

    Email

    Despite Facebook owning all our data, email is the key identifier. The identifier that you log into your Amazon account, log on to Netflix with and countless other services. Despite email being dead and countless other services being layered on top to replace it, its still very much alive. My own email account has selected correspondence that goes back to 2001.

    Email marketing statistics are declining in effectiveness yet its still a very effective medium. Just look at businesses like ASOS.

    Our relationship with email changed. When I left college, I had signed up for an online account with Yahoo! I could keep in touch with friends and apply for jobs. The email address went on my CV and I went to a cyber cafe Liverpool with a disc full of email messagess to send every Saturday. I usually had coffee and carrot cake with a friend whilst I sent it. We’d then go into the shopping district of central Liverpool to chat and do some window shopping.

    Working in an office, I could check my personal email at lunch time. Home broadband meant that I could check my account at home. Move forward ten years and email is in the palm of our hands, everywhere we go. I managed to get email to work on a Nokia 6600. You can see a surge in Gmail accounts that coincides with the rise in popularity of smartphones.

    Yahoo! Mail, Hotmail and Gmail users over time

    XML

    XML (and JSON) are ways of getting formatted data on to a webpage and allowing the page to become an app. Portability of data is now a foundational technology for the modern web. Want an app or web page that uses data, like the weather forecast or a spreadsheet. It will have XML like feeds in the background. It is so pervasive alongside Javascript that it is more like data as a utility. Electric cabling or indoor plumbing would be a good real world analogy.

    Prior to XML and Javascript, a web page would have to be completely refreshed to show updates. There were software as a service applications running on the web; but they were painful. I know, I was a beta tester for an early version of an IPG company’s real time reporting tool. Every agency person knows the pain of time tracking, but time tracking when the page had to constantly update was ten times worse. I know, I was there.

    JavaScript

    The modern web, where web pages function as an app is down to the use of a group of technologies one of which is JavaScript. JavaScript is a programming language that alters the in-browser behaviour of a web page. When this was combined with formatted data such as XML or JSON it allows a web page to perform as a piece of software. You make a change and the page doesn’t need to refresh, thus improving responsiveness. The potential of it first became obvious with a web email application called Oddpost. Oddpost was a subscription based email service. What you paid your $2.99 a month for was a web interface that thanks to JavaScript and XML worked just like a desktop app. It was Internet Explorer only, which gives you an idea how close Microsoft came to extending their monopoly from Windows to web browsers. Oddpost was eventually acquired by Yahoo! and inspired the launch of Gmail two years later. From there you got self-service enterprise apps like e-Days and Workday. JavaScript has proved surprisingly resilient and that’s why it makes the 25 technologies from the past 25 years.

    MPEG

    MPEG stands for Motion Picture Experts Group, which is responsible for pretty much every form of audio and video format that we use today. Whilst the technology might come from a multitude of sources, MPEG set standards are invaluable for it. Whether its digital radio, online radio, digital physical media like Blu-Ray and DVD or streaming media MPEG has had an outsized influence. It also relates directly to voice and video communications codecs, hence their place in the 25 technologies. If you’ve done a FaceTime call, listened to Spotify or watched a movie you can thank MPEG.

    NFC

    Near-field communications (NFC) offers a way of using devices as authentication. It has really come to its own in smartphones where they serve as contactless digital wallets, access passes and digital car keys. Admittedly mobile wallets have a poor experience and its frightening to think that you wouldn’t be able to get into your car because someone couldn’t be bothered to maintain the Android or iOS app. Yet whether we like it or not NFC has become part of our tech eco-system. I would have preferred if I didn’t have to put into this list of 25 technologies, but I had to acknowledge its impact.

    2FA

    Over the past ten years, two factor authentication (2FA) has gone from being an enterprise level security tool to consumer grade security. The traditional RSA dongle with its constantly changing number codes was a status symbol of the corporate road warrior alongside Tumi luggage and a Blackberry. Now we get those numbers via a smartphone app or by SMS. This has happened as online identity theft and data breaches have become commonplace and massive databases of passwords have been cracked. 2FA regrettably therefore ended up in one of my 25 technologies.

    Strong cryptography

    It’s hard to convey how pervasive strong cryptography has become. Up to a 1/4 of users online currently use a VPN application which encrypts their web traffic. Web connections between a site and a browser are now encrypted more often than not. If you’ve ever done online backing, or bought something online with your credit card you’re using strong cryptography. My laptop uses Apple’s FileVault to encrypt the drive completely. Messaging via iMessage, WhatsApp, Signal or Silent Phone all use strong cryptography. Back in the early 1990s, strong cryptography was seen as a weapon, it was limited in its export. I strongly recommend reading Steven Levy’s Crypto to find out how we got here. I remember when Lotus Notes came with weaker encryption outside the US during the dot com era. Now I am leery of using any communications platform that doesn’t have strong cryptography. In fact, when I freelanced encryption was an important consideration for my even being able to get professional insurance. Its now a core part of business, so is one of my 25 technologies.

    OCR

    Optical character recognition (OCR) is technology that has been around for decades. In its modern sense, the start of it is around 1974 with entrepreneur Ray Kurzweil. Now its a foundational technology for many leading edge applications:

    • Interpreting the real world (billboards, road signs, automatic number plate readers)
    • Real time translation (using Google translate to read restaurant menus etc)
    • Digitisation of books and manuscripts (Google Books)
    • handwriting recognition and pen computing
    • Making digitised documents searchable

    All of this helps technology to interact with the real world in near real time. You need it for many of the wide range of future technologies that are envisaged. The slow rise of a web-of-no-web where the real world is blended with the online world is possible because of multiple technologies from GPS and QRcodes to optical character recognition. For its use in Google Translate alone, it would be enough to make it into this list of 25 technologies from the last 25 years.

    Machine learning

    When people talk about artificial intelligence they usually mean machine learning. Google and other companies are applying techniques that were developed at the University of Toronto in the 1980s during an AI winter. The idea is that if you show a computer programme enough pictures with cats, it will recognise cat attributes as a pattern and recognise them in the future. Its a very particular skill which is the reason why machine learning has offered so much promise and let us down at the same time.

    I talked about an AI winter. That’s a time when there was a dearth of spending in artificial intelligence research. We’ve had several cycles of massive government investment and withdrawal as AI historically failed to deliver.

    So under the right circumstances, machine learning can count craters on lunar photography or likely cancerous tumours in X-ray imagery. Yet machine intelligence struggles to recognise what I ask. AI driven ad platforms get targeting hilariously wrong. It mirrors some of the fuzzy logic capabilities of Japanese consumer electronics: the auto focus camera, lifts that optimise for traffic flow in tall buildings or the microwave that knows how long to cook your food for. This was based off a mathematical paper published in 1965 by an academic at UC Berkeley.

    Moore’s Law and the worry of digital disruption has pushed machine learning adoption, the results may disappoint; but realpolitik will keep it in play. It will be the most invisible of the 25 technologies listed, you will feel its impact rather than you seeing it.

    USB

    The shock of seeing the floppy disk disappearing and the use of the USB on the first iMac would have been enough to get it on list this of 25 technologies. Computing before USB was messy. There was a range of ports for different things. Connecting a printer, connecting a keyboard and connecting an external hard drive or CD ROM drive all required different sized cable connectors. When you were setting up a computer, it would be clearly labeled on the back of the machine what its function was. I had cables which had ideograms that were moulded on the top of them which came with the Macs that I owned.

    CMOS sensors

    CCD sensors had been invented over 50 years ago. If you had asked me about 25 technologies, back when I was a teenager CCD would have been very close to the top of the list. They were well understood and had been incorporated in video cameras since at least the early 1980s. CCD sensors offered better quality, but had issues with lag. Techniques designed to deal with this helped the performance of CMOS sensors. CMOS sensors were invented by NASA’s Jet Propulson Lab building on work that Olympus did in the 1980s. First it went into mice, then into low end cameras. The technology got better all the time. Doing more in less space with less power. Eventually they went into webcams and cellphones. Nowadays, you’re only like to see CCDs in very particular use cases now. CMOS sensors are everywhere in modern life; even high end photography equipment like PhaseOne.

    What would be in your 25 technologies, how would they differ from mine or CNet’s?

  • The OSS post

    I guess where I should start this post in OSS is by going back. This time 20 years ago, we were in a time of economic irrational exuberance so large as to be like a fairy tale in comparison to Brexit and the coronavirus.

    Irrational exuberance

    Everyone believed that the future was going to be rebuilding the catalogue shopping business online. Consumers would have a raft of choice.

    Japanese newsprint

    Advertisers were going to swap print and TV advertising for banner ads. Something that looked like small advertisements on the pages of newspapers at the time. Because of this, online display advertising was over-priced and everyone was happy.

    In order to do these businesses, you needed a lot of servers and a lot of software. If you had the money you bought really good software and servers from Silicon Valley. Companies like Sun Microsystems, Silicon Graphics or Digital Equipment Corporation. These all ran variants of the Unix operating system.

    If you were less fortunate you might be running on an Intel server running Windows NT, anything by IBM or repurposing a Mac from the design studio. The Mac made a surprisingly robust server solution mainly because the computer was so ‘dumb’. There wasn’t a lot that hackers could do to it at the time.

    True hackers

    People who were hackers in the truest sense realised that you didn’t have to pay for software to run on servers. If you knew where to go and had the right technical chops, you could have robust server software. You could end up paying good money to Microsoft and still need to use three times the amount of servers for a given load because Windows didn’t handle multiple threads as well. It couldn’t do as much ‘work’ as free software. You would get even more benefit if you were skilled enough to see how you could tweak it to meet your needs. Online communities also meant that you would find fellow travellers interested in similar tweaks and would collaborate with you.

    A classic example of this would be Hotmail. Hotmail was founded on NetBSD servers and it took years for Microsoft to migrate away from it due to performance and scaling issues with Microsoft’s own software.

    Yahoo! which used and contributed to various OSS projects including:

    • Debian Linux and later moved to an adapted version of Red Hat Linux
    • FreeBSD
    • PHP

    A peer of Yahoo!’s founders David Filo and Jerry Yang, decided to make hacking together servers and web services easier for businesses and technologists. The founder was called Larry Augustin and the company he founded was VA Linux. VA Linux built workstations and servers for websites. VA Linux is now most famous for the largest opening day price increase on the NASDAQ; but they made seem really great computers.

    For smaller businesses, a small start-up called Cobalt Networks came up with a relatively friendly server that could sit in the corner of an office called the Qube. This was popular in a number design offices as a file server and also ran numerous websites. As well as the cute form-factor, it made OSS more approachable for a lot of businesses and changed expectations about IT complexity.

    Cobalt Qube 2
    Cobalt Qube

    I was working on a mix of telecoms, enterprise and consumer technology clients. One of my clients . By the time I was working with VA Linux in April 2000, open source software (OSS) was a hot ticket. And both Cobalt Networks and VA Linux were at the forefront.

    At this time OSS, in particular the Linux operating system was endorsed by IBM with a $1 billion investment in the community. This helped adoption by other large business technology companies including Oracle, SAP and Sun Microsystems.

    IBM and Linux

    Suddenly it was OSS everywhere. My client Palm was trying to move its photo-smartphone operating system to Linux underpinnings.

    Where was Microsoft in all this?

    Its hard to explain to someone under 30 how dominant Microsoft was a business at the time. They were steadily working towards a goal outlined by Bill Gates and Paul Allen in the mid-1970s

    A computer on every desk, and in every home, running Microsoft software.

    Paul Allen and Bill Gates, 1974 – 1975

    Bill Gates wasn’t a cuddly billionaire who wanted to give the world toilets, but a dodgy looking technocrat who made Mark Zuckerberg seem human.

    https://youtu.be/-hRUAdi3g5g

    Microsoft had won the PC industry and was looking to extend itself into every aspect of business and home life. Microsoft injected investment into Apple at a time when the company was days away from bankruptcy. This made sense for a number of reasons:

    • The Apple Microsoft Office business was worth more than the investment into Apple
    • The deal allowed Microsoft to settle a number of patent disputes
    • It was a cheap distribution deal for the Microsoft Internet Explorer browser

    The disappearance of Apple would have had serious issues in terms of antitrust regulation in the US into Microsoft’s core Windows business.

    They’ve done a great job. They’re a company that’s done a great job. If you go back to 1997, when Steve came back, when they were almost bankrupt, we made an investment in Apple as part of settling a lawsuit. We, Microsoft made an investment. In a way, you could say it might have been the craziest thing we ever did. But, you know, they’ve taken the foundation of great innovation, some cash, and they’ve turned it into the most valuable company in the world.

    Former Microsoft executive Steve Ballmer on the Apple investment

    Back then Bill Gates was the Mark Zuckerberg or the Sergei Brin of his day and even he almost missed the importance of the world wide web and the internet. Gates was paranoid about the next thing coming along and sweeping all his success away.

    The internet represented one such threat.

    Gates is as fearful as he is feared, and these days he worries most about the Internet, Usenetand the World Wide Web, which threaten his software monopoly by shifting the nexus of control from stand-alone computers to the network that connects them. The Internet, by design, has no central operating system that Microsoft or anybody else can patent and license. And its libertarian culture is devoted to open—that is to say, nonproprietary—standards, none of which were set by Microsoft. Gates moved quickly this year to embrace the Net, although it sometimes seemed he was trying to wrap Microsoft’s long arms around it.

    Headliners: Bill Gates. – Time magazine. December 25, 1995

    OSS represented a second such threat. Microsoft’s sales of enterprise software for businesses and other organisations was a high margin business. OSS was a threat to that business. Back in 2001, I started working with colleagues at an agency who were asked to deposition OSS products and the the underlying legal agreement (the GPL).

    I was asked by my colleagues to write a briefing document of what OSS actually meant. It didn’t g0 down that well as it outlined the challenge of assailing an idea and a committed community. That didn’t stop our client Microsoft trying, mostly at the C-suite and policy level.

    The problem was that it didn’t offer a better alternative. And so we come forward 20 years: Microsoft: We Were on ‘The Wrong Side of History’ With Open Source – ExtremeTech which captures the highlights of Microsoft president Brad Smith talking at MIT a week ago.

    More information

    Yahoo: The Linux Company | ZDNet

    A Brief History of Search Advertising | Searchengineland

    MS Hotmail servers begin switch from FreeBSD to Win2k | The Register and Microsoft Hotmail still runs on U**x | The Register – this give you an idea of how critical and high-performing NetBSD is as an operating system.

    Barbarians led by Bill Gates by Jennifer Edstrom

    Report Flays Open-Source Licenses | Wired

More posts