The Industrial Revolution, started in the middle of the 18th century, transformed the world. It marks the start of a major turning point in history that would influence almost every aspect of daily life. The Industrial Revolution meant the shift from handmade to machine-made products and increased productivity and capacity. Technological change also enabled the growth of capitalism. Factory owners and others who controlled the means of production rapidly became very rich and working conditions in the factories were often less than satisfactory. It wasn't until the 20th century, 150 years after its beginning, that the Industrial Revolution ended creating a much higher standard of living than had ever been known in the pre-industrial world. Consumers benefited from falling prices for clothing and household goods. The impact on natural resources, public health, energy, medicine, housing and sanitation meant that chronic hunger, famines and malnutrition started to disappear and the life expectancy started to increase dramatically.
An undesired side-effect of the Industrial Revolution is that instead of utilizing artisans to produce hand-made items, machines started to take the place of the artisans. Before the industrial revolution, custom-made goods and services were the norm. The one-on-one relationships that guilds had with their customers sadly got lost in an era of mass-production. But what is exciting me about the world today is that we're on the verge of being able to bring back one-on-one relationships with our customers, while maintaining increased productivity and capacity.
As the Big Reverse of the Web plays out and information and services are starting to come to us, we'll see the rise of a new trend I call "B2One". We're starting to hear a lot of buzz around personalization, as evidenced by companies like The New York Times making delivery of personalized content a core part of their business strategy. Another recent example is Facebook testing shopping concepts, letting users browse a personal feed of clothing and other items based on their "likes". I'd imagine these types of feeds could get smarter and smarter, refining themselves over time as a user browses or buys. Or just yesterday, Facebook launched Notify, an iOS app that pushes you personalized notifications from up to 70 sites.
These recent examples are early signs of how we're evolving from B2C to B2One (or from B2B2C to B2B2One), a world where all companies have a one-on-one relationship with their customers and personalized experiences will become the norm. Advances in technology allow us to get back what we lost hundreds of years ago in the Industrial Revolution, which in turn enables the world to innovate on business models. The B2One paradigm will be a very dramatic shift that disrupts existing business models (advertising, search engines, online and offline retailers) and every single industry.
For example, an athletic apparel company such as Nike could work sensor technology into its shoes, telling you once you've run a certain number of miles and worn them out. Nike would have enough of a one-on-one relationship with you to push an alert to your smartphone or smartwatch with a "buy" button for new shoes, before you even knew you needed them. This interaction is a win-win for both you and Nike; you don't need to re-enter your sizing and information into a website, and Nike gets a sale directly from you disrupting both the traditional and online retail supply chain (basically, this is bad news for intermediaries like Amazon, Zappos, clothing malls, Google, etc).
I believe strongly in the need for data-driven personalization to create smarter, pro-active digital experiences that bring back one-on-one relationships between producers and consumers. We have to dramatically improve delivering these personal one-on-one interactions. It means we have to get better at understanding the user's journey, the user's context, matching the right information/service to the user and making technology disappear in the background.
Algorithms are shaping what we see and think -- even what our futures hold. The order of Google's search results, the people Twitter recommends us to follow, or the way Facebook filters our newsfeed can impact our perception of the world and drive our actions. But think about it: we have very little insight into how these algorithms work or what data is used. Given that algorithms guide much of our lives, how do we know that they don't have a bias, withhold information, or have bugs with negative consequences on individuals or society? This is a problem that we aren't talking about enough, and that we have to address in the next decade.
In the past several weeks, Volkswagen's emissions crisis has raised new concerns around "cheating algorithms" and the overall need to validate the trustworthiness of companies. One of the many suggestions to solve this problem was to open-source the software around emissions and automobile safety testing (Dave Bollier's post about the dangers of proprietary software is particularly good). While open-sourcing alone will not fix software's accountability problems, it's certainly a good start.
As self-driving cars emerge, checks and balances on software quality will become even more important. Companies like Google and Tesla are the benchmarks of this next wave of automotive innovation, but all it will take is one safety incident to intensify the pressure on software versus human-driven cars. The idea of "autonomous things" has ignited a huge discussion around regulating artificially intelligent algorithms. Elon Musk went as far as stating that artificial intelligence is our biggest existential threat and donated millions to make artificial intelligence safer.
While making important algorithms available as Open Source does not guarantee security, it can only make the software more secure, not less. As Eric S. Raymond famously stated "given enough eyeballs, all bugs are shallow". When more people look at code, mistakes are corrected faster, and software gets stronger and more secure.
Automobiles aside, there is possibly a larger scale, hidden controversy brewing on the web. Proprietary algorithms and data are big revenue generators for companies like Facebook and Google, whose services are used by billions of internet users around the world. With that type of reach, there is big potential for manipulation -- whether intentional or not.
There are many examples as to why. Recently Politico reported on Google's ability to influence presidential elections. Google can build bias into the results returned by its search engine, simply by tweaking its algorithm. As a result, certain candidates can display more prominently than others in search results. Research has shown that Google can shift voting preferences by 20 percent or more (up to 80 percent in certain groups), and potentially flip the margins of voting elections worldwide. The scary part is that none of these voters know what is happening.
And, when Facebook's 2014 "emotional contagion" mood manipulation study was exposed, people were outraged at the thought of being tested at the mercy of a secret algorithm. Researchers manipulated the news feeds of 689,003 users to see if more negative-appearing news led to an increase in negative posts (it did). Although the experiment was found to comply with the terms of service of Facebook's user agreement, there was a tremendous outcry around the ethics of manipulating people's moods with an algorithm.
In theory, providing greater transparency into algorithms using an Open Source approach could avoid a crisis. However, in practice, it's not very likely this shift will happen, since these companies profit from the use of these algorithms. A middle ground might be allowing regulatory organizations to periodically check the effects of these algorithms to determine whether they're causing society harm. It's not crazy to imagine that governments will require organizations to give others access to key parts of their data and algorithms.
The explosion of software and data can either have horribly negative effects, or transformative positive effects. The key to the ethical use of algorithms is providing consumers, academics, governments and other organizations access to data and source code so they can study how and why their data is used, and why it matters. This could mean that despite the huge success and impact of Open Source and Open Data, we're still in the early days. There are few things about which I'm more convinced.
It's hard to ignore the strong force of digital distributors on the open web. In a previous post, I focused on three different scenarios for the future of the open web. In two of the three scenarios, the digital distributors are the primary way for people to discover news, giving them an extraordinary amount of control.
When a small number of intermediary distributors get between producers and consumers, history shows us we have to worry -- and brace ourselves for big industry-wide changes. A similar supply chain disruption has happened in the food industry, where distributors (supermarkets) changed the balance of power and control for producers (farmers). There are a few key lessons we can take from the food industry's history and apply them to the world of the web.
When food producers and farmers learned that selling directly to consumers had limited reach, trading posts emerged and began selling farmers' products more than their own. As early as the 14th century, these trading posts turned into general stores, and in the 18th century, supermarkets and large-scale grocery stores continued that trend in retailing. The adoption of supermarkets was customer-driven; customers benefit from being able to buy all their food and household products in a single store. Today, it is certainly hard to imagine going to a dozen different speciality stores to buy everything for your day-to-day needs.
But as a result, very few farmers sell straight to consumers, and a relatively small amount of supermarkets stand between thousands of suppliers and millions of consumers. The supermarkets have most of the power; they control how products are displayed, and which ones gain prominent placement on shelves. They have been accused of squeezing prices to farmers, forcing many out of business. Supermarkets can also sell products at lower prices than traditional corner shops, leading to smaller grocery stores closing.
In the web's case, digital distributors are the grocery stores and farmers are content producers. Just like supermarket consumers, web users are flocking to the convenience and relevance of digital distributors.
Web developers and designers devote a tremendous amount of time and attention to creating beautiful experiences on their websites. One of my favorites was the Sochi Olympics interactive stories that The New York Times created.
That type of experience is currently lost on digital distributors where everything looks the same. Much like a food distributor's products are branded on the shelves of a supermarket to stand out, publishers need clear ways to distinguish their brands on the “shelves” of various digital distribution platforms.
While standards like RSS and Atom have been extended to include more functionality (e.g. Flipboard feeds), there is still a long way to go to support rich, interactive experiences within digital distributors. As an industry, we have to develop and deploy richer standards to "transport" our brand identity and user experience from the producer to digital distributor. I suspect that when Apple unveils its Apple News Format, it will come with more advanced features, forcing others like Flipboard to follow suit.
In China, WeChat is a digital distributor of different services with more than 0.5 billion active users. Recently, WeChat blocked the use of Uber. The blocking comes shortly after Tencent, WeChat's parent company, invested in rival domestic car services provider Didi Kuaidi. The shutdown of Uber is an example of how digital distributors can use their market power to favor their own businesses and undermine competitors. In the food industry, supermarkets have realized that it is more profitable to exclude independent brands in favor of launching their own launching grocery brands.
Digital distributors have an enormous amount of power through their ability to manipulate curation algorithms. This type of control is not only bad for the content producers, but could be bad for society as a whole. A recent study found that the effects of search engine manipulation could pose a threat to democracy. In fact, Google rankings may have been a deciding factor in the 2014 elections in India, one of the largest elections in the world. To quote the study's author: "search rankings could boost the proportion of people favoring any candidate by more than 20 percent -- more than 60 percent in some demographic groups". By manipulating its search results, Google could decide the U.S. presidential election. Given that Google keeps its curation algorithms secret, we don't know if we are being manipulated or not.
Finally, a last major fear is control of monetization. Like supermarkets, digital distributors have a lot of control over pricing. Individual web publishers must maintain their high quality standards to keep consumers demanding their work. Then, there is some degree of leverage to work into the business model negotiation with digital distributors. For example, perhaps The New York Times could offer a limited-run exclusive within a distribution platform like Facebook's Instant Articles or Flipboard.
I'm also interested to see what shapes up with Apple's content blocking in iOS9. I believe that as an unexpected consequence, content blocking will place even more power and control over monetization into the hands of digital distributors, as publishers become less capable of monetizing their own sites.
I've spent a fair amount of time thinking about how to win back the Open Web, but in the case of digital distributors (e.g. closed aggregators like Facebook, Google, Apple, Amazon, Flipboard) superior, push-based user experiences have won the hearts and minds of end users, and enabled them to attract and retain audience in ways that individual publishers on the Open Web currently can't.
In today's world, there is a clear role for both digital distributors and Open Web publishers. Each needs the other to thrive. The Open Web provides distributors content to aggregate, curate and deliver to its users, and distributors provide the Open Web reach in return. The user benefits from this symbiosis, because it's easier to discover relevant content.
As I see it, there are two important observations. First, digital distributors have out-innovated the Open Web in terms of conveniently delivering relevant content; the usability gap between these closed distributors and the Open Web is wide, and won't be overcome without a new disruptive technology. Second, the digital distributors haven't provided the pure profit motives for individual publishers to divest their websites and fully embrace distributors.
However, it begs some interesting questions for the future of the web. What does the rise of digital distributors mean for the Open Web? If distributors become successful in enabling publishers to monetize their content, is there a point at which distributors create enough value for publishers to stop having their own websites? If distributors are capturing market share because of a superior user experience, is there a future technology that could disrupt them? And the ultimate question: who will win, digital distributors or the Open Web?
I see three distinct scenarios that could play out over the next few years, which I'll explore in this post.
Digital distributors provide publishers reach, but without tangible commercial benefits, they risk being perceived as diluting or even destroying value for publishers rather than adding it. Right now, digital distributors are in early, experimental phases of enabling publishers to monetize their content. Facebook's Instant Articles currently lets publishers retain 100 percent of revenue from the ad inventory they sell. Flipboard, in efforts to stave off rivals like Apple News, has experimented with everything from publisher paywalls to native advertising as revenue models. Expect much more experimentation with different monetization models and dealmaking between the publishers and digital distributors.
If digital distributors like Facebook succeed in delivering substantial commercial value to the publisher they may fully embrace the distributor model and even divest their own websites' front-end, especially if the publishers could make the vast majority of their revenue from Facebook rather than from their own websites. I'd be interested to see someone model out a business case for that tipping point. I can imagine a future upstart media company either divesting its website completely or starting from scratch to serve content directly to distributors (and being profitable in the process). This would be unfortunate news for the Open Web and would mean that content management systems need to focus primarily on multi-channel publishing, and less on their own presentation layer.
As we have seen from other industries, decoupling production from consumption in the supply-chain can redefine industries. We also know that introduces major risks as it puts a lot of power and control in the hands of a few.
For the Open Web to win, the next disruptive innovation must focus on narrowing the usability gap with distributors. I've written about a concept called a Personal Information Broker (PIM) in a past post, which could serve as a way to responsibly use customer data to engineer similar personal, contextually relevant experiences on the Open Web. Think of this as unbundling Facebook where you separate the personal information management system from their content aggregation and curation platform, and make that available for everyone on the web to use. First, it would help us to close the user experience gap because you could broker your personal information with every website you visit, and every website could instantly provide you a contextual experience regardless of prior knowledge about you. Second, it would enable the creation of more distributors. I like the idea of a PIM making the era of handful of closed distributors as short as possible. In fact, it's hard to imagine the future of the web without some sort of PIM. In a future post, I'll explore in more detail why the web needs a PIM, and what it may look like.
Finally, in a third combined scenario, neither publishers nor distributors dominate, and both continue to coexist. The Open Web serves as both a content hub for distributors, and successfully uses contextualization to improve the user experience on individual websites.
Right now, since distributors are out-innovating on relevance and discovery, publishers are somewhat at their mercy for traffic. However, a significant enough profit motive to divest websites completely remains to be seen. I can imagine that we'll continue in a coexistence phase for some time, since it's unreasonable to expect either the Open Web or digital distributors to fail. If we work on the next disruptive technology for the Open Web, it's possible that we can shift the pendulum in favor of “open” and narrow the usability gap that exists today. If I were to guess, I'd say that we'll see a move from A1 to B2 in the next 5 years, followed by a move from B2 to C2 over the next 5 to 10 years. Time will tell!
The web was born as an open, decentralized platform allowing different people in the world to access and share information. I got online in the mid-nineties when there were maybe 100,000 websites in the world. Google didn't exist yet and Steve Jobs had not yet returned to Apple. I remember the web as an "Open Web" where no one was really in control and everyone was able to participate in building it. Fast forward twenty years, and the web has taken the world by storm. We now have a hundreds of millions of websites. Look beyond the numbers and we see another shift: the rise of a handful of corporate "Walled Gardens" like Facebook, Google and Apple that are becoming both the entry point and the gatekeepers of the web. Their dominance has given rise to major concerns.
We call them "Walled Gardens" because they control the applications, content and media on their platform. Examples include Facebook or Google, which control what content we get to see; or Apple, which restricts us to running approved applications on iOS. This is in contrast to the Open Web, where users have unrestricted access to applications, content and media.
Facebook is feeling the heat from Google, Google is feeling the heat from Apple but none of these Walled Gardens seem to be feeling the heat from an Open Web that safeguards our privacy and our society's free flow of information.
This blog post is the result of people asking questions and expressing concerns about a few of my last blog posts like the Big Reverse of the Web, the post-browser era of the web is coming and my DrupalCon Los Angeles keynote. Questions like: Are Walled Gardens good or bad? Why are the Walled Gardens winning? And most importantly; how can the Open Web win? In this blog post, I'd like to continue those conversations and touch upon these questions.
What makes this question difficult is that the Walled Gardens don't violate the promise of the web. In fact, we can credit them for amplifying the promise of the web. They have brought hundreds of millions of users online and enabled them to communicate and collaborate much more effectively. Google, Apple, Facebook and Twitter have a powerful democratizing effect by providing a forum for people to share information and collaborate; they have made a big impact on human rights and civil liberties. They should be applauded for that.
At the same time, their dominance is not without concerns. With over 1 billion users each, Google and Facebook are the platforms that the majority of people use to find their news and information. Apple has half a billion active iOS devices and is working hard to launch applications that keep users inside their walled garden. The two major concerns here are (1) control and (2) privacy.
First, there is the concern about control, especially at their scale. These organizations shape the news that most of the world sees. When too few organizations control the media and flow of information, we must be concerned. They are very secretive about their curation algorithms and have been criticized for inappropriate censoring of information.
Second, they record data about our behavior as we use their sites (and the sites their ad platforms serve) inferring information about our habits and personal characteristics, possibly including intimate details that we might prefer not to disclose. Every time Google, Facebook or Apple launch a new product or service, they are able to learn a bit more about everything we do and control a bit more about our life and the information we consume. They know more about us than any other organization in history before, and do not appear to be restricted by data protection laws. They won't stop until they know everything about us. If that makes you feel uncomfortable, it should. I hope that one day, the world will see this for what it is.
While the Walled Gardens have a positive and democratizing impact on the web, who is to say they'll always use our content and data responsibly? I'm sure that to most critical readers of this blog, the Open Web sounds much better. All things being equal, I'd prefer to use alternative technology that gives me precise control over what data is captured and how it is used.
Why then are these Walled Gardens growing so fast? If the Open Web is theoretically better, why isn't it winning? These are important questions about future of the Open Web, open source software, web standards and more. It is important to think about how we got to a point of walled garden dominance, before we can figure out how an open web can win.
The biggest reason the Walled Gardens are winning is because they have a superior user experience, fueled by data and technical capabilities not easily available to their competitors (including the Open Web).
Unlike the Open Web, Walled Gardens collect data from users, often in exchange for free use of a service. For example, having access to our emails or calendars is incredibly important because it's where we plan and manage our lives. Controlling our smartphones (or any other connected devices such as cars or thermostats) provides not only location data, but also a view into our day-to-day lives. Here is a quick analysis of the types of data top walled gardens collect and what they are racing towards:
On top of our personal information, these companies own large data sets ranging from traffic information to stock market information to social network data. They also possess the cloud infrastructure and computing power that enables them to plow through massive amounts of data and bring context to the web. It's not surprising that the combination of content plus data plus computing power enables these companies to build better user experiences. They leverage their data and technology to turn “dumb experiences” into smart experiences. Most users prefer smart contextual experiences because they simplify or automate mundane tasks.
I still believe in the promise of highly personalized, contextualized information delivered directly to individuals, because people ultimately want better, more convenient experiences. Walled Gardens have a big advantage in delivering such experiences, however I think the Open Web can build similar experiences. For the Open Web to win, we first must build websites and applications that exceed the user experience of Facebook, Apple, Google, etc. Second, we need to take back control of our data.
The obvious way to build contextual experiences is by combining different systems that provide open APIs; e.g. we can integrate Drupal with a proprietary CRM and commerce platform to build smart shopping experiences. This is a positive because organizations can take control over the brand experience, the user experience and the information flow. At the same time users don't have to trust a single organization with all of our data.
To deliver the best user experience, you want “loosely-coupled architectures with a highly integrated user experience”. Loosely-coupled architectures so you can build better user experiences by combining your systems of choice (e.g. integrate your favorite CMS with your favorite CRM with your favorite commerce platform). Highly-integrated user experiences so can build seamless experiences, not just for end-users but also for content creators and site builders. Today's Open Web is fragmented. Integrating two platforms often remains difficult and the user experience is "mostly disjointed" instead of "highly integrated". As our respective industries mature, we must focus our attention to integrating the user experience as well as the data that drives that user experience. The following "marketecture" illustrates that shift:
For the time being, we have to integrate with the big Walled Gardens. They need access to great content for their users. In return, they will send users to our sites. Content management platforms like Drupal have a big role to play, by pushing content to these platforms. This strategy may sound counterintuitive to many, since it fuels the growth of Walled Gardens. But we can't afford to ignore ecosystems where the majority of users are spending their time.
At the same time, we have to worry about how to leverage people's data while protecting their privacy. Today, each of these systems or components contain user data. The commerce system might have data about past purchasing behavior, the content management system about who is reading what. Combining all the information we have about a user, across all the different touch-points and siloed data sources will be a big challenge. Organizations typically don't want to share user data with each other, nor do users want their data to be shared without their consent.
The best solution would be to create a "personal information broker" controlled by the user. By moving the data away from the applications to the user, the user can control what application gets access to what data, and how and when their data is shared. Applications have to ask the user permission to access their data, and the user explicitly grants access to none, some or all of the data that is requested. An application only gets access to the data that we want to share. Permissions only need to be granted once but can be revoked or set to expire automatically. The application can also ask for additional permissions at any time; each time the person is asked first, and has the ability to opt out. When users can manage their own data and the relationships they have with different applications, and by extension with the applications' organizations, they take control over their own privacy. The government has a big role to play here; privacy law could help accelerate the adoption of "personal information brokers".
People don't seem so concerned about their data being hosted with these Walled Gardens since they've willingly given it to date. For the time being, "free" and "convenient" will be hard to beat. However, my prediction is that these data privacy issues are going to come to a head in the next five to ten years, and lack of transparency will become unacceptable to people. The Open Web should focus on offering user experiences that exceed those provided by Walled Gardens, while giving users more control over their user data and privacy. When the Open Web wins through improved transparency, the closed platforms follow suit, at which point they'll no longer be closed platforms. The best case scenario is that we have it all: a better data-driven web experience that exists in service to people, not in the shadows.
At yesterday's Worldwide Developer Conference keynote, Apple announced its annual updates to iOS, OS X, and the new watchOS. As usual, the Apple rumor blogs correctly predicted most of the important announcements weeks ago, but one important piece of news only leaked a few hours before the keynote: the launch of a new application called "News". Apple's News app press release noted: "News provides beautiful content from the world's greatest sources, personalized for you".
Apple basically cloned Flipboard to create News. Flipboard was once Apple's "App of the Year" in 2010, and it remains one of the most popular reading applications on iOS. This isn't the first time Apple has chosen to compete with its ecosystem of app developers. There is even a term for it, called "Sherlocking".
But forget about Apple's impact on Flipboard for a minute. The release of the News app signifies a more important shift in the evolution of the web, the web content management industry, and the publishing industry.
Why is Apple's News app a big deal for content management platforms? When you can read all the news you are interested in in News, you no longer have to visit websites for it. It's a big deal because there are half a billion active iOS devices and Apple will ship its News app to every single one of them. It will accelerate the fact that websites are becoming less relevant as an end-point destination.
Some of the other new iOS 9 features will add fuel to the fire. For example, Apple's search service Spotlight will also get an upgrade, allowing third-party services to work directly with Apple's search feature. Spotlight can now "deep link" to content inside of a website or application, further eliminating website or applications as end-points. You could search for a restaurant in Yelp directly from your home screen, and go straight to Yelp's result page without having to open the Yelp website or application. Add to that the Apple Watch which doesn't even ship with a web browser, and it's clear that Apple is about to accelerate the post-browser era of the web.
The secret to the News app is the new Apple News Format; rumored to be a RSS-like data feed with support for additional design elements like images, videos, custom fonts, and more. Apple uses these feeds to aggregate content from different news sources, uses machine learning to match the best content to a given user, and provides a clean, consistent look and feel for articles coming from the various news sources. That is the long way of saying that Apple decides what the best content is for you, and what the best format is to deliver it in. It is a profound change, but for most people this will actually be a superior user experience.
The release of Apple News is further proof that data-driven experiences will be the norm and of what I have been calling The Big Reverse of the Web. The fact that for the web to reach its full potential, it will go through a massive re-architecture from a pull-based architecture to a push-based architecture. After the Big Reverse of the Web is complete, content will find you, rather than you having to find content. Apple's News and Flipboard are examples of what such push-based experiences look like; they "push" relevant and interesting content to you rather than you having to "pull" the news from multiple sources yourself.
When content is "pushed" to you by smart aggregators, using a regular web browser doesn't make much sense. You benefit from a different kind of browser for the web. For content management platforms, it redefines the browser and websites as end-points; de-emphasizing the role of presentation while increasing the importance of structured content and metadata. Given Apple's massive install base, the launch of its News app will further accelerate the post-browser era of the web.
I don't know about your content management platform, but Drupal is ready for it. It was designed for a content-first mentality while many competitive content management systems continue to rely on a dated page-centric content model. It was also designed to be a content repository capable of outputting content in multiple formats to multiple end-points.
Forget the impact on Flipboard or on content management platforms, the impact on the publishing world will even be more significant. The risk for publishers is that they are being disintermediated as the distribution channel and that their brands become less useful. It marks a powerful transformation that could de-materialize and de-monetize much of the current web and publishing industry.
Because of Apple's massive installed base, Apple will now own a large part of the distribution channel and it will have an outsized influence on what hundreds of millions of users will read. If we've learned one thing in the short history of the Internet, it is that jumping over middlemen is a well-known recipe for success.
This doesn't mean that online news media have lost. Maybe it can actually save them? Apple could provide publishers large and small with an immense distribution channel by giving them the ability to reach every iOS user. Apple isn't alone with this vision, as Facebook recently rolled out an experiment with select publishers like Buzzfeed and the New York Times called Instant Articles.
In a "push economy" where a publisher's brand is devalued and news is selected by smart aggregators, the best content could win; not just the content that is associated with the most well-known publishing brands with the biggest marketing budgets. Publishers will be incentivized to create more high-quality content -- content that is highly customized to different target audiences, rather than generic content that appeals to large groups of people. Success will likely rely on Apple's ability to use data to match the right content to each user.
This isn't necessarily bad. In my opinion, the web isn't dead, it's just getting started. We're well into the post-PC era, and now Apple is helping to move consumers beyond the browser. It's hard to not be cautiously optimistic about the long-term implications of these developments.
Here is a very simple thesis on how to disrupt billion dollar industries:
Content platform + user platform = BOOM!
That is a bit cryptic, so let me explain.
Traditional retailers like RadioShack and Barnes & Noble were great "content platforms"; they have millions of products on shelves across thousands of physical stores. Amazon disrupted them by moving online, and Amazon was able to build an even better content platform with many more products. In addition, the internet enabled the creation of "user platforms". Amazon is a great user platform as it knows the interests of the 250 million customers it has on file; it uses that customer information to recommend products to buy. Amazon built a great content and user platform.
Businesses with a content platform that aren't investing in a user platform will most likely get disrupted. To understand why user platforms matter, take a look at a traditional media company like The New York Times -- one of the world's best content platforms, both online and offline. But it's also one of the world's poorest user platforms; they don't have a 1-on-1 relationship with all their readers. By aggregating the best content from many different sources, Flipboard is as good of a content platform as The New York Times, if not better. However, Flipboard is a much better user platform because all of its readers explicitly tell Flipboard what they are interested in and Flipboard matches content to users based on their interest. For The New York Times to survive, their strategy should be to invest in a better user platform: they should spend more time getting to know every single reader and serving curated content that matches the user's interest. The New York Times seems well aware of this problem, with its decision last week to host its articles directly on Facebook to get access to Facebook's user platform with 1.4 billion users.
Similarly, Netflix is disrupting both traditional broadcasters and cable companies because they built a great user platform capable of matching movies and shows to users. To many Netflix users' frustrations, traditional TV broadcasters still have the better content platform, but that hasn't stopped the growth of Netflix. Furthermore, Netflix is investing heavily in becoming a better content platform by producing their own shows, including original series such as House of Cards and Orange Is the New Black. Unless traditional broadcasters invest in becoming great user platforms and matching content to users, they risk losing against Netflix.
The challenge for newspaper organizations or cable providers is usually not with the technical evolution, but with changing their business model. Take the cable providers, for example. Legacy constraints like distribution models, FCC regulations and broadcast spectrum requirements prevent them from moving as fast in this direction as a Netflix might. Fortunately for most cable providers, they are also the internet providers, which allows them to become user platforms if they too can master the personalization and contextualization equation.
Facebook, Twitter, Apple and Google are some of the world's best user platforms; they know about their users' likes and dislikes, their location, their relationships and much more. For them, the opportunity is to become better content platforms and to match users with relevant products and articles. By organizing the world's information, Google is building a massive content platform, and by launching services like Gmail, Google+, Google Ads, Google Fiber and Google Wallet, they are building a massive user platform. Given that they have the world's largest content platform and the richest user platform, I have no doubt that Google could dominate the web the next couple of decades.
The examples above are focused on print media, television and radio, but the thinking can easily be extended to commerce, manufacturing, education, and much more. The thesis of content platforms adding user platforms (or vice versa) is very basic but also very powerful. Adding user platforms to existing content platforms enables a transformative change in the customer's user experience: content can find you, rather than you having to find content. Furthermore, brands are able to establish a 1-on-1 relationships with their customers allowing them to interact with them in a way they were never able to in the past. By establishing 1-on-1 relationships with their customers, brands will be able to "jump over" the traditional distribution channels. If we've learned one thing in the short history of the internet, it is that jumping over middlemen is a well-known recipe for success.
Anyone building a digital business should at least consider investing in building both a better content platform and a better user platform. It's no longer just about publishing content; it's about understanding what uniquely delights each user and using that information to manage the entire experience of a site visitor or customer over time. The idea of using interests, location, user feedback, past behavior and contextual information to deliver the best user experience is no longer a nice-to-have; it is becoming a make-or-break point. It is the next big challenge and opportunity for everyone building digital experiences. This is why I'm passionate about content management systems needing to evolve to digital experience management systems and why Acquia has spent the last two years building software that helps organizations build user platforms. As I talked and wrote about years ago, I believe personalization and contextualization will be a critical building block of the future of the web, and I'm excited to help make that a reality.
I believe that for the web to reach its full potential, it will go through a massive re-architecture and re-platforming in the next decade. The current web is "pull-based", meaning we visit websites or download mobile applications. The future of the web is "push-based", meaning the web will be coming to us. In the next 10 years, we will witness a transformation from a pull-based web to a push-based web. When this "Big Reverse" is complete, the web will disappear into the background much like our electricity or water supply. We'll forget what 'www' stood for (which was kind of dumb to begin with). These are bold statements, I understand, but let me explain you why.
In the future, content, products and services will find you, rather than you having to find them. Puma will let us know to replace our shoes and Marriott will automatically present you room options if you missed your connecting flight. Instead of visiting a website, we will proactively be notified of what is relevant and asked to take action. The dominant function of the web is to let us know what is happening or what is relevant, rather than us having to find out.
Facebook and Flipboard are early examples of what such push-based experience looks like. Facebook "pushes" a stream of personalized information designed to tell you what is happening with your friends and family; you no longer have "pull" them and ask how they are doing. Flipboard changes how we consume content by aggregating the best of the web and filtering it based on our interests; it "pushes" the relevant and interesting content to you rather than you having to "pull" the news from multiple sources. Also consider the rise of notification-centric experiences; your smartphone's notification center provides you with a stream of relevant information that is pushed to you. More recently, these notifications have become interactive; you can check in for a flight without having to open your travel app. You can buy a product without having to visit their website.
What people really want is to tune into information rather than having to work to get information. It saves them time and effort and in the long run, an improved user experience always wins. In most cases, "Show me what I want" is more useful than "Let me search around and see what I can find".
With some imagination, it's not too hard to picture how these kind of experiences could expand to other areas of the web. The way the e-commerce works today is really no different than having to visit a lot of separate physical stores or wading through hundreds of products in a department store. We shouldn't have to work so hard to find what we want. In a push-based world, we would sit back as if we were watching a fashion show -- the clothing presented could come for hundreds of different online brands but the stream is "personalized" to our needs, budget, sizes and style preferences. When the Big Reverse is complete, it will be the end of department stores and malls. Keep an eye on personalized clothing services like Trunk Club or Stitch Fix.
Ten years from now we're going to look back and recognize that search-based content discovery was broken. Today the burden is put on the user to find relevant content either via directly typing in a URL or by crafting complex search queries. While pull-based experiences might not go away; push-based experiences will dominate as they will prove to be much more efficient.
Many of you won't like it (at first), but push will win over pull. Healthcare is going through a similar transformation from pull to push; instead of going to a doctor, we'll have web-enabled hardware and software that is able to self-diagnose. Wearables like activity trackers are just the start of decades of innovation and opportunity in healthcare. Helped by the web, education is also moving from pull to push. Why go to a classroom when personalized training can come to you?
We are at the beginning of a transition bridging two distinctly different types of economies. First, a "push economy" that tries to anticipate consumer demand, creates standardized or generic products in large amounts, and "pushes" them into the market via global distribution channels and marketing. Now, a "pull economy" that—rather than creating standardized products—will create highly customized products and services produced on-demand and delivered to consumers through one-on-one relationships and truly personal experiences.
This new paradigm could be a very dramatic shift that disrupts many existing business models; advertising, search engines, app stores, online and offline retailers, and much more. For middlemen like online retailers or search engines, the push-based means they risk being disintermediated as the distribution chain becomes less useful. It marks a powerful transformation that dematerializes and de-monetizes much of the current web. While this might complicate the lives of many organizations, it will undoubtedly simplify and better the lives of consumers everywhere.
Building a successful company is really hard. It is hard no matter where you are in the world, but the difficulty is magnified in Europe, where people are divided by geography, regulation, language and cultural prejudice. If governments can provide European startups a competitive advantage, that could come a long way in helping to offset some of the disadvantages. In this post, I'm sharing some rough ideas for what governments could do to encourage a thriving startups ecosystem. It's my contribution to the Belgian startup manifesto (#bestartupmanifesto).
Marc Andreessen famously said that software is eating the world. While I certainly agree with Marc that software companies are redefining our economies, I believe that much of that technological shift is being driven by data. So is the value of a business in the data or is it in the software? I believe data is eating the world because the value is increasingly more in the data and not the software. Let's investigate why.
Netflix provides a great example of a data-driven customer-centric company. By introducing streaming video, their software "ate" the traditional DVD business. But Netflix soon realized their future wasn't in the medium of delivery -- it was in the wealth of data generated simply by people using the service. The day-to-day data generated by Netflix viewers provides a crucial ingredient to competing in the marketplace and defining the company's mission: improving the quality of the service.
To that end, Netflix uses passive data -- the information gathered quietly in the background without disrupting users' natural behaviors -- to provide TV and movie recommendations, as well as to optimize the quality of services, such as streaming speed, playback quality, subtitles, or closed captioning. Of course, Netflix subscribers can contribute active feedback to the company, such as movie reviews or feedback on the accuracy of a translation, but the true value of Netflix's user data is in the quiet, zero-effort observation that allows the company to optimize experiences with no friction or disruption to regular user behavior. In fact, the company even hosted several competitions to invent better algorithms for user ratings, with a winning prize of $1M USD.
Within very saturated marketplaces, data is also becoming a key differentiator for some companies. For example, when Google first started, its value was almost entirely centered around the quality of its Pagerank algorithm, or its "software". But Google did not rest on the laurels of having good software, and prioritized data-driven insights as the future of the company. Consider Google Waze, the world's largest community-based traffic and navigation app. Google Waze relies heavily on both active consumer input and passive location-based data, combined with a sophisticated routing algorithm. The routing algorithm alone would not be enough to differentiate Waze from the other navigation systems of the world. Consumers are demanding more accurate maps and real-time traffic information, which could not happen without the use of data.
There is another element in the rising importance of data: not only is the sheer amount of consumer data growing, but software is simultaneously becoming much easier to build. Developers can leverage new software programming tools, open source, and internet-based services to build more complex software in less time. As a result, the underlying intrinsic value of software companies is diminishing.
Netflix and Google are still disruptive companies, but no longer primarily because of their software -- it's their ability to use the data their customers produce to extend their engagement with customers. Their actual software is increasingly being commoditized; recommendation engines and navigation software both exist in open source and are no longer trade secrets.
Tomorrow's applications will consume multiple sources of data to create a fine-grained context; they will leverage calendar data, location data, historic clickstream data, social contacts, information from wearables, and much more. All that rich data will be used as the input for predictive analytics and personalization services. Eventually, data-driven experiences will be the norm.
And this basic idea doesn't even begin to cover the advances in machine learning, artificial intelligence, deep learning and beyond -- collectively called "machine intelligence". Looking forward even more, computers will learn to do things themselves from data rather than being programmed by hand. They can learn faster themselves than we'd be able to program them. In a world where software builds itself, computers will only be limited by the data they can or cannot access, not by their algorithms. In such a future, is the value in the software or in the data?
As value shifts from software to the ability to leverage data, companies will have to rethink their businesses, just as Netflix and Google did. In the next decade, data-driven, personalized experiences will continue to accelerate, and development efforts will shift towards using contextual data collected through passive user behaviors.
Companies of the future have a lot on their plates. More than ever, they'll need to adapt to all types and formats of data (closed, open, structured and unstructured); leverage that data to make their product or service better for users; navigate the gray area around privacy concerns; and even reconsider the value of their intellectual property derived from software. They'll have to do all this while providing more contextualized, personalized, and automated experiences. "Data-driven" will spell a win-win situation for both users and businesses alike.
Updates from Dries straight to your mailbox