The basic information technology for epidemiologic surveillance was once (and often still is) “shoe-leather”—a term that harkens back to the days of John Snow and his predecessors, when data collection was limited by how far an epidemiologist could walk. Since then, the technological tools for data collection have evolved. The gradual adoption of the telephone in the late 19th and early 20th centuries facilitated the use of phones for surveillance purposes. By the 1950s, public health officials were using telephone interviews to conduct outbreak investigations1,2 and, in doing so, helped to usher in a new era in survey methodology. Likewise, the advent of the computer age profoundly altered the landscape of population-health research. In the last 30 years, electronic medical records,3 health insurance claims data,4 and population-based registers5 have allowed investigators to conduct research on large samples, and usage of computer data repositories has become accepted practice. More recently, epidemiologists have taken advantage of the Internet as a communications medium to facilitate research. The world is increasingly “wired”: over 1.8 billion persons worldwide use the Internet, and population percentages of Internet users are high for many developed regions.6 Accordingly, many aspects of research, including recruitment,7 data collection,8 and even certain interventions9 have been implemented through the Internet. But the value of the Internet for epidemiologic research is not simply as a faster method of reaching potential participants or conducting a survey, or as a replacement for the telephone when people are increasingly reluctant to respond to solicitations. User-driven Internet content—particularly the content produced under the Web 2.0 platform—offers research opportunities for epidemiology that have only begun to be explored. WEB 2.0 The Internet is a global network of smaller computer networks and the World Wide Web (Web, for short) is the browser-accessible content that exists on the Internet. The Web was introduced in 1991 and, for many years, information transfer was generally 1-way. Users were limited to passive viewing and receipt of Web site content with little interaction among users. But technological advances in broadband access, Internet-connected digital devices (such as mobile phones, smart phones, and personal computers), and software applications helped foster a fundamental shift in Internet usage toward the production of user-driven content. Popularized in 2004, the term Web 2.0 refers to the active generation of dynamically updated content made possible by social interaction and participation in online communities.10 Although revolutions in hardware and software have facilitated this shift, Web 2.0 refers to neither hardware nor software, nor a new technical version of the Internet. Rather, Web 2.0 embodies an emerged culture in how persons engage in the Web. It is precisely this culture—how individuals actively use the Web (and the data they contribute)—that may be of value to epidemiologists. Participation in Web 2.0 can occur inadvertently, such as when using a search engine whose output is ranked by popularity, or when clicking on the most-read articles links in online newspapers (or the Epidemiology Web site).11 The next level of engagement might include the active seeking-out of community content, such as reading restaurant reviews to decide on a dinner destination. The deepest level of involvement is in the production and delivery of content for others. Examples of Web 2.0 content include individual information platforms of blogs and microblogs such as Twitter; photo-sharing sites (Flickr); collaborative or crowd-sourced information efforts (Wikipedia, Amazon product reviews); social networks (Facebook, MySpace, LinkedIn); and dating websites (OKCupid, eHarmony). Although the forms and functions of each of these Web 2.0 services vary, the common thread is that each relies on the user community to supply the content that other users demand. EXAMPLES In the most prominent example to date of user-driven Internet content for population health research, Google researchers derived accurate estimates of US influenza prevalence from the frequency and geographic origin of influenza-related Google searches.12 This type of research is known as infodemiology (information + epidemiology)—the study of the distribution and determinants of information on the Internet with the intent of informing public health and public policy.13 The basic premise of infodemiology is that certain information patterns on the Internet may be caused by, or may cause, population-health patterns. An estimated 61% of US adults search for health information on the Internet.14 Information patterns such as those provided by health-seeking behaviors can be capitalized-upon for surveillance purposes. Outbreaks that have been correlated with search-query data include salmonella,15 listeriosis,16 gastroenteritis, and chicken pox.17 Presumptive advantages of infodemiology studies for outbreak surveillance include a much faster timescale compared with traditional surveillance, as well as improved cost-effectiveness. In Google's case, their data accurately described influenza activity 2 weeks earlier than CDC efforts.12 However, the added-value of infodemiology for surveillance of endemic disease is uncertain, and few studies exist. One study of cancer-related search behaviors suggested that the frequency of searches was correlated with the prevalence and mortality of specific cancers but was also influenced by factors such as news coverage and awareness months.18 A recent Epidemiology letter demonstrated plausible seasonality trends in searches regarding diabetes, blood pressure, heart attacks, and kidney stones.19 In addition to disease surveillance, infodemiology may be useful for the study of disasters through monitoring of social-network communications, such as microblog status updates regarding the location and magnitude of effects. The American Red Cross uses Twitter to help coordinate relief efforts,20 while the US Geological Survey is investigating the use of Twitter for real-time earthquake detection.21 The social nature of Web 2.0 is perhaps best exemplified by the large and rapidly growing social networking sites. On Facebook alone, more than 500 million persons (70% outside the United States) actively participate and the average user has 130 “friends.”22 Breadth, depth, and public view ability of content vary by user but online profiles can contain a wealth of data. Researchers can mine profiles for data regarding risk behaviors, personal difficulties, attitudes and beliefs, and relationships.23 Similarly, text analysis of blog posts may reveal information regarding cognitive abilities, personality, and psychologic profiles. Sociologically relevant group-level phenomena can also be studied. For example, a recent provocative paper suggested that the migration of educated white and Asian users from one social networking site (MySpace) to another (Facebook) was similar to white flight from a “digital ghetto.”24 Interactions within online social networks also may be fruitful for research regarding how social networks influence health. Networks formed in cyberspace are both popular for social purposes and relevant for sexually transmitted diseases.25 While Internet chat rooms and dating sites continue to thrive, real-time, location-based socialization has surged in popularity due to GPS-enabled devices such as the iPhone. Grindr, popular with gay males, is a smartphone application that shows potential sex partners and their real-time distance from the user's location. The Foursquare and Google Latitude applications also make use of mobile phone GPS data to publish real-time users' locations onto the Web, generally for social purposes (eg, enabling friends to meet in an impromptu fashion). By analyzing shared location data, researchers may be able to quantify mobility patterns with regard to environments, activities, and health outcomes of interest. For example, GPS tracking can be used to study human movements and their relations to risk of dengue virus,26 as well as environmental characteristics such as population density and street connectivity.27 A special type of social network is the community centered on a particular health concern. More than ever, people are leading a data-driven life. They share personal health data within communities to support others, exchange advice, and gain insight into their own health issues. PatientsLikeMe has over 40,000 patient profiles within a broad range of disease communities, including amyotrophic lateral sclerosis, HIV/AIDS, and organ transplants.28 MedHelp, which has 10 million monthly visitors, features health trackers for a variety of personal health issues such as pregnancy, exercise, sleep, chemotherapy, and hepatitis C. While the data in these health communities are self-reported, data derived from wearable sensors to monitor physical activity, sleep, calorie expenditure, location, and more are frequently shared and may be attractive alternatives to traditional self-reported data. Commercial devices of note include bodybugg, FitBit, and the Nike+ iPod system. At the other end of the health spectrum, interactive communities promoting unhealthy behaviors such as self-injury, suicide, and eating disorders,29 have also proliferated in recent years, and warrant monitoring to understand the impact of such dysfunctional encouragements on health. CONCERNS AND LIMITATIONS For the skeptical epidemiologist who may be unimpressed by the novelty of Web 2.0 uses for epidemiologic research, several obstacles are apparent. The first is the lack of generalizability. The population using Web 2.0 is likely to differ from target populations of interest due to self-selection. However, the Web 2.0 demographic is diversifying rapidly. Even though Facebook was targeted at college students, 18–24 year olds account for less than 25% of the total user population, with the fastest growing age group being persons over 65 years of age (6.5 million of whom signed up in May 2010).30 Still, there is clearly a “digital divide.” Those with little or no access to information technology are fundamentally different by factors such as age, income, education, and health status.31 Web 2.0 studies may therefore exclude segments of the population at highest risk of poor health outcomes. Measurement and analytical issues loom large. Ecologic studies such as Google's influenza study rely on crowd-aggregated data and are thus vulnerable to problems including ecological fallacy and lack of confounder control.32 Individual-level Web 2.0 data are generally self-reported and subject to potential biases. Misleading data and selective reporting (especially for sensitive issues) may occur on online profiles. An analysis of a dating Web site's users found indications of inaccurate claims regarding height, income, and sexual preference.33 Even objective data, such as the Internet protocol address that uniquely identifies most machines on the Internet and can be linked with geographic areas, can correctly resolve within 25 miles of the true location only 83% of the time in the United States.34 The inherent interactive nature of Web 2.0 communities renders questionable assumptions of statistical independence, and sampling from social networks may result in “snowball samples” and consequent statistical complexities.35 One by-product of the digital age is digital detritus that must be sifted to extract useful data. Informatics techniques such as Web scraping (an automated software technique for parsing Web pages to collect information), mashups (the integration of data from multiple disparate sources),36 natural language processing (computer interpretation of language), and machine-learning (a general term for a diverse number of classification and prediction algorithms) may be useful at various points in the workflow translating from Web 2.0 content to research findings. These tools are used in many other fields (eg, machine learning for detection of suspicious credit card activity) but rarely in epidemiology.37 These techniques require technical proficiency, and epidemiologists can benefit from collaboration with computer scientists and informaticists. Other tools include HealthMap, which scrapes health news to depict global disease activity. Google Flu Trends tracks influenza-related Google search queries for 28 countries, while Google Insight allows user-friendly analysis of search volume patterns across location and time. Ethical concerns also must be addressed, such as the “big-brother” aspect of monitoring real-time GPS data. The automated process of Web scraping may violate the terms of use of certain Web sites. Even the use of data from supposedly anonymous Web 2.0 profiles will require caution due to potential linkage with real-life identifying information on the Internet. Epidemiologists generally know what to measure and how to measure it. What Web 2.0 offers is a new anthropological dimension to data, with new possibilities for what epidemiologists can measure and new challenges for how to measure it. The prospects of Web 2.0 for epidemiologic research are limited by the available Web 2.0 content—content which, by its nature, grows daily in both depth and breadth. Given the vast content, the real constraints may simply be those imposed by the limits of epidemiologists' own ingenuity and creativity. ACKNOWLEDGMENTS I gratefully acknowledge Daniel Westreich (UNC-Chapel Hill and Duke University) and Amy Auchincloss (Drexel University) for many helpful comments on a previous version of this manuscript. ABOUT THE AUTHOR BRIAN LEE is Assistant Professor of Epidemiology and Biostatistics at the Drexel University School of Public Health. A member of Generation Y, he is broadly interested in the interface of technology and health research. He is currently studying the use of machine-learning algorithms in epidemiology.
No takes yet. Share an insight, caveat, or question.
Brian K. Lee (2010) studied this question.
Synapse has enriched 3 closely related papers on similar clinical questions. Consider them for comparative context: