Big Brother Update: HHS Seeking Access to ‘Full Twitter Historical Data’ UPDATED!

02.20.2014

Government wants ‘social media analytic tool’ for ‘ongoing monitoring’

Free Beacon - The Department of Health and Human Services (HHS) is seeking a “social media analytic tool” that will give the government access to “full Twitter historical data,” according to a solicitation released on Tuesday.

The agency is seeking feedback for a “possible future acquisition to provide near real time social media analysis.” HHS said it wants to use the tool for “ongoing monitoring” of public health issues.

HHS provides a long list of requirements, including “access to real-time social media posts,” and “access to full Twitter firehose.”

The agency requires an archive that goes back at least five years of “full Twitter historical data.” The government will also need “access to multiple account log-ins,” “real-time alerting,” the “ability to construct lengthy Boolean searches,” and a function that can filter search results based on the location of a Twitter user.

Under “additional attributes that we would find useful,” HHS said the “ability to export full data into excel or another spreadsheet program” would be beneficial.

HHS said it would use the social media tool for public health concerns and emergencies such as Superstorm Sandy. “In the midst of an event we want to know when hospitals and/or nursing homes are evacuating patients,” HHS said under “scenarios of how we would utilize this tool.”

“We conduct on-going monitoring of certain public health issues,” HHS said. “An increase in the level of discussion on social media could indicate a new development or concern related to that issue.”

The Office of the Secretary of HHS filed the solicitation, arguing that social media monitoring is necessary since the agency is responsible for ensuring “preparedness” for public health threats and emergencies.

Within HHS, the Office of Emergency Management (OEM) is responsible for coordinating the department’s “operational response to acts of terrorism and other public health and medical threats and emergencies.”

HHS said OEM’s “Division of Fusion” can use social media as a “non-traditional” data collection tool to respond to health emergencies and natural disasters.

“Social media and open source data analytics play an important role in filling gaps in traditional data collection and help our office provide insights to decision makers to aid them in making informed decisions to protect the health and welfare of impacted populations during emergencies,” the agency said.

HHS is seeking responses no more than five pages in length by March 3.

source

UPDATE: Accidental Companion Piece OR Part of the Motive?

(Found on Google News of all places)

Study uncovers six basic types of Twitter conversations

A graph of a polarized crowd created by Pew Research Center and Social Media Research Foundation

You pull up your phone to check Twitter, see a couple of tweets that interest you, so you retweet or reply. We’ve all done it, or at least all of us tweeters. What you may not know, though, is that it’s possible to map the dialogue formed from those tweets, retweets and replies into different types of social and conversational structures.

The Pew Research Center and the Social Media Research Foundationanalyzed thousands of twitter conversations going back to 2010. They found these conversations occoured based on the structure of the individual’s Twitter network. For example, the subjects and content that a person tweets about, the people they follow, the people who follow them and the way they network creates a structure of social activity. In a recently released report Pew reports that they uncovered six distinct patterns for these structures.

“These are data-driven early steps in understanding Twitter discussion structures that contribute to the emerging science of social participation,” Ben Shneiderman professor of computer science at the University of Maryland and a report-co-author said. “This new field is emerging right before our eyes and could eventually have a large impact on our understanding of everything from health to community safety, from business innovation to citizen science and from civic engagement to sustainable energy programs.”

Does the last conversation you had on Twitter represent one of these types of networks the researchers mapped?

• divided, Polarized Crowd: Polarized discussions feature two big and dense groups that have little connection between them. The topics being discussed are often highly divisive and heated political subjects. In fact, there is usually little conversation between these groups despite the fact they are focused on the same topic. Polarized Crowds on Twitter are not arguing. They are ignoring one another while pointing to different web resources and using different hashtags.

• unified, Tight Crowd: These discussions are characterized by highly interconnected people with few isolated participants. Many conferences, professional topics, hobby groups, and other subjects that attract communities take this Tight Crowd form.

• fragmented, Brand Clusters: When well-known products or services or popular subjects like celebrities are discussed in Twitter, there is often comment from disconnected participants (the “isolates” who are participating in a conversation cluster are on the left side of the picture on the left). Well- known brands and other popular subjects can attract large fragmented Twitter populations who Tweet about it but not to each other. The larger the population talking about a brand the less likely it is that people are connected to one another. Brand mentioning participants focus on a topic, but tend not connect to each other.

• cohesive, Community Clusters: Some popular topics may develop multiple smaller groups, which often form around a few hubs each with its own audience, influencers, and sources of information. These Community Clusters conversations look like bazaars which host multiple centers of activity. Global news stories often attract coverage from many news outlets, each with its own following. That creates a collection of medium-sized groups – and a fair number of isolates (the left side of the picture above).

• inward facing hubs and spoke, Broadcast Network: Twitter commentary around breaking news stories and the output of well-known media outlets and pundits has a distinctive hub and spoke structure in which many people repeat what prominent news and media organizations tweet. The members of the Broadcast Network audience are often connected only to the hub news source, without connecting to one another. In some cases there are smaller subgroups of densely connected people – think of them as subject groupies – who do discuss the news with one another.

• outward facing, Support Network: Customer complaints for a major business are often handled by a Twitter service account that attempts to resolve and manage customer issues around their products and services. This produces a hub and spoke structure that is different from the Broadcast pattern. In the Support Network structure, the hub account replies-to many otherwise disconnected users, creating an outward hub. In contrast, in the Broadcast pattern, the hub gets replied to or retweeted by many disconnected people, creating an inward hub.

This isn’t to say every tweet falls into one of the structures or that more structures couldn’t emerge. However, the six structures they discovered occurred regularly.

Pew’s team identified structures by looking for patterns. If a pattern didn’t fit into a particular structure they created a new one, Marc Smith, the director of the Social Media Research Foundation and main author of the report said.

Tweets containing mla13 show a Tight Crowd. Graph by Pew Research Center/Social Media Research Foundation

“We expected the divided structure around political topics, but were surprised by five other patterns and we didn’t find many more,” Smith said.

This report represents a new approach for Pew. Instead of their normal public opinion survey they worked with researchers at the Social Media Research Foundation and used social network analysis to reach their findings.

“These maps provide insights into people’s behavior in a way that complements and expands on traditional research methods such as public opinion surveys, focus groups and even sentiment analysis of texts,” Lee Rainie, director of the Pew Research Center Internet Project said.

Using the software tool NodeXL, a plug-in extension to Microsoft Excel spreadsheets, researchers where able to import data from thousands of Twitter networks on hundreds of topics. The tool searched for keywords and hashtags and captured the tweet, usernames, hyperlinks, hashtags and information on the tweet’s author followers and follows. The data was analyzed and visualized in network social structure maps.

Rainie described it as similar to taking a photograph or video of a crowd.

“It gives us a way to take the digital equivalent of aerial photos of crowds and simultaneously listen to their conversations,” Rainie said.

Rainie said the data also pushes back against the notion that social media has disrupted everything and that nothing is the same as before.

“It’s clear that traditional important institutions and people still have the ability to be very influential,” Rainie said.

Graph of a Support Network from tweets using delllistens or dellcares. Graph by Pew Research Center/Social Media Research Foundation

There are limitations to the data collected. NodeXL only captured public tweets in the English language and couldn’t grab direct messages or content from protected Twitter accounts. Data was also taken for specific periods of times and the researchers note it does not represent the sentiments of the full population of Twitter. Plus, Twitter users are still a relatively small demographic. According to the 2013 Pew Social Media Update only 18 percent of Internet users use Twitter and only 14 percent of the adult population.

Still, while the data is limited in scope, social media communicators everywhere will likely be pour over the results to figure out how to use it to their advantage.

“You could map who am I now, who am I like, who do I aspire to, and how close I am,” Smith said.

In other words an organization that wants to promote a brand name, product or news story might consdier what social media network is the topic most like–or target a network type with a goal. Then they could use network maps of the topic to track the progress of their message across Twitter.

While the researchers looked specifically at Twitter, the tool could be used on other social networks including YouTube, Flickr and Facebook fan pages.

So, when you share this story on Twitter, ask yourself what social conversation you’re taking part in–and are we at PBS NewsHour mapping it to see our impact?

source