Please Note: This project is not currently active. The content on this site is provided for reference and is not actively maintained.

Posts Tagged ‘Pulse’

Tracking the Mood About Gas Prices on Twitter: A Case Study

by January 25, 2012

As another test of our strategy for teasing out public opinion from social media, we explored measuring mood about gas prices on Twitter. This post summarizes the findings from this case study. Incidentally, we are set up to measure mood from Twitter on an ongoing basis, although we would need to find a partner to help defray the ongoing costs of crowdsourcing the sentiment judgments. (See this post to read more about our decision to examine the discussion about gas prices on Twitter.)

The sentiment we mapped was culled from tweets gathered from four weeks’ worth of data starting on May 22nd, 2011. This time period was chosen to coincide with Memorial Day, a holiday during which many Americans travel by car. Our team was curious to see whether there would be an uptick in either the volume of tweets about gas prices during this period or a noticeable change in sentiment about these prices. (more…)

More »

Capturing Mood About Daily Weather From Twitter Posts

by September 29, 2011

After considerable preparation, we’ve just launched a version of our interactive tool, Pulse. Using Pulse, users can explore feelings about the weather as expressed on Twitter.

We began the process by choosing a topic that would yield a substantial volume of discussion on Twitter as well as be of general interest. Once we settled on weather, we wrote a survey designed to gauge Twitter users’ sentiments about the topic. With the help of workers from the “crowd” accessed through CrowdFlower, we had tens of thousands of relevant tweets coded as to the expressed emotion about the weather. These results were then used to create an “instance” of the Pulse tool, which manifests as a map of the United States that at a glance reveals Twitter users’ sentiments about the weather in their region on a given day. (You can read more about the coding process here and our choice of weather as a topic here.)

For our launch of Pulse for weather, we chose to feature tweets published over a month beginning in late April, 2011, a period in which many extreme weather events occurred—the devastating tornado in Joplin, MO; widespread drought throughout the South; and flooding of the Mississippi River, among others. The image below is from May 25, three days following the Joplin tornado (jump to the interactive map here).

may-25-pulse

We gathered tweets from all 50 states as well as for about 50 metro areas. Here you can see a zoom up on several states centered on Missouri.

zoom-may-25-pulse

The interactive map tells part of the story, namely a state’s or city’s overall sentiment about the weather, while the content under the “Analysis” and “Events” tabs reveal some of the “why” behind this sentiment: what were some of the most notable weather events occurring on a given day? [Note: our "events" feature has a bug in it and is currently turned off. In the future, icons will show up on the map to highlight out-of-the-ordinary weather events, like outbreaks of tornadoes, persistent flooding or drought, etc.] To what extent did the weather deviate from normal conditions? Why were tweets from, say, the South, uniformly negative during a certain time? What was happening when we saw a single positive state amidst a region that was otherwise negative?

We hope that weather is just the beginning. We envision using the Pulse tool to visualize nationwide sentiments about more complex, nuanced topics in the future—a sample of emotions about gas prices is just around the corner, and see our preliminary work on opinions about global warming. For now, you can explore the Pulse tool here, and let us know what you think!

More »

Teasing Out Opinions About Global Warming From Twitter

by June 24, 2011

snapshot-ca A couple of months ago, we posted results from a quick sampling of mood about global warming in the Twittersphere that was featured in Momentum, the publication of the University of Minnesota’s Institute on the Environment. Along with our work on weather mood and mood about gas prices, we are on the verge of releasing a more in-depth analysis of sentiment about global warming. Here, we explain the method behind our sentiment analysis related to global warming, building off an earlier post that presented some of the details of our methodology on studying global warming chatter. (more…)

More »

Hope for Human Sentiment Analysis Coding

by May 13, 2011

I just read an interesting blog post on Social Times discussing the advantages of machine-based sentiment analysis. In the piece, author Dr. Taras Zagibalov challenges the critics of “automatic” sentiment analysis, who claim that humans can better determine than computers the sentiment of social media text. He asserts that, with the proper tuning of a system’s classifier—creating specific classifiers for each domain (subject matter) and keeping them current—a machine-based sentiment analysis system can outperform human accuracy.

The discussion of human vs. machine sentiment is core to our work at Dialogue Earth, where we are developing Pulse—a social media analytics tool to help tease out nuances in the social media dialogue about key societal topics. Pulse social media analytics tool (more…)

More »

“Momentum” for Dialogue Earth

by May 11, 2011

We are thrilled that Dialogue Earth is featured in the most recent issue of Momentum magazine, an award-winning publication from the University of Minnesota’s Institute on the Environment.

momentum_dropshadow_300dpi While we work to optimize key aspects of our business—from the incentives we provide crowdsourced video creators, to the quality of the underlying data for Pulse, our social media analytics tool—we’re also rapdily ramping up our efforts to engage and broaden our base of supporters and collaborators.

Indeed, this Momentum feature piece comes at a great time for us.  There’s a ton going on.

Our Pulse tool is just about ready for prime time.  In a matter of weeks, we’ll have an version of Pulse that will provide daily information on the Twittersphere’s mood about the weather.  On the heels of that, we’ll be looking at Twitter chatter related to gas prices.

(more…)

More »

Oil Companies’ Profits to Increase Greatly This Year; People’s Energy-Related Questions to Follow Suit.

by May 5, 2011

The rapid increase in oil prices should equate to the oil industry having its best year since 2008, as reported by Chris Kahn for AP (via ABC). Exxon Mobil Corp., Chevron Corp. and ConocoPhilips are expected to report a combined $18.2 billion in first quarter earnings — a 40% increase from last year and just shy of the $20.2 billion that they earned in the first three months of 2008.

An increase in consumption, the constriction of supply (e.g., Libya’s reserve access is currently limited), and also a weaker US dollar are all speculated to contribute to an increase in oil prices.

While some stand to benefit from the rise in oil prices (shareholders), businesses and consumers will feel the hurt as gasoline prices inflate. Increases in gas prices tend to have ripple effects, increasing the prices of transportation and any good or service that is reliant on transportation — bread, toiletries, DVD players, air plane tickets, etc.

The broad societal effect of an increase in oil prices is precisely what makes this issue of interest to Dialogue Earth.  This will undoubtedly augment expressed sentiment related to energy across social media platforms, such as Twitter. (more…)

More »

Teasing Out Weather Mood From Twitter Posts: A Pulse Pilot

by March 8, 2011

In choosing a topic to use as a test case for our Pulse social media analytics tool, we wanted to pick something that is broadly discussed. What better topic to start with than people’s mood about the weather? It is hard to escape having a few thoughts about the weather on a regular basis. Snow storms, sunny warm days, and heatwaves, to mention a few, cross party lines and ideological divides. Plus, people love to discuss the weather, so we figured there would be lots of chatter in the social media—and we haven’t been disappointed. Read more on our weather strategy here.

In this post, I describe our first demonstration of the Pulse platform to describe weather mood across the U.S. using 12,500 tweets collected on February 4th. While our process is a work in progress, there are several key steps: identifying and collecting useful social media posts, getting reliable judgments about the sentiment in these posts made by crowd-sourced workers, publishing the data on our Pulse platform, and finally, combining our sentiment data with external data sources to tease out a story about the drivers of the observed sentiment.

pulse2

(more…)

More »

In Search of Quality Control with Crowd-Based Sentiment Judgments

by March 4, 2011

In a previous post, I described our evolving approach for developing a question that can be addressed on our Pulse platform. We’ve also described previously why we think crowdsourcing is a smart way to get lots of judgments made about sentiment expressed in the social media. But, what about quality control? How can we maintain an acceptable level of quality control while relying on the crowd to make thousands and thousands of judgments?

Quality through known answers and feedback to workers. We were drawn to CrowdFlower because of their approach for ensuring quality control using what they call “gold”. In a typical “assignment” set up on the CrowdFlower platform, a worker needs to make judgments for a group, or assignment, of “units” (a unit in our case would be an individual Twitter tweet). Within every assignment, CrowdFlower includes a gold unit for which we have indicated the correct answer. By setting an assignment to include 15 tweets, it means that a worker will be presented with a gold unit within each new batch of 15 tweets. (more…)

More »

Preparing to Extract Weather Mood from Tweets

by March 3, 2011

weather-tweet1

Yep, it was cold this morning in the Twin Cities. I didn’t need Twitter to tell that. Yet, we can’t always assume that, just because it is cold, people are upset, or that because it is warm, people are happy about the weather. But, we believe tweets will reveal something quite interesting: how people’s emotions are indirectly affected by the weather. For example, are people happy to be inside watching a movie even though it is “super chilly” outside? Or happy that the it is raining because it will help the garden, even though they may not be eager to be out in the rain themselves?

weather-tweet2

Having set the stage for tackling the issue of weather mood on our Pulse platform, here I describe our process for developing weather as a Pulse topic. (more…)

More »

Contemplating Content Crowd-Sourcing: an Interview

by February 18, 2011

Dialogue Earth’s associate director, Tom Masterman, was recently interviewed by Crowdsourcing.org about recent projects to crowd-source the creation of Dialogue Earth videos. In this post, the first of a two-part series, Tom talks with Crowdsourcing.org’s Carl Esposti about the issues of control, quality, cost and timing.

Carl Esposti: Why did Dialogue Earth consider crowdsourcing a video project?

Tom Masterman: Just the other day, I realized that crowdsourcing now pervades most aspects of the business strategy for our start-up nonprofit, Dialogue Earth. Given some personal experiences producing corporate videos, I truly wanted to avoid the unfortunate situation where you develop something in-house (or with a single contractor or agency) that you and the executive team love, but that falls flat with your target viewers. Since our goal is to communicate science in ways easily understood by a variety of audiences, it seemed worthwhile to test how the crowd would explain our key points.

(more…)

More »

Why Weather Mood for Pulse?

by February 14, 2011

As we developed our interactive platform for the analysis of dialogue in the social media, we needed to identify a topic to start with. Specifically, we needed to identify a topic that would have a high volume of chatter on Twitter, be of general interest, and present a decent challenge for our research team. Plus, we wanted a topic that was likely to vary geographically, because Pulse is fundamentally a platform for examining trends in dialogue across geographies. (more…)

More »