Just a few hours earlier, YouTube's Steve Grove took your questions on the new National Broadband Plan to Federal Communication Commission (FCC) Chairman Julius Genachowski. Chairman Genachowski took 17 questions in the interview, exclusively from user submissions on Moderator. Check out the video below and see all the questions on CitizenTube.
Editor's note: We're excited to welcome Google's Elections and Issue Advocacy Team to the Public Sector Blog. Since 2007, they've worked with political candidates, consultants and advocates to build online advertising campaigns and fully integrate digital media into political strategy. This post marks the beginning of what we hope will be a regular series from the team. Follow the Digital Playbook label for future posts.
"So many people are living their lives through technology—how can we expect their interaction with politics to be the one exception?" This question, posed by Obama campaign manager David Plouffe, is more relevant now than ever. Hundreds of elections will be conducted this year in Congress, and no campaign can afford to ignore the Web.
On Google's Elections and Issue Advocacy team, we work with political campaigns of all stripes to help them use Google's online advertising platforms to build momentum, capture voter interest, steer debate and mobilize supporters. We've worked alongside candidates and issue groups on some of the top issues of the day—from health care reform and the Republican victories in November, to Scott Brown's upset in Massachusetts.
Today's electorate is hungry for political news and is eager to voice opinions online. This requires campaigns to adopt thoughtful and integrated strategies. And so as campaigns gear up for the November midterm elections over the coming months, we'll be sharing our thoughts on how they can take advantage of opportunities to do so. Today we are highlighting our top five strategies for using digital media to win:
1. Use search advertising to build your email list and raise money. Everyone has seen the "Sponsored Links" on Google search results. These simple text ads, called AdWords, have been compared to direct mail because of their precise targeting and cost-effectiveness—you only pay when someone clicks on your ad. At the start of the campaign and throughout, running ads in your district on the names of your candidate and opponents, and on some of the key issues, can be a great way to capture voter interest. But rather than seeking a donation right away, put the email signup form front and center. It can help you build a bigger list, with greater potential for donations and engagement in the long run.
2. "Blast" the Google Network when you need to make a big splash. The Google Content Network is made up of over a million websites that run Google ads as a way to make money, through a program we call AdSense. These ads can be simple text links, or video and image ads ("display" ads in industry lingo), tailored to your campaign's personal brand. When you want to dramatically raise the buzz level or increase momentum for your campaign—such as when you announce, or before Election Day—you can use a technique called the Google Network blast to blanket the Internet in your district or state with ads. Just about every election since 2008 has seen one or more Google Network blasts, including in Virginia and Massachusetts, and it's a great way to grab attention at crucial moments.
3. Join social networks to further amass and interact with your list of supporters. Social networking sites like Twitter, Facebook and YouTube represent massive gatherings of audiences, so they can't be ignored. Social networks allow supporters to "subscribe" or "follow" your campaign, and they're great for sharing information about your candidate and seeing that information passed on. Keep your free YouTube politician channel fresh with short videos that call out your supporters and show your candidate's human side. And don't hesitate to ask your followers to take action when needed.
4. Use data to inform your campaign decisions. One of the most exciting aspects of campaigning online is access to real-time feedback, and many of the necessary tools are free. Google Insights for Search tracks searches for your candidate and the competition within your state. Google Analytics highlights what content on your website is catching fire—and what's not. Metrics like click-through rates in Google AdWords tell you which of your campaign messages is working best right now. For an even more data-driven campaign, use Google Website Optimizer to run controlled experiments on aspects of your site to see which variations help you, for example, gather the most donations.
5. Remember: Rapid response happens online, with or without you. Americans go online when political news breaks (see: Joe Wilson). The chance to be a part of the conversation, shift perceptions, enlist support, and raise funds begins within minutes, and the window usually lasts less than three days. Bob McDonnell’s campaign deftly used search advertising to answer questions raised by his controversial thesis. Within hours of the story breaking, Virginians searching for "mcdonnell thesis" saw ads directing them to the campaign's official response.
We'll be posting further insights and best practices throughout the 2010 cycle, so keep an eye on this blog and on the Digital Playbook label. And let us know what you think—we'll be using your comments to help determine what we write about next.
Update: If you're a campaign or candidate looking for help on getting started with advertising on Google, don't hesitate to give us a shout. You can get started on AdWords yourself, though—all it takes is a credit card and a few moments to create your first ad.
Posted by Chris Talbot, Elections and Issue Advocacy Team
Google Moderator makes it easy for organizations around the world to receive questions and input from audiences of any size. Two recent uses of Moderator show how this tool can be useful worldwide.
Across the pond in the UK, the Conservative Party is using Moderator to power their new Draft Manifesto site. They're asking citizens to post questions about their health care plans and vote on submissions from others. Party Leader David Cameron will then answer the top questions in a live webcast this Friday. With three days to go, over 1,300 people have cast more than 20,000 votes.
Moderator was also a key component of the CNN/YouTube Debate at the recent Copenhagen Climate Change Conference. Visitors worldwide submitted text and video questions for the debate through Moderator, and the top questions were answered by a panel of climate experts, including Kofi Annan, Thomas Friedman, Yves de Boer, Bjorn Lomberg and Daryl Hannah.
We believe technology can empower citizens to become involved in policy-making at all levels of government. We're excited to see this process take place around the world and across all political ideologies.
Have other examples of Google Moderator or other online tools improving the policy-making process? Let us know in the comments.
As many of us recall from our civics lessons in school, the United States is a common law country. That means when judges issue opinions in legal cases, they often establish precedents that will guide the rulings of other judges in similar cases and jurisdictions. Over time, these legal opinions build, refine and clarify the laws that govern our land. For average citizens, however, it can be difficult to find or even read these landmark opinions. We think that's a problem: Laws that you don't know about, you can't follow — or make effective arguments to change.
Starting today, we're enabling people everywhere to find and read full text legal opinions from U.S. federal and state district, appellate and supreme courts using Google Scholar. You can find these opinions by searching for cases (like Planned Parenthood v. Casey), or by topics (like desegregation) or other queries that you are interested in. For example, go to Google Scholar, click on the "Legal opinions and journals" radio button, and try the query separate but equal. Your search results will include links to cases familiar to many of us in the U.S. such as Plessy v. Ferguson and Brown v. Board of Education, which explore the acceptablity of "separate but equal" facilities for citizens at two different points in the history of the U.S. But your results will also include opinions from cases that you might be less familiar with, but which have played an important role.
We think this addition to Google Scholar will empower the average citizen by helping everyone learn more about the laws that govern us all. To understand how an opinion has influenced other decisions, you can explore citing and related cases using the Cited by and Related articles links on search result pages. As you read an opinion, you can follow citations to the opinions to which it refers. You can also see how individual cases have been quoted or discussed in other opinions and in articles from law journals. Browse these by clicking on the "How Cited" link next to the case title. See, for example, the frequent citations for Roe v. Wade, for Miranda v. Arizona (the source of the famous Miranda warning) or for Terry v. Ohio (a case which helped to establish acceptable grounds for an investigative stop by a police officer).
As we worked to build this feature, we were struck by how readable and accessible these opinions are. Court opinions don't just describe a decision but also present the reasons that support the decision. In doing so, they explain the intricacies of law in the context of real-life situations. And they often do it in language that is surprisingly straightforward, even for those of us outside the legal profession. In many cases, judges have gone quite a bit out of their way to make complex legal issues easy to follow. For example, in Korematsu v. United States, the Supreme Court justices present a fascinating and easy-to-follow debate on the legality of internment of natural born citizens based on their ancestry. And in United States v. Ramirez-Lopez, Justice Kozinski, in his dissent, illustrates the key issue of the case using an imagined good-news/bad-news dialogue between the defendant and his attorney.
We would like to take this opportunity to acknowledge the work of several pioneers, who have worked on making it possible for an average citizen to educate herself about the laws of the land: Tom Bruce (Cornell LII), Jerry Dupont (LLMC), Graham Greenleaf and Andrew Mowbray (AustLII), Carl Malamud (Public.Resource.Org), Daniel Poulin (LexUM), Tim Stanley (Justia), Joe Ury (BAILII), Tim Wu (AltLaw) and many others. It is an honor to follow in their footsteps. We would also like to acknowledge the judges who have built this cathedral of justice brick by brick and have tried to make it accessible to the rest of us. We hope Google Scholar will help all of us stand on the shoulders of these giants.
The Voting Information Project, founded by the Pew Center on the States and Google, works with election officials to organize voting data across the United States, giving voters and developers easier access to useful election information. Stay tuned to learn about ways you can help bring the project to your county or state in preparation for the 2010 elections.
Posted by Dan Berlin, Public Sector Engineering Manager
Last year we worked with partners to launch tools that made it easier to find basic voting information like when to register, where to vote, and how to contact your local election office.
We're back at it this year, helping Virginians vote in the upcoming 2009 general election with the Virginia Voting Info Map and gadget, which uses a data feed built by the Virginia State Board of Elections.
If you vote in Virginia, you can enter the home address where you're registered and receive the following information:
Your polling place address and directions to get there
Candidates on your ballot, along with a link to their websites (when available)
Absentee voting information
Your local election office address and phone number
The Voting Information Project, founded by the Pew Center on the States and Google, works with election officials to organize voting data across the United States, giving voters and developers easier access to useful election information. Stay tuned to learn about ways you can help bring the project to your county or state in preparation for the 2010 elections.
Posted by Dan Berlin, Public Sector Engineering Manager
[Cross-posted from the personal blog of Google Analytics Evangelist Avinash Kaushik]
If you know what the desirable outcomes are from your website, it is not hard to measure performance of the website for you and your customers.
Measuring top line success of ecommerce websites is not very complicated, all the sweet revenue based outcomes are there (at the least).
Measuring non-profit websites is a bit complicated, but not really all that hard because we can, with a small amount of love, figure out outcomes to focus on (donations, # of sign-ups for the protest in DC, # of petitions signed, volunteer applications, etc).
Measuring government websites is a bit more complicated, if for no other reason than that it takes a pinch of effort with a dash of imagination to figure out what one is solving for. What are the desirable outcomes one can focus on to measure success?
The above question came to mind from a kind note I got from Ines Jans who is a part of the team that is responsible for www.belgium.be
Ines and team were just starting to think about analytics (because the love their customers!) and asked for some thoughts.
My first question to Ines was, (surprise!):
Q: Tell me a bit more about what your site does, like what are the real goals (or give me some ideas about it) and what challenges you face, what do you expect people to get out of it?
[Best Practice: Always, always, always start any measurement conversation with the above inquiry. The answer will be key to insights, and without it you'll simply be a glorified Reporting Squirrel.] The answer, which might fit most government websites was:
A: The goal of our site is to be a portal to all the official information there is about Belgium and make information easy to find. Visitors should be able to figure out which Ministry is responsible for what tasks.
[Best Practice: Don't be surprised in your Analysis Ninja quest if you get answers that just start the conversation, rather then give you a prescription for what you need. Squirrels will despair here, but Ninjas will take clues from what they hear and visit the site and come up with a set of important measurable outcomes.]
Based on the answer above and some time spent on the English language site as well as those in other languages (Google Translate!), I came up with the following five questions I could ask data to measure success.
~ Are Visitors able to find the information they are looking for?
~ Are the Visitors satisfied with their experience?
~ What is the most popular content on the site? What area can we prioritize higher than it currently is?
~ How long does it take for someone to find key information they want?
~ Does the right information actually exist on the website? What major things might we be missing on our website?
Let’s take each of these questions one at a time and figure out the best way to answer each using a true Web Analytics 2.0 strategy.
Q1. Are Visitors able to find the information they are looking for?
Given the singular purpose in life of this government website is to be the one stop shop for all the information one could possibly need, it should be pretty obvious that the very first, and magical, thing we would measure is if Visitors to the site are able to find what they might be looking for.
So would you use a web analytics tool?
Here’s the first surprise: No!
There are certainly tertiary ways in which you can answer this question using Omniture’s Site Catalyst or Google Analytics or other wonderful web analytics tools. But the best way to answer this question?
Ask the Visitors!
Using a simple survey that pop-up on-exit (when Visitors leave the website) you can ask your customers to tell you if they were able to complete their task. No interpretation required.
4Q from iPerceptions, available in 18 languages, is a free on-exit survey you can use. If you don’t want to use a external survey build your own, ask four questions, analyze the data for:
“Were you able to complete the purpose of your visit today?“
The answer to this question becomes the #1 Key Performance Indicator (KPI). You are going to watch it like a hawk, you’ll post it on all your bulletin boards, you’ll set up custom alerts to ensure that your team gets a small electric shock every time this number drops below 65%!
The overall number is good enough, but the data that will be awesomely actionable will be, if you use 4Q: Primary Purpose by Task Completion Rate. . .
You see the second question in 4Q is “Which of the following best describes the primary purpose of your visit?” and a standard report in 4Q will paint the above picture.
Now you not only know if people find what they are looking for, but you also know which tasks are hard to complain.
You need to fix “Complain about the French” : ) because the Visitors are already upset and only 5% are able to complete their task, resulting in them becoming even more mad!
Remember: You don’t need to show the survey to everyone who comes to your site. You can sample just a small percent of your Visitors. You only need 300 responses in a month to get a statistically significant sample of data, and 1,200 if you want to do segmented analysis.
Q2. Are the Visitors satisfied with their experience? HiPPO’s (the “highest paid person’s opinion”) in the organization, even in the government will love to have a more direct (than task completion rate) answer to the question: Are our Visitors happy with our website?
That’s were it is prudent to measure Customer Satisfaction.
4Q and other surveys of course measure that quite easily: Based on today’s visit, how would you rate your site experience overall?
Measure it. Trend it. Report it. Correlate the trend over time with changes you have made to the site and identify insights (any causal connection between site improvements / campaigns and customer satisfaction?).
An alternative, or additional, way to measure satisfaction is to count and analyze the Contact Us submissions. . . .
Start with the number of submissions. Trend over time.
Drill down into the type of complaints and do atleast rudimentary sentiment analysis (i.e. read & categorize) of actual messages to gauge customer satisfaction.
Remember: When you do surveys you don’t have to torture your Visitors with billions of questions! In researching this post I went to US government sites and I got a ugly 34 question on one single page looooong survey. 34 questions! Most were irrelevant. I would have answered a few, but this showed a fundamental disrespect for your customers. In the end your Visitors are upset and you suffer from a lack of data.
Only ask what you can action.
Q3. What is the most popular content on the site? What area can we prioritize higher than it currently is?
It is not unusual for content sites to produce content. It is even less unusual for them to produce content that they think potential visitors to the site might want.
What is rare is the analysis of what visitors to the site are actually consuming on the site. Here’s a simple analysis I had learned from Tim Hart (who was with the J. Paul Getty Trust): Measure the distribution of content in each section of your website and the percentage of Visits to each section.
On the y-axis is each of the sections on the belgium.be website. In blue is the amount of content in each section. In red are the percentage of visits where that content was consumed.
Is it not awesome! Insights galore!!
If this were their data, and it is not, it would be pretty obvious that there is huge interest in content about Housing and Economy tiny fraction of the site’s content is about Housing and Economy.
The balance for Family is a lot less lop sided.
While the government might love Justice, Mobility and Health (and boy do they love Environment!), Visitors to the site are a lot less interested in those pieces of content.
Action? You know what people want, how about giving them more of that content?
When it comes time to prioritize the next set of web pages or videos or podcasts, how about giving higher priority to those big red lines?
Sweet right?
You can also do segmented version of this analysis, see what Visitors to English, Dutch, French and German sites prefer. Or within Family what group of content do people like. Etc etc.
Two more ideas to get into your Visitor’s head. . . .
Measure Downloads:
There are a ton of downloads (pdf’s mostly) on the belgium.be website. Forms, applications, useful guides (like how to marry a belgian or how to prepare for your first job) etc.
It is a trivial cost, analytically, to track these downloads using your web analytics tool. Do it. Measure what your Visitors are most interested in.
Yes, yes, yes I see my technical squirrel friends raising their hands and saying you can only track that someone clicked on the download link and not that the download was successful. I know.
For our analysis here just intent is fine.
In fact unless a vast majority of your Visitors are connecting using dial up it is safe to assume the download of small files went through. I know that does not make the squirrels happy. I am sorry. You keep squirreling while we make decisions about how to improve the site.
Outbound Link Tracking:
Another thing you’ll notice about the website (see why it helps to surf a site you are supposed to analyze?) is that there are a ton of links on the site that point to other government websites. Track ‘em!
Of course the above is not their data :), it’s just an illustration of how absolutely easy it is to track this data.
From the report it is very easy to then figure out what links your Visitors click, which is a great, positive, indicator of the fact that they found what they wanted and also what they were interested in.
Remember: It is not very hard to do any of the above three types of analysis. All you need to get into your customer’s head is move away from “Top Pages Viewed” and “Page Views Per Visitors” and think a bit more creatively.
Q4. How long does it take for someone to find key information they want?
There are some pieces of content that are so darn important that they are heavily linked (say latest news in case of belgium.be) right from the home page, or that you really do want people to find them asap (in the Health section for example the pdf about how to deal with H1N1 virus in belgium). For these important pieces of content measure Average Time To This Page.
That’s almost three minutes from the time that someone entered the website to the time they found this page (say the one about swine flu).
On average people give a page two and half seconds before they click/leave. Consider how long three minutes is, and how many people might have given up in the process of finding this key information.
Unfortunately not too many tools, Google Analytics and other Paid Solutions included, provide this as a standard metric. I use ClickTracks and that this delightful metric as a standard offering.
I wish others would have it.
Remember: You can use this data to ensure that your best information is found by Visitors to your site quickly. Fix your top / left / right / bottom / whatever navigation you have on the site. Consider creating a prominent “box” on the top right where you “merchandize” these important links. More things like that.
Q5. Does the right information actually exist on the website? What major things might we be missing on our website?
Like many other sites belgium.be has a internal site search engine. Typically Visitors who have a harder time with normal navigation (or limited data on a page) will make liberal use of this site search box.
Why not use that data?
Again, this is not their data :).
I recommend looking at the top typed search terms by the Visitor but then also looking at the metric: % Search Exits.
That’s the bounce rate of your search results page. I.E. People come to belgium.be, search for the term hippo and the search results are so bad that 33.33% of the people exit from that page! They don’t even bother to do anything. Just bail. Bounce. Kaput!
Now you know both 1. what information they were looking for, 2. what search results stink and 3. likely because you don’t have the right or enough content about that keyword on your site.
Fix it!
I have one more idea to understand if you are missing information that your Visitors want on your government website.
Use Page Level surveys.
There are free page level surveys available or you can build your own (like the one above from a software vendor’s website).
These can be an excellent way to understand what content is missing from your website. You can of course also use the open text voice of customer (VOC) from surveys like 4Q, look for Visits with Task Completion = No.
Remember: These surveys don’t collect any personally identifiable information (PII) information, and that goes for your web analytics tools as well. Many government sites are extra concerned about privacy, as they should be. Do Please familiarize yourself with the privacy policies of the vendor.
Note: What was not tracked or emphasized. . .
Visits.
Unique Visitors.
Page Views.
Time on Site.
And so many more mundane and perhaps more “famous” web metrics.
I am sure most government or normal websites jump to that first. And why not, they are all staring you in the face when you crack open any analytics tool.
The problem is that these aggregate metrics barely contain any insight. If you focus on them, you’ll be left holding a empty bucket / cry a lot / get fired / not get your government pension / dread meetings with your boss.
I hope the above ideas inspire you to do more, go beyond the obvious and less than useful.
One last quick example. . .
You can use the same strategy for other sites. Though remember the job the site is trying to do and the desired outcomes will decide which key performance indicators you end up using.
For example for www.recovery.gov in addition to some of the metrics above I would probably also measure Visitor Loyalty and Recency. That’s because the government wants the data provided to be so sticky, and it is updated frequently, that it wants you to come and check it again and again.
In this case perhaps more than downloads I would also measure # of customized graphs created. When I measure content consumed (#3 above) I’ll probably focus on understanding which departments get looked at more on the site (are they the ones most spending money?).
You can also bet I am going to be totally on top of reporting how many complaints we have received on the site for Fraud, Waste & Abuse! Getting a ton of those would be a key performance indicator! : )
Makes sense?
Don’t despair just because you have a government site. Ignore the obvious. Focus on the site’s jobs. Identify key outcomes. Do productive analysis.
Good luck.
Ok now it’s your turn.
Are you responsible for a government website? What are your key performance indicators? What web metrics are important to you? Do you use any of the above strategies? If not, why not? Have you looked at www.belgium.be? What would you have recommend that I did not?
Please share your valuable advice / insights / feedback / critique (on my blog).
Thanks.
PS: Like this post? Perhaps you’ll consider ordering my * new * book: Web Analytics 2.0.
PPS: Couple other related posts you might find interesting:
For more than 70 years, the Federal Register has been the official daily record for federal agency rules and notices, executive orders, and other presidential documents. But at 80,000 pages per year, it lands on your desk with a thud.
That's one reason why we're excited to see that the U.S. government is taking steps to make the Federal Register more open and accessible to citizens. Starting today, the Federal Register will be published in XML format to Data.gov, which will allow third-parties to develop new ways to organize, re-organize, and analyze its contents. Past issues of the Federal Register dating back to 2000 will also be posted online.
We're already seeing cool new tools emerge around this data. This morning Ed Felten of Princeton's Center for Information Technology Policyannounced the launch of Fedthread.org, which allows users to annotate and search the Federal Register. The tool also allows users to set up customized RSS feeds for specific search queries, which will allow users to track items and issues over time. Amazingly, the project took only 10 days to create.
The Washington Post describes the Federal Register as the "de facto daily newspaper of the executive branch." Making the Federal Register available on Data.gov is an important step towards making that newspaper more accessible to citizens across the country.