6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Opening Keynote: Test is Dead
Presented by Alberto Savoia

ABSTRACT

The way most software is designed, developed, and launched has changed dramatically over the last decade -- but what about testing? Alberto Savoia believes that software testing as we knew it is dead -- or at least moribund -- in which case we should stick a fork in it and proactively take it out of its misery for good. In this opening keynote of biblical scope, Alberto will cast stones at the old test-mentality and will try his darnedest to agitate you and convince you that these days most testers should follow a new test-mentality, one which includes shifting their focus and priority from "Are we building it right?" to "Are we building the right it?" The subtitle of this year's GTAC is "cloudy with a chance of tests," and if anyone can gather the clouds into a hurricane, it's Alberto -- it might be wise to bring your umbrella.

Alberto Savoia is Director of Engineering and Innovation Agitator at Google. In addition to leading several major product development efforts (including the launch of Google AdWords), Alberto has been a lifelong believer, champion, innovator and entrepreneur in the area of developer testing and test automation tools. He is a frequent keynote speaker and the author of many articles on testing, including the classic booklet "The Way of Testivus" and "Beautiful Tests" in O'Reilly's Beautiful Code. His work in software development tools has won him several awards including the 2005 Wall Street Journal Technical Innovator Award, InfoWorld's Technology of the Year award, and no fewer than four Software Development Magazine Jolt Awards.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Vishal Chowdhary, Microsoft

ABSTRACT

In this session, we share our experiences for testing the Microsoft Translator (MT) service. Testing the translator service can be divided into two broad areas -- (1) Testing of the machine learning system that returns the translation answer and (2) the web service that serves translate requests running on the Microsoft cloud. The MT service offers translation in 36 different languages for users across the globe through UI and API. Testing the MT cloud service without user data would be like shooting in the dark. From a product standpoint, we need to answer questions like How do we prioritize languages for improvement? How do we divide resources in our data center for effective capacity distribution for the languages? From a test perspective we need to understand how the system is being used so that we can ensure that any new bits deployed will hold-up in production.

We will discuss the following three problems: Strategy for testing the machine learning system. How do you perform load testing for the translation service running in the cloud? How can one extend the role of test by completely skipping the 'opening bugs' step?

With Microsoft for the past seven years, Vishal Chowdhary is currently with the MSR - Machine Translation (MT) team where he is responsible for both performance and scale testing of the MT cloud service and the machine translation quality. In the past, he has been involved with BizTalk, .NET Framework Wf and Wcf, and the Windows Azure AppFabric teams where he owned test strategy, test framework design, and feature testing. Vishal is passionate about making testing simpler and more interesting by employing new testing strategies and processes that prevent defects from entering the product.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Andre Arcilla.

ABSTRACT

Hadoop is the distributed technology that powers Yahoo! grids. Due to the complex nature of the Hadoop ecosystem, Hadoop stack deployment requires significant investments of time and engineering expertise. Hadoop engineering team came up with a solution for automatic deployment and validation of the software stacks on a small computational footprint, enabling wider use of the technology for running small-scale trials, and using and testing Hadoop-based products in realistic environments. This talk presents HIT - Hadoop deployment and integration test environment that enables rapid automated Hadoop deployment.

Andre Arcilla is the Hadoop Integration Architect at Yahoo!, focused on assembly and deployment of Hadoop ecosystem. He previous experience includes architecting and building scalable utility and distributed enterprise solutions.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Yana Margolin and Jason Elbaum.

ABSTRACT

BidiChecker is a tool for the automated testing of web pages for errors in support of right-to-left (RTL) languages, also known as bidirectional (bidi) because they routinely include left-to-right items such as numbers and Latin-script words and phrases. Bidi support for a web page is a common requirement, even for pages in left-to-right scripts. Any page which accepts user input or displays multilingual content is likely to end up handling bidirectional text at some point, as it will eventually encounter data in Arabic, Hebrew or another RTL language. BidiChecker provides a Javascript API which can be easily integrated into an existing test suite. It also supports a browser bookmarklet which lets you run the checks manually on any web page and browse through the errors highlighted on the page. We'll talk a bit about common bidi bugs, then describe and demonstrate BidiChecker.

Yana Margolin joined Google in 2009. Since then she's been in charge of testing bidirectional text support implementation across various Google applications. Her focus includes promoting BidiChecker - an internally developed, open-sourced, automated tool for bidirectional text handling testing, as well as facilitating product development teams to switch from manual testing model to an automated one. Prior to Google, Yana was a QA Team Manager at WebCollage Israel LTD, a content syndication provider, who built the company's testing team from scratch.

Jason Elbaum has been at Google since 2008, where he develops infrastructure for supporting bidirectional languages. Before that he spent nine years at Motorola/Freescale Semiconductor. He has degrees in computer science from Princeton University and economics from the London School of Economics, and worked at Imperial College London as a research assistant in petroleum engineering (really!). Originally from suburban Washington, D.C., he now lives with his wife and two kids in Israel, where he umpires Little League baseball.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Anthony Voellm.

ABSTRACT

The world of building software is undergoing rapid changes with the shift from desktop applications to highly connected and ubiquitous applications served from the Cloud. The shift to the Cloud poses new challenges (eq: how do you run xUnit frameworks on PAAS?) and opportunities on how to test while also creating whole new ways of testing in general (eg: fuzz testing on hundreds of machines for little cost). This talk will focus on helping you understand the challenges and opportunities while separating fact from fiction. It's time to part the Clouds and understand what lies ahead.

Anthony F. Voellm currently leads the Google Cloud Test team and has a wide range of experience from kernel and database engines to graphics and automated image and map extraction from satellite images. Anthony is an avid inventor with 7 technology patents issued. He is focused on delivering Rerformance, Reliability, and Security to existing products like Google Cloud Storage and Dremel while also innovating new offerings. Prior to joining Google in 2011, Anthony held multiple roles at Microsoft leading the Microsoft Windows Reliability, Security, and Privacy test team working on Windows7+; Microsoft Hyper-V Performance Team; and SQL Server Performance team. He has also been a developer and tester on the Windows Filesystem, SQL Server Engine, and SGI IRIX networking teams. Anthony has taught performance testing to over 2,000 people worldwide and given dozens of informative talks on software fundamentals. He keeps a personal technology blog on software fundamentals at perfguy.blogspot.com. In addition to computer interests his passions lie in growing engineers, building things, and doing anything outdoors. Anthony holds a Master of Science from George Washington University, BA in Physics and a BS in Computer Science and Mathematics from the University of Vermont.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Kevin Menard.

ABSTRACT

Web Consistency Testing is a new form of automated Web testing that answers the simple question "does this page look the way it should?". Historically, the way a page looks has been relegated to the status of "design artifact" and as such, been treated as something that must be tested with human eyes. In my talk I present the results of research and development of an automated issue detection system that can be extended in numerous dimensions to detect cross-browser rendering issues, CSS regressions, and i18n differences. Using the simplest representation possible, the "golden copy" of a page, this system requires no site-specific programming, making Web Consistency Testing available to every person in an organization, from product manager to QA engineer.

Kevin is the founder of Mogotest, a Web Consistency Testing service that aims to change the way we test Web sites and applications and simultaneously make testing available to all. He's been involved with many open source projects over the years, most notably the Apache Cayenne and Tapestry projects, Selenium, svn2git, and the rubber Capistrano plugin for cloud provisioning and deployment of Ruby applications. He is an Apache Software Foundation member and the current maintainer of the Selenium Grid project.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Roy Williams.

ABSTRACT

WebGL will enable developers to create richer web applications than ever before by giving developers full access to the GPU on their users' machines. Testing this new capability presents unique challenges new to most web developers. In this talk we'll be discussing techniques and tools used for testing WebGL applications inside of Google, as well as some tips for building your own WebGL applications.

Roy Williams has been at Google for 2 years, and was at Microsoft for 5 years prior to that. Some of his major externally visible accomplishments include launching Route Around Traffic in Google Maps for Android. Roy has his BSc in Computer Science from Duke University. He lives in Seattle with his wife Tara.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Hugh Thompson, People Security.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Lightning Talks I: A series of 5-minute technical talks about cloud testing.

More information about talks and speakers here:
http://www.gtac.biz/speakers

Testing Cloud Failover
Roussi Roussev, VMware

Behind Salesforce Cloud: Test Automation Cloud and Yoda
Chris Chen, Salesforce

ABFT in the Cloud
Timothy Crooks, CygNet

ScriptCover: Javascript Coverage Analysis Tool
Ekaterina Kamenskaya, Google

Cloud Sourcing - Realistic Performance, Load and Stress Testing
Sai Chintala, AppLabs

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Adam Christian.

ABSTRACT

In a world where Javascript is everywhere; your browser, server, database, mobile device -- you want and need code resuse to speed up development. In order to do this, you need to know that code works in all the environments you care about.

Jellyfish is a node project focused on provisioning different environments and making it easy for you to execute your JS and get the results.

Adam is the co-creator of Windmill and various other open source projects, including Mozmill (the XUL test automation project), and Jellyfish. He also works on a small snowboarding video blog called EatPow. His personal blog is at adamchristian.com. He is currently employed as a Javascript Architect at Sauce Labs.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Simon Stewart.

ABSTRACT

Google has a unique infrastructure for running web tests. This talk will focus on how this infrastructure evolved, from running tests on local machines, all the way up to the sophisticated tools available for Googlers now. Along the way, you'll learn how you, too, can build something similar using OSS, and a little bit of elbow grease. You'll walk away knowing just how much effort you want to expend on running your tests in the cloud, and whether a private or public implementation is the right thing for you.

Simon Stewart lives in London and works as a Senior Software Engineer in Test at Google. He is the current lead of the Open Source Selenium project and deeply involved with browser automation at work. Simon's first GTAC experience was in New York, where his carefully planned demo went horribly awry. It has been said before that Simon enjoys beer and writing better software, sometimes at the same time. This continues to be true. He is also the top hit for the search 'steel cage knife fight', a fact that makes him inordinately proud.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Ibrahim El Far and Jason Arbon

ABSTRACT

Today's test engineering is labor intensive, requires expensive switches in context, involves so much grunt work that it stifles creativity and slows down productivity, and, finally, it often ignores product and customer risks. Come and learn about the latest Google has to offer in open source test tools that help manual testers by eliminating much of the grunt work, keeping them focused on testing, and helping them prioritize their efforts based on risk. Chief among these are BITE, Quality Bots, Test Analytics, and Script Cover, the first two of which are the focus of this talk.

Ibrahim is an engineering manager at Google leading a team dedicated to building next-generation test tools for the web. Earlier he was a software engineer building developer tools used across the company. Prior to Google, Ibrahim was at Microsoft where he led tools and QA teams in Bing and SQL Server. His academic background includes extensive graduate-level work in software testing at the Florida Institute of Technology.

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Lightning Talks II - a series of 5 minute talks on Web Testing.

For abstracts and speaker bios, please see http://www.gtac.biz/speakers .

Mobile Web Testing Using WebDriver
Dounia Berrada, Google

jstestnet: CI with JavaScript Integration Tests
David Clarke, Mozilla

NativeDriver
Matt DeVore, Google

Page Coverage
David Burns, Mozilla

Writing Tests in Plain English
Jerome Mueller, Google

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Misko Hevery.

ABSTRACT

Angular teaches your old browser new tricks. It is what HTML would have been had it been designed for building web-applications. Angular is radical because it eliminates boilerplate code with declarative rather than imperative syntax.

Angular:
* Allows you to create custom HTML elements and attributes that provide dynamic behavior
* Declaratively describe web-applications behavior with little JavaScript.
* Creates an environment that provides trivially reusable widgets, data-binding, "automatic MVC", server resources, and other primitives useful in building AJAX apps.
* Builds apps that have orders of magnitude less JavaScript than equivalent apps written in classical way.
* Eliminates waiting on compiling for UI changes.

Having an awesome framework is not enough, one needs to also have an awesome testability story. In this session we will focus on all of the work which we have done to make applications written in Angular a joy to test.

Misko Hevery works as an Agile Coach at Google where he is responsible for coaching Googlers to maintain the high level of automated testing culture. This allows Google to do frequent releases of its web applications with consistent high quality. Previously he worked at Adobe, Sun Microsystems, Intel, and Xerox (to name a few), where he became an expert in building web applications in web related technologies such as Java, JavaScript, Flex and ActionScript. He is very involved in Open Source community and an author of several open source projects such as Angular (http://angularjs.org) and JsTestDriver (http://code.google.com/p/js-test-driver).

Read more about this video…

6th Annual Google Test Automation Conference 2011 (GTAC 2011)
"Cloudy With A Chance Of Tests"
Computer History Museum
Mountain View, CA USA
October 26-27, 2011

Presented by Steve McConnell.

ABSTRACT

Construx consultants work with literally hundreds of software organizations each year. Among these organizations, a few stand out as being truly world class. They are exceptional in their ability to meet their software development goals and exceptional in the contribution they make to their companies' overall business success. Do world class software organizations operate differently than average organizations? In Construx's experience, the answer is a resounding "YES." In this talk, award-winning author Steve McConnell reveals the technical, management, business, and cultural secrets that make a software organization world class.

Steve McConnell is CEO and Chief Software Engineer at Construx Software where he consults to a broad range of industries, teaches seminars, and oversees Construx's software engineering practices. Readers of Software Development magazine named him one of the three most influential people in the software industry along with Bill Gates and Linus Torvalds. Steve is the author of Software Estimation: Demystifying the Black Art (2006), Code Complete (1993, 2004), Rapid Development (1996), Software Project Survival Guide (1998), and Professional Software Development(2004), as well as numerous technical articles. His books have won numerous awards for "Best Book of the Year" from Software Development magazine, Game Developer magazine, Amazon.com's editors, and other sources. Steve serves as Editor-in-Chief Emeritus of IEEE Software magazine, is on the Panel of Experts of the SWEBOK project, and is past Chair of the IEEE Computer Society's Professional Practices Committee. He can be reached at stevemcc@construx.com.

Read more about this video…

Google Tech Talks
October 23, 2008

ABSTRACT

Presented by James Whittaker, Microsoft Corp. at the 3rd Annual Google Test Automation Conference (GTAC) held in Seattle, WA on October 23-24, 2008.

Read more about this video…

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Andres Almiray

Google Tech Talks
October 23, 2008

Read more about this video…

GTAC 2008: The New Genomics - Software Development at Petabyte Scale

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Matt Wood

Google Tech Talks
October 23, 2008

Read more about this video…

GTAC 2008: Using Cloud Computing to Automate Full-Scale System Tests

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Marc-Elian Begin

Google Tech Talks
October 23, 2008

Read more about this video…

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Opening Remarks

Speaker: Lydia Ash

Google Tech Talks
October 23, 2008

Read more about this video…

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Elfriede Dustin
Speaker: Marcus Borch

Google Tech Talks
October 23, 2008

Read more about this video…

GTAC 2008: Taming the Beast - How to Test an AJAX Application

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Markus Clermont
Speaker: John Thomas

Google Tech Talks
October 23, 2008

Read more about this video…

GTAC 2008: Automated Model-Based Testing of Web Applications

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Atif M. Memon
Speaker: Oluwaseun Akinmade

Google Tech Talks
October 24, 2008

Read more about this video…

GTAC 2008: Atom Publishing Protocol - Testing Your Server Implementation

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: David Calavera

Google Tech Talks
October 24, 2008

Read more about this video…

GTAC 2008: Practicing Testability in the Real World

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Vishal Chowdhary

Google Tech Talks
October 24, 2008

Read more about this video…

GTAC 2008: Context-Driven Test Automation - How to Build the System You Really Need

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Pete Schneider

Google Tech Talks
October 24, 2008

Read more about this video…

GTAC 2008: Simple Tools to Fight the Bigger Quality Battle: Continuous Integration Using Batch Files and Task Scheduler

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Komal Joshi
Speaker: Patrick Martin

Google Tech Talks
October 24, 2008

Read more about this video…

GTAC 2008: JInjector - A Coverage and End-to-End Testing Framework for J2ME and RIM

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Julian Harty
Speaker: Olivier Gaillard
Speaker: Michele Sama

Google Tech Talks
October 24, 2008

Read more about this video…

GTAC 2008: Context-Driven Test Automation - The Value of Small Tests

The Third Annual Google Test Automation Conference (GTAC), Seattle, WA, Oct. 23rd and 24th.

Speaker: Christopher Semturs

Google Tech Talks
October 24, 2008

Read more about this video…