AllThingsD » migration

Twitter Brags of Successful Data Center Migration

Liz Gannes — Mon, 21 Mar 2011 22:30:56 +0000

Twitter, after years of fighting the Fail Whale, has recently made major changes under the hood to ensure its messaging service will stay online. Its engineering and operations teams coordinated a massive effort starting last September to migrate Twitter not once, but twice, shifting 20 TB of tweets and live traffic-serving from a first data center to a second testing center to its third “final nesting ground.”

Over the last couple months in particular, I’ve heard murmurs through the grapevine of Twitter engineers boasting as shifts happened with no disruption to the service.

Twitter VP of Engineering Michael Abbott publicly bragged about the migration today in a blog post, but declined to disclose where the data center musical chairs actually occurred, or why multiple moves were necessary.

Since 2008, the company–which coincidentally is celebrating the five-year anniversary of the first tweet today–2008 had been using NTT America Enterprise Hosting Services, which has a data center in San Jose, Calif., and later expanded to Santa Clara. In July 2010, Twitter said it would move into a custom-built data center in Salt Lake City before the end of that year.

But that didn’t happen, and in December, Twitter reportedly leased data center space in Sacramento.

In a rare sentence that didn’t include a bird metaphor (flocking! nesting! migration!), Abbott described the implications of the data center move in his blog post: “This move gives us the capacity to deliver Tweets with greater reliability and speed, and creates more runway to focus on the most interesting operations and engineering problems.”

IBM Brings the Cloud to New York City

Arik Hesseldahl — Mon, 31 Jan 2011 14:30:44 +0000

Computing giant IBM has announced that it has landed a contract to consolidate the computing operations of 14 different New York City agencies to a modern cloud computing environment.

The contract, I’m told, is worth $7.7 million and covers the first part of a three-phase project called CITIServe, which will ultimately see the consolidation of 50 different municipal data center operations scattered around the city over five years. The city hopes to save $100 million on its IT budget over the five years. Helpful, yes, but it’s not likely to put much of a dent in the city’s budget deficit, which is expected to be $2.4 billion in the fiscal year beginning July 1.

It might not occur to the average New Yorker that the city has so many data centers. It certainly surprised me, though calling them data centers may be overstating it a bit. A few are groups of servers in back offices no bigger than 1,000 square feet. The plan is to get them centralized both physically and from a management perspective. Each agency has its own staff handling the management.

The first things that will be streamlined in this phase of the project are the help desk, hosting, storage, email, virtualization and network for several city departments, though neither IBM nor the city is saying yet exactly which departments are involved. A statement from the city last March said the departments of Education, Buildings, Housing Preservation and Development, Sanitation and Finance would be among the first involved. Finance itself will be a pretty big job. It collects $25 billion in taxes and other revenue, and assesses about a million individual properties collectively worth more than $1 trillion. Then there’s the matter of the 10 million parking tickets the city issues each year.

The agency in the spotlight is the Department of Information Technology and Telecommunications, which will be in charge of managing the migration and then will run the new data centers once they’re operational. The plan is the result of a top-down 30-day study of the city’s IT infrastructure that Mayor Mike Bloomberg ordered last year.

Getting these services centralized will make them easier to protect and reduce the power needed to run them, thus reducing the city government’s carbon footprint, says David Cohn, program manager of the Smarter Cloud program at IBM Research. It’s not uncommon for servers that are set up to run just one application to use only 10 percent of their computing capacity, and then sit idle the rest of the time, burning electricity throughout that idle time.

“Getting a smaller number of systems running more applications and using less power is just the beginning,” Cohn told me. “After that you start developing deeper insight into where all your information is going that you couldn’t get before.”

It’s a positive sign for IBM on the cloud computing front. You may remember that Ric Telford, IBM’s VP of cloud services, said government is a segment it considers a priority this year. If New York successfully adopts the cloud, more will probably follow.

Windows 7 Upgrade Made Easy

Katherine Boehret — Tue, 13 Oct 2009 22:16:03 +0000

Windows 7, Microsoft Corp.’s new operating system due out next week, is giving the company a lot to be happy about. By early reports, it’s fast, easy on the eyes and fixes most of the problems that plagued its predecessor, Vista. But while Microsoft (MSFT) employees are doing the dance of joy, some consumers are confused and scared about the prospect of upgrading their computers to Windows 7.

[ See post to watch video ]

The upgrade from Windows XP to Windows 7 is particularly daunting because it requires first wiping the computer’s hard disk to perform what’s called a “custom” or “clean” install. This clears out the old operating system—as well as all of your programs, files and settings. To save personal files, XP users must back them up first, typically on an external hard disk, then transfer them back. Programs, however, will be lost altogether, so users must re-install these using their original CDs or installation files, and then also re-install all the program updates they’ve accumulated over the years.

People upgrading to Windows 7 from Vista may have it easier. In some common cases, they can upgrade to Windows 7 “in place,” which means they can save programs, files and settings right where they were. But since Vista was such a dud, many Windows users still use XP.

This week, I tested a program that tries to make the upgrade to Windows 7 just as easy for XP users as it is for some Vista users. I tested Laplink Software Inc.’s PCmover Windows 7 Upgrade Assistant (http://bit.ly/JeafI), a $15 program that saves programs, files and settings on the computer in a place that won’t be affected by the installation of Windows. This eliminates the hassle of using an external hard disk or re-installing programs. The company uses the analogy of a moving van to load up your computer’s information, storing it locally until it can be unloaded again on the same PC with a new operating system.

I tested this program using an Acer Aspire One netbook running Windows XP. It took me two hours from start to finish, a three-part process of installing the Upgrade Assistant, installing Windows 7, and then re-installing the PCmover program. I followed instructions and the process of upgrading was really quite easy, showing me the programs and files (photos, videos and documents) I had on my old operating system.

Afterward, I did have to dig around on my computer a little bit to make some adjustments, like fixing Apple’s (AAPL) iTunes music program so it opened in Windows 7. And I found it a little annoying that, throughout the process, the Upgrade Assistant tried to get me to buy more software programs, like RegistryBooster and DiskImage, by saying the programs would better prepare my old PC for the switch.

Laplink’s $15 PCmover Windows 7 Upgrade Assistant helps smooth the way for some XP users to upgrade to Windows 7.

The Upgrade Assistant also works with PCs running Vista. Microsoft offers an in-place upgrade option from Vista to 7, but this mainly works for people transferring from an identical version of Vista to an identical version of 7, like Windows Vista 32-bit Home Premium to Windows 7 32-bit Home Premium.

This program won’t magically fix every upgrade issue you face. If you bought your computer many years ago, it may not be able to run Windows 7 at all, because the hardware may be insufficient.

Another problem is that most netbooks and some laptops don’t come with built-in disk drives, making it a challenge to install Windows 7, since it comes on a DVD. I had to call around town to find a Radio Shack selling an external DVD disk drive that plugged into my Acer netbook via a USB cord.

Some security software programs, like that from McAfee Inc. (MFE) and Symantec Corp.’s (SYMC) Norton Antivirus, may not transfer over to Windows 7, though you should be able to manually install them after the migration.

When first installing the Upgrade Assistant, you can choose to do a full migration (files, settings and programs); just move files and settings; move files only; or perform a custom migration. You also can specify which user accounts to include or exclude and you can opt to exclude certain types of files, like temporary files.

After the PCmover program assessed the contents of my PC, it explained that it was packing my content into a “moving van”—a file for holding the content—and offered to break the moving van’s content into smaller parts for people who have storage limitations while transferring.

It’s a little nerve-wracking to think about transferring your computer’s entire contents over without being able to see where the files are going. At least on an external hard disk, you feel like the files are stored on something tangible and accessible—even if some step in the migration goes terribly wrong and the laptop never starts again, however unlikely.

After installing Windows 7 and then re-installing the PCmover program, I was finished. The next time I turned on the PC, a program called StartUp immediately started to run. This appeared to show me a list of programs that automatically ran on my old operating system but which PCmover disabled from running automatically on Windows 7. A quick step allowed programs that I selected to automatically run again.

One thing to note as you upgrade from Windows XP is that your PC may not be equipped to deliver the full Windows 7 experience. Windows 7 Upgrade Advisor Beta, Microsoft’s own tool, analyzes what will and won’t work properly when the newest version of Windows installs. The Upgrade Advisor warned me that Windows Aero, the name used for some of the gorgeous visuals in Windows 7, wasn’t capable of working with my netbook’s graphics adapter. Sure enough, Aero’s ability to show tiny, pop-up previews of programs that are running in your taskbar as you hover over them didn’t work. Instead, the names of the files and programs appeared in text-only preview panes.

The downloadable version of the Upgrade Assistant is now $15 for one license to use on one PC—a special pre-release price before Windows 7 is available Oct. 22. After that, the downloadable version will cost $20 from Laplink.com for one license to use on one PC. If you would rather not download this program, it also will be available for purchase in retail stores by the end of October. Of course, you also will have to buy a copy of Windows 7; the version most consumers will want is called Home Premium and it costs $120 as an upgrade.

If you are considering Windows 7 and you are currently using Windows XP on a relatively new PC, a simpler and better-organized migration process is worth the nominal price of Laplink’s PCmover Windows 7 Upgrade Assistant.

Edited by Walter. S. Mossberg

Write to Katherine Boehret at mossbergsolution@wsj.com

Upgrading from XP to Windows 7

Walter S. Mossberg — Wed, 29 Jul 2009 21:54:01 +0000

This week’s Mailbox is devoted to the most common of the hundreds of questions I received in response to last week’s Personal Technology column describing how difficult and time-consuming it will be to upgrade a Windows XP computer to Microsoft’s forthcoming Windows 7 operating system.

To avoid the difficulties you described last week with migrating from Windows XP to Windows 7, what do you think about a two-step approach whereby we buy Vista, upgrade from XP to Vista, and then go from Vista to Windows 7?

That would work, since–unlike those running XP–PCs running Vista can be upgraded to Windows 7 directly, without wiping their hard drives, displacing any files or re-installing any programs.

However, you’d be doing twice the work and paying for two new versions of Windows instead of one.

If I bought a Vista computer, but had it downgraded at the factory to XP, will my situation be any different than what you described should I choose to migrate to Windows 7?

According to Microsoft, the answer is no. Your computer is now a Windows XP computer, and thus still has no direct upgrade path to Windows 7. You would still have to remove and later restore your personal files, wipe your hard disk clean, and then re-install all your programs. However, if you received Windows Vista installation disks with the machine, you could upgrade it to Windows Vista first, and then, upgrade it directly to Windows 7, a process that doesn’t require any of those cumbersome steps.

Does the difficult scenario of moving from Windows XP to Windows 7 that you described last week also apply to those of us who run XP on Macs in virtual-machine programs like Parallels or Fusion?

Yes. Microsoft says the same migration steps are necessary whether the Windows XP computer is physical or virtual, and that includes Macs running XP via the Parallels or Fusion software.

It also applies if you are running XP on a Mac using Apple’s Boot Camp program and wish to move to Windows 7.

After Windows 7 comes out in October, will Microsoft somehow force us XP users to stop using it? Is there any reason I have to upgrade, or can I keep using XP, which meets my needs perfectly?

You can keep using Windows XP and all your current programs on your current computer. It won’t suddenly expire.

Especially in light of how hard it will be to upgrade, can you please explain what advantages Windows 7 will have over XP, which is tried and true? I deliberately skipped Vista and am inclined to skip this new Windows version as well.

People should never feel stampeded to upgrade their technology and should keep using whatever meets their needs and makes them comfortable.

However, based on my testing of pre-release versions of Windows 7, I would say it is significantly better than XP, which, after all, was designed a decade ago, an eternity in computer time.

I’ll cite just a few examples. Microsoft says that Windows 7 is more secure than XP, because its underlying architecture allows more defenses against malicious software than in the older product. Microsoft claims, and my tests bear out, that Windows 7 makes networking computers much simpler, quicker and more reliable than XP does. And the company says that Wi-Fi networks work better and faster than they do with XP.

I would add that, if Windows 7 catches on in a way that Vista didn’t, you may gradually find that new software and hardware makers will stop bothering to make their products compatible with XP, though this process will take years.

You can find Mossberg’s Mailbox, and my other columns, online for free at the All Things Digital Web site, http://walt.allthingsd.com.

A Problem Has Been Detected With Your Classified Mission. Windows Has been Shut Down to Prevent Damage to Your Computer.

John Paczkowski — Mon, 25 May 2009 17:11:16 +0000

How slow are government agencies at adopting new technologies? So slow that the U.S. Army is planning a major upgrade of its information systems– to Microsoft’s (MSFT) Windows Vista OS.

Though Windows 7 is expected at market by the end of the year, the United States military has set that as a deadline for its migration from Windows XP to the “worthy, but largely unexciting” Windows Vista and from Office 2003 to Office 2007.

The Army has been testing Vista since 2006 and its decision to move forward with a migration of its 744,000 desktops–on both classified and unclassified networks–was apparently driven by the OS’s improved security. “First, they see real value in Windows Vista’s improved security architecture,” Microsoft senior director Gavriella Schuster said in a statement. “Second, it shows large organizations have unique needs and timetables for deployment. These things take time–they have been rigorously testing internally–and it makes sense that they have approached deployment in a measured and well-planned way, especially given the number of seats they are migrating to Windows Vista.”