While eHarmony Inc.’s goal is to get its 20 million members married or into long-term relationships, the online matchmaker is a downright commitment-phobe in its use of technology.
For the business intelligence infrastructure that powers if its matchmaking algorithms and maximizes the effectiveness of its numerous TV ads, the firm relies on four database and data warehousing products.
They include Oracle Database, the open-source MySQL database, another open-source data-crunching app, Hadoop, and data warehousing appliances from Netezza
For some IT managers, managing four such disparate products wouldn’t be worth the trouble. But not for Joseph Essas, vice-president of engineering and operations for eHarmony.
“We always use multiple vendors for different things,” Essas told the audience during his speech Wednesday at Computerworld’s Business Intelligence Perspectives conference in Chicago.
Essas say he likes the “leverage from playing multiple people against each other.” He fears that while settling down exclusively with one vendor might initially be a “bargain,” it would eventually lead eHarmony to financially “bleed to death in years 2 to 5.
“
Essas’ philosophy is interesting because it runs so counter to the site’s goals, as a self-declared maker of long-term relationships.
eHarmony Inc. says that 236 of its 20 million members get married every day. That’s more than 2 per cent of American marriages per year, acccording to statistics based on online surveys conducted by a third party, Harris Corp., that were commissioned by eHarmony.
Marriage is only one of “hundreds of metrics” that eHarmony “deeply cares about,” said Essas.
Tracking and crunching all of these metrics is key, as eHarmony must produce good matches for its members as soon as they fill out their profiles at sign-up, lest they lose them to rival dating sites.
“Their attention span with us is very short,” Essas said, “So we need to get it right on the first try, if you will.”
Assigning matches is a complex mathematical problem called “graph partitioning,” said Essas.
eHarmony uses Oracle to do much of the initial matching. But for its hardcore data-processing, eHarmony relies on a 50-node Hadoop cluster. Hadoop is speedy, says Essas. “What used to take hours now with Hadoop takes just 30 minutes,” he said.
That’s important, because Harmony is rescoring its relationship matches whenever new members sign up, or even when existing members update their profile.
Hadoop also forces eHarmony to keep its data in key-value store form, rather than in a structured SQL format.
“It’s really hard to build reusable data structures, especially at scale, in SQL,” he said. Using Hadoop also makes it easier to figure out the cause of slow queries compared to using a SQL database, he said. And it forces eHarmony’s developers to be more disciplined about what data it stores permanently, preventing the database from getting “too bloated.”
eHarmony also uses Hadoop to do real-time analysis of the effectiveness of its TV ads.
“We know exactly how much each commercial yields in new customers,” he said.
eHarmony’s core technical team includes 40 engineers in its Los Angeles headquarters, along with the same number of developers based at various Eastern European firms.
Essas, who is of Russian origin, says he likes working with Eastern European developers because “they will challenge you on what you ask them to do.”
“They will tell me, ‘Joseph, this is just stupid,’ and I will say, ‘What? Aren’t I paying you?’ But this enhances our creativity overall,” he said.
A former engineer on Yahoo’s search team, Essas said there are a lot of similarities between “matching people and matching search queries to people.”
Asked if eHarmony would ever consider taking its love-match algorithms into other match-making endeavors, he said: “We would definitely consider it. We are experimenting and playing with different businesses.”
The main prerequisite, Essas said, is that there potentially be a critical mass of users. “You need millions of users to create statistical meaning and make it very successful.”
Source: Computerworld