If you’re into parsing XML or HTML with ruby then chances are you’re familiar with the various gems out there for getting the job done.  Lately, there have been a lot of things flying around about which is the fastest and to settle it, Aaron Patterson (author of Nokogiri and Mechanize) wrote a test suite.

After it’s release, RubyInside posted about how the tests showed how fast Nokogiri was compared to Hpricot in this article here: Ruby XML Performance Shootout: Nokogiri vs LibXML vs Hpricot vs REXML.  Later in the day, I saw Why’s posting about the release of Hpricot here: hpricot 0.7 and decided to modify Aaron’s tests to use Hpricot.XML and here are the results:

Tests were run at N=5 to get a clearer picture of the differences between the various gems.  At N=2, tests were pretty close, which indicated that a larger sample was needed.

test_IO_parsing(XmlTruth::DOM::XML::LargeDocumentParsingTest) N=5
user     system      total        real   kBps
null          0.690000   0.070000   0.760000 (  0.768641) 46343.68
nokogiri      2.790000   0.130000   2.920000 (  3.015303) 11813.62
libxml-ruby   2.970000   0.140000   3.110000 (  3.130175) 11380.08
hpricot      13.660000   0.370000  14.030000 ( 14.088780) 2528.37
.
test_in_memory_parsing(XmlTruth::DOM::XML::LargeDocumentParsingTest) N=5
user     system      total        real   kBps
null          1.240000   0.010000   1.250000 (  1.260841) 28252.30
nokogiri      4.360000   0.060000   4.420000 (  4.444468) 8014.83
libxml-ruby   4.570000   0.050000   4.620000 (  4.641338) 7674.87
hpricot      13.750000   0.210000  13.960000 ( 14.045647) 2536.13
.
test_simple_xpath(XmlTruth::DOM::XML::LargeDocumentXPathSearchTest) N=5
user     system      total        real   kBps
nokogiri     44.430000   0.300000  44.730000 ( 44.972003) 792.09
libxml-ruby  40.950000   0.210000  41.160000 ( 41.300780) 862.49
hpricot      18.410000   0.090000  18.500000 ( 18.540239) 1921.32
.
test_IO_parsing(XmlTruth::DOM::XML::SmallDocumentParsingTest) N=1944
user     system      total        real   kBps
null          8.150000   0.130000   8.280000 (  8.326070) 4278.17
nokogiri     17.850000   0.100000  17.950000 ( 17.950534) 1984.36
libxml-ruby  19.010000   0.260000  19.270000 ( 19.370769) 1838.87
hpricot      25.320000   0.460000  25.780000 ( 25.827516) 1379.16
.
test_in_memory_parsing(XmlTruth::DOM::XML::SmallDocumentParsingTest) N=1944
user     system      total        real   kBps
null          3.960000   0.030000   3.990000 (  4.005522) 8892.82
nokogiri     18.140000   0.200000  18.340000 ( 18.403396) 1935.53
libxml-ruby  19.760000   0.230000  19.990000 ( 19.999905) 1781.03
hpricot      15.980000   0.150000  16.130000 ( 16.133157) 2207.90
.
Finished in 426.233021 seconds.

5 tests, 0 assertions, 0 failures, 0 errors

You can find my fork of the test suite on github here: Patrick Tulskie’s Fork of XMLTruth

From this small sample of tests, it appears as though Nokogiri and libxml-ruby are similar in performance for most items. This makes sense though since Nokogiri utilizes the native libxml of the current operating environment. Nokogiri clearly excels at parsing larger documents while Hpricot appears to handle smaller, in-memory documents rather quickly.

In real-world scenarios, one might expect Nokogiri to be the ideal solution to parsing large XML or HTML documents from the disk into a database, whereas Hpricot might be a more ideal gem for use in a web crawler where it is rare that a page’s DOM is more than a 1MB.

Please post any other thoughts you might have in the comments.

This is powered by Mobi which basically takes the RSS feed from my site and parses it into a normally readable page.  This works pretty good on iPhones and Blackberries but I would imagine that it will be just fine on even your normal cellphone.  It took me like 1 minute to setup my site so if you’ve always wanted the m.yourdomain.com then here is an easy way for you to do it.

I think I might need to write some logic in the back end to redirect viewers to the mobile site if I detect they are browsing from a mobile browser.  Hmm.  That’s a post for another time I suppose.

Please note: I am not affiliated with this service at all.

Like it?  Loathe it?  Tell me.

Update 7/15/2008:
I was informed today by James Januszka (http://twitter.com/jamesjanuszka) that if you were not logged into the site and you tried to view a full article that it would not work properly.  I apologize for that and spent some quality time with the theme working out what was going on.  Apparently there was a missing close div tag.  The author of the theme still denies that there was a bug and insists it is a conflict with plugins in Wordpress.  If anyone is looking to use “Hello :D” and needs the fix, let me know.

I know.  I know.  There are plenty of questions going through your head right now upon reading the title of this… How could this possibly happen?  Why do they want some Irish/Polish mixed name?  Don’t they have enough to do with the Olympics this year?  How many licks does it take to get to the center of a Tootsie pop?

Well, I’m as bewildered as you are.  Let me start at the beginning since it was only this morning and I am pretty sure I can re-count it.

I woke up to my blackberry going off next to me for an emergency email.  No one sends me emergency emails, with the exception of the Chinese government, so naturally I had a look see.  I skimmed it quickly and determined it could wait until morning because they did not say anything about me needing to wake up immediately and get dressed.

Dear principal,

We are a domain name registration service company in asia,which mainly deal with international company’s in Asia.We have something important need to confirm with you company.On the July 01th, 2008, we received an application formally.One company named “Makerc International Holdings Ltd” wanted to register following domain names:
patricktulskie.asia
patricktulskie.cn
patricktulskie.com.cn
patricktulskie.hk
patricktulskie.info
patricktulskie.net
patricktulskie.net.cn
patricktulskie.org.cn
patricktulskie.tw
and Internet brand name:
Patricktulskie
through our body.
During our auditing procedure we find out that the alleged “Makerc International Holdings Ltd” has no trade mark, Intellectual property, nor patent even similar to that word. we found that the keywords and domain names applied for registration are as same as your company’s name and trademark. one point need you to confirm: whether this alleged “Makerc International Holdings Ltd” is your business partner or distributor in ASIA. if so, we will complete their registration. These days we are dealing with it.
If you are not in charge of this please transfer this email to appropriate dept.In order to deal with this issue better,please let someone who is responsible for trademark or domain name contact me as soon as possible.

Best Regards,

Carol
Auditing Department
______________________________________________________________________________________________________________________________________________________________________________________
Hong Kong Office:
Tel: 00852 8122 6293 (Direct)
Tel: 00852 3059 3057 (Office)
Fax: 00852 3059 3080

Email: Carol@skasia.hk.cn
Web: http://www.skholdingscompanyltd.asia

Confidentiality Notice. This is a letter for confirmation. If the mentioned third party is your business partner or distributor in ASIA please DO NOT reply. We will automatically confirm application from your business partner after this audit procedure. we have to notify you, and our registration organization are not responsible for any dispute questions about trade mark, intellectual property nor patent after they succeed in registration. hope you can understand. thank you.

My initial thoughts were “Hot damn, I’m a principal now.”  Then I went to GoDaddy and bought PatrickTulskie.org and PatrickTulskie.net.  I sat back in my chair and thought to myself “Damn you’re slick aren’t you Patrick?  Yeah you are.”

At this point you probably think it’s unfair that I say the Chinese government was responsible for this but it’s more fun to blame them for it.  Besides, at a later point I was lead to believe that this Carol person was a representative for the Chinese government.  I did not yet realize what they were trying to do, so I replied with this:

Carol,

Thank you for notifying me of this. PatrickTulskie is my name and my business name. Please do not permit this to go through as it would inflict damage on my reputation, and business in addition to confusion for people who view those pages. I’ve had other companies attempt to register my name as domains in an attempt to do “domain squatting” and advertising under my name without my consent.

They are not my business partner nor are they my distributor in Asia. Furthermore, to my knowledge I am the only Patrick Tulskie in the entire world. Please do not permit this transaction. Thank you very much Carol.

Patrick Tulskie
http://www.PatrickTulskie.com

Almost immediately I got a response back that said:

Dear Patrick,

Thanks for your prompt reply.We are a government authorized domain registration organization,During the auditing process, we have found that Makerc International Holdings Ltd is not the owner of “patricktulskie”.We also do not know that company’s detail information,So we ask you to confirm the relationship between you and that company.

If you have no relationship with them. According to our working experience, there are two possibilities:1.Makerc International Holdings Ltd is a domain name investment company, they want to register these names before you and sell back to you to gain profits.2.Makerc International Holdings Ltd is consigned by your competitor to register, let your customers feel confusion.

You know domain name takes open registration, this is international domain name registration principle. So Makerc International Holdings Ltd has right to register it.I think you must know some cases about the domain names grabbed by the third party,we also won’t want to see things happen like this.

As the owner of “patricktulskie”,you will get the priority to register these domain names and keyword.If you think these domian names are important for your company.we can send you a dispute application form and help you to register these domains within dispute period.This is the only way to prevent domain name grab. But If you don’t think their application will affect your company, you can give up.Each company has their own idea,Hope you can give me your decision ASAP.so that we can handle the next step.

Best Regards

Carol

Ah!  So I see!  She’s from the government and she’s looking out for my best interest!  How sweet of her and the Chinese government to be looking out for my ass.  Well, at this point I just kinda want her to go away because it was my last work day of the week and I wanted to get some real work done, so I sent her this:

Hello Carol,

I have no relationship with that company. I have already registered PatrickTulskie.net and PatrickTulskie.org in addition to my flagship PatrickTulskie.com.

They can go ahead and buy whatever is left out there. I am not interested in them and I do not feel that they would be a threat to my business.

Thank you for the notification.
Patrick Tulskie
http://www.PatrickTulskie.com

…and I thought that would be sufficient enough to make her go away.  Alas, no I was wrong.  I didn’t realize she still needed to fill her quota for the month and she wasn’t going to let me go yet.

I’m tired now though and I believe I’ll have to continue the saga tomorrow.  I have more emails to/from her that I need to sift through and pick apart.  Check back soon for the continuation.