Comments for Djoerd Hiemstra's home page

Comment on English Wikipedia off-line as protest by Djoerd Hiemstra

Wed, 18 Jan 2012 08:23:42 +0000

Today is an excellent day for the University’s storage problems, see: http://www.utwente.nl/icts/onderhoudstoring/storingen/calamiteit_nexenta.doc If you could not reach the site today, think of it as a protest

Comment on Keynote lecture by Jimmy Lin at Big Data tutorial by Djoerd Hiemstra

Sun, 04 Dec 2011 21:33:46 +0000

With 50 participants (the maximum we could handle, sorry for those we had to disappoint), the Big Data course was a huge success. Below an impression from the course

Opening by Evert Lammerts

Keynote lecture by Jimmy Lin

Arjen de Vries talks about HadoopDB

Winners of Jimmy's MapReduce book

Comment on DBDBD 2011 in Twente by pyjama

Sun, 20 Nov 2011 20:43:05 +0000

Very interesting. Especially the speaker Stefano Ceri is very good. I have seen some of his work “Search Computing (Seco)” I will definitely be there.

Comment on Anchor text for ClueWeb09 Category A by Djoerd Hiemstra

Mon, 27 Jun 2011 10:09:46 +0000

The Category B anchors mentioned in the comments above are no longer available.

Comment on Anchor text for ClueWeb09 Category A by Djoerd Hiemstra

Thu, 06 Jan 2011 20:51:43 +0000

Dear You Wang, The size of the Category B anchors should be approximately 2GB zipped, so something must have gone wrong. Please try again. We cannot provide more download capacity for these big files, unfortunately (the files come directly from our cluster, otherwise I would have liked to provide a torrent file). The size of the Category A anchors is over ten times as big. Best, Djoerd.

Comment on Anchor text for ClueWeb09 Category A by You Wang

Thu, 23 Dec 2010 14:27:03 +0000

Hello, thank you for providing these two datasets. I have downloaded the file “mirex-anchors-catb.txt.gz”, however, it is only 416.99MB. Is this size its real size? Can you be so kind to provide an address that supports multi-thread download?

Comment on SARA organizes Hadoop hackathon by Djoerd Hiemstra

Tue, 21 Dec 2010 13:22:11 +0000

Well-attended SARA Hadoop Hackathon on December 7
On December 7, a total of 47 participants from 23 different organizations attended the SARA Hadoop Hackathon at Science Park Amsterdam. It was the first Hadoop related event organized by SARA, and considering the enthusiasm displayed by the participants a follow-up event might be announced in 2011.

Guided tour at SARA

Hacking away

Presentation by Emiel and Vincent

Proud winners of Tom White's Hadoop book

Comment on Guest lecture by Peter Dickman from Google by Djoerd Hiemstra

Thu, 02 Dec 2010 09:26:17 +0000

The slides from Peter Dickman's guest lecture are not "cleared" by Google, so we can not provide them here. Instead, have a look at Google hero Jeff Dean's slides at: http://research.google.com/people/jeff/WSDM09-keynote.pdf.

Comment on Anchor text for ClueWeb09 Category A by Djoerd Hiemstra

Mon, 21 Jun 2010 07:48:07 +0000

Hi Yin, Thanks for your interest. We use the PowerEdge R200 from Dell. The machines have dual core Intel Xeon E3110 64 bit processors with 6MB Cache. Each machine has 8GB main memory (4 times 2GB DDR2), and two hard disks, one of 750 GB is used for the Hadoop distributed file system, the other, 150 GB, is used for the operating system and non-Hadoop related activities on the cluster. The machines run Suse 10.3, and Hadoop 0.19.2
The machines were a real bargain when we bought them. Still, if we were to buy the systems now, I would opt for a little more storage, and maybe a little less computing power. These machines are very fast, but you would be surprised how easy it is to fill almost 10 TB of storage space. Best, Djoerd.

Comment on Anchor text for ClueWeb09 Category A by Yin

Wed, 09 Jun 2010 20:01:01 +0000

Hello, thank you for your technical report regarding MIREX. Would you clarify the specifications of the 15 machines in the cluster in terms of RAM, CPU types (number of cores), hard drive storage, and OS version (i.e. 32 bit or 64 bit)? Thank you.