Main features: - Take starting URL and drill down through Groups, Meetings to retrieve information - Match groups with Mirule Organizations - Match meetings with Mirule meetings - Match people with Mirule people DONE: - Store web pages for later mining/reruns with better algorithms I just ran the spider on the Sibbo web site for 2009 and downloaded all protocols + attachments (2.5 GB). Yesterday's 0.5GB was just for the council data, 2.5GB includes all data.