Progress to Date (and Future Workshop Scheduling)

• Status Reports (Developer Task Assignments page)
• AdditionalTask: Setting up Mac workstations in the lab (or debugging the virtual environment for WE1S)
• Optional: Setting up personal laptops for WE1S work
• Workshops for next week (Project Development Calendar)
• Wednesday, 3:45- :
• Planning discussion for continued scraping work
• Scheduling of future workshops including planning meetings for topic modeling
• Friday, 1:00- : 
• Other Developments
• Manifest system (Google scripts thanks to Scott Kleinman)
• Collection manifest form > Collection manifest spreadsheet > Google Script > JSON
• Scraping master spreadsheet > Google Script > JSON

Scraping the Guardian

• Guardian Collection Workflow

Tutorial: Making a Collection Workflow

• Creating a systematic search method for a publication (via API's, Proquest and other databases, or a publications search form)
• Document Sources for WE1S (a list we can add to)
• Theory:
• Document Object Model (diagram)
• XPath
• XPath to DOM
• Making a scraper
• with Import.io (Import.io client "app")
• Example page to scrape: NY Times 1999 article
• with Outwit Hub (Outwit Hub client)
• Writing up a Collection Workflow (see current workflow examples)

Today's workshop tasks

• Developer Task Assignments