Last updated: 30 Jan. 2019 (This workshop is now ready)
How can we use Voyant Tools to highlight significant subjects in the texts that you and other students have transcribed?TIP: To answer the big question for this Workshop and for the Voyant Assignment, go beyond the obvious. In past years, for example, a few students found it significant that the most common words in the transcribed texts were "slave" and "slavery", and then proceeded to explain that. We think you'll agree that you do not need the help of a computer program to reach this obvious conclusion!
Learning outcomesAt the end of this week you should be able to:
- Create a shareable URL of a Voyant Tools output, describe it, and weigh its usefulness and limitations for analyzing a text.
- Evaluate another person's Voyant Tool output and their analysis (their post).
In your posts, you should be trying to explain the difference between concepts and other kinds of words, and you should demonstrate an understanding of how Voyant Tools can help analyze concepts.
Overview of tasks
Our big question this week asks how can we use Voyant tools to highlight significant subjects in texts. In the previous Voyant Workshop, we’ve only used the Cirrus tool. Now we'll explore the program further. In this Workshop you’ll see the program offers several tools for our work of distant reading.
In our Transcription Assignment, we transcribed two texts that we can now use in Voyant (ready soon). For now we’re also making available the texts that students in previous last year’s transcribed. The goal of the Workshop and of the Voyant assignment and fine final project is to analyze these texts (the number of texts you use is open – more on this below).Thinking in terms of a workflow, for this Workshop you will do the following...
- Note: Unlike most lessons and workshops in this course, this Workshop stretches over TWO weeks. In those two weeks, you should set the following deadlines:
- Beginning 30 January learn about several tools in Voyant, and practice applying them to the transcribed texts (see Primary Sources below) and by Wednesday, 6 Feb. 2019 (sooner if possible) create a URL that outputs your best analysis of at least one of the primary sources. You will submit and comment on your URL in the Forum;
- NOTE: For your Forum post, it's enough for you to export and write about one tool and apply it to one of the texts, but we recommend that you try doing more.
- For the Voyant Assignment, you will have to write about how you used at least two tools to analyze at least two texts. The Workshop is a good opportunity for you to start experimenting with this more ambitious task.
- By Monday, 11 Feb. 2019 comment on at least one of your classmate's URLs in the Forum (provide constructive questions, tips, or other kinds of useful feedback);
- By Friday, 15 Feb. 2019 submit the written text for the Voyant Assignment. Click the link to go the Assignment instructions. You will submit the assignment in Sakai.
Questions to considerIn addition to the big question for the Workshop, here is a more specific set of questions to think about:
- Describe a specific argument made by one of our transcribed authors, or a concept that is important for understanding that author's unique point of view. (Any author, any point he argues or significant concept he uses -- or multiple authors, arguments, and concepts, if you want to be more adventurous, and prepare for the Voyant Assignment.)
- Provide evidence of your observation. This could be a sentence (or more) that this author used (including a citation and page reference), and explain how you used Voyant Tools to find this piece of evidence.
- TIP: Some of the authors are abolitionists (i.e., they opposed slavery), while others were defenders of the British slave trade. Can you use Voyant to help you identify who was an abolitionist and who was not? What were their reasons for taking any given side?
- How can Voyant help you to think more conceptually?
- Here, you’ll need to think about getting past an obvious limit of the Cirrus output: it sometimes gives us fairly obvious outputs. For example, we’re working with texts on the slave trade. You won’t be terribly surprised to see that “slave” and “slavery” emerge as the most common terms in your corpus (aka, the collection of one or more texts you're analyzing). So, what should you make of that? Well, not much –- it’s pretty obvious, and you could have predicted that "slave" and "slavery" would be the most common terms, even without the help of Voyant Tools. So, here, Voyant is useless –- it tells us something that is just waaaay tooooo obvious. Thus, the question becomes: How do we “read” a Voyant output in a way that allows us see less obvious -- but still significant -- things?
- Here are three suggestions:
- First, examine your Cirrus for not just the most obvious terms, but for terms that are frequent but a bit more unexpected. For example, slaves, as we’ve discussed at some length, were property. What does it mean if property, and perhaps some related terms, are not showing up as common terms? What does it mean if they are? Look for terms that point to conceptually distinctive areas. Social terms, economic terms, political terms, and so on. Allow yourself some time to explore, and think.
- Second, look for unique and telling clusters of terms. Researchers sometimes talk about texts as though they have a unique conceptual "fingerprint" (a collection of concepts that distinguishes one text from another). Maybe you won't be able to identify a complete "fingerprint", but you might be able to work as a Forum discussion community to identify several of the unique key concepts in one or more of the texts.
- Third, allow yourself some time to play. There are several tools, that produce different outputs, different visualizations. Play with them, play with the number of terms its working with, and the number of texts you’re entering (one? two? seven?). Voyant is not going to magically do the work for you. It’s a tool –- it will help you, not do any thinking for you. It’s a way to see patterns that you might not see otherwise. Play with it.
BackgroundFor this Workshop you'll need to schedule 5 to 6 hours (maybe more) over the next week to become familiar with some of Voyant's tools, create a URL to add to the Forum, and explain your URL to your Forum.
You are expected to complete at least two posts to the Forum before the end of the Workshop. See the overview of tasks (above) for details.
Before we get going, it's important for all of you to know that this is not a stand-alone activity. In fact, this Workshop is integral to the entire course as the assignments and workshops build on one another. Your data for this workshop will be the files you created in the Transcription Assignment (plus the files that last year's classes created), and your analysis in the Forum for this Workshop will form a starting point for the final major assignment in the course.
We'll offer more details about the other assignments in a few weeks, but for now you should know that the major assignment will ask you to combine "distant reading" via Voyant [i.e. what you're practicing in this Workshop] with "close reading" [i.e. using your eyes and brain to read the conventional pages of texts!]. Our hope is that you'll discover some ways that distant reading enhances close reading, and vice versa.
A Note about Original Research You Are All Doing in the CourseThis week you will use our transcribed and digitized documents to do original historical research. Original historical research is what historians do, and your work is original because very, very few historians have looked closely and carefully at the primary sources that 2F90 students have transcribed. This means that if you do your work well you can make an actual and significant contribution to scholarship! If your work is really good, it might even even be publishable!
ToolboxHere's a word about a term you should think about this week: concepts. Concepts are ideas, usually abstract ideas, although sometimes they're more like a notion or an assumption. They often appear as simple nouns, but because they're abstract, and because they often derive from other concepts, they are often quite complex. "Democracy" and "nation" are two examples. Their meanings are variable, contested and change over time. Because of this, a standard dictionary definition will almost certainly not help us understand the historically specific meanings of a word that is a concept.
As you'll recall from our first Voyant workshop, when you get your initial output from Voyant, you'll see a Cirrus (word cloud) and several of the terms will stand out as the most frequently used terms. We'd like you to think about what kind of terms these are (i.e., concepts, or not). Looking at any one term, ask yourself, is this word a person, or a thing (usually a noun)? Or is this word an action (usually a verb)? Most significantly, we'd like you ask, is this word a concept?
Voyant Tools is really good at showing the reader (you!!!) the frequency of some terms -- terms that might be concepts. Note that not all keywords or concepts in a text will be as useful for you to investigate using Voyant. For example, in a text on slavery, we can expect "slave" and "slavery" to be among the most common terms. We probably don't need Voyant to tell us that.
Voyant is really useful to help you dig deeper. For example, try focusing on words that the cirrus tool shows us are not the first or second, or third, or eighth (or whatever!) most frequent terms. Which of the words in the word cloud might might be the most revealing about the unique point of view in the text? You should begin to hit words that may be clearly conceptual - words that might help us to think about what the author thought about "slavery". In terms of how far you go down that list - first most common word, eighth (etc.) - there's not fixed rule here, except to make sure the word is still commonly used.
"Reading" using Voyant Tools allows us to identify potentially significant concepts in a text very quickly. Of course, we still have to do a good deal of interpretive work, since we have to make judgments about which of the most frequent words are important and meaningful, and then we have to follow up on our initial judgements with further investigations using other tools in Voyant and with close reading of carefully selected passages. The last point is important, because distant reading done quickly and carelessly will very likely lead to poor results. However, distant reading is useful for helping us find significant concepts and passages that deserve closer reading, especially when we have a large text, or a collection of texts. We have both.
Learning activitiesThe learning activity for this week's workshop consists of several main parts.
PART 1: Review our first Voyant workshopYou can make progress in this Workshop only if you are well acquainted with the basic skills outlined in our first Workshop. Before you proceed, make sure that you can make a cirrus of a digitized text using Voyant Tools, and that you can export the URL for that analysis.
PART 2: Read some more about how other students have applied Voyant Tools to particular research projectsRecently a professor in the US (Brian Croxall) has written a blog post summarizing the discoveries of his students. These students used Voyant Tools to analyze the HUGE number and amount of short stories of the famous 20th-century writer Ernest Hemingway. The results of these students' experiences might give you some ideas about how you might use Trends and Bubblelines in Voyant Tools to highlight possible subjects of significance in our corpus of texts. See the Secondary Sources for details and a link to the reading. It's not too long.
PART 3: Learn how to use new tools in Voyant Tools
The following instructions are similar to the instructions in the first Voyant Workshop, but we've updated them.
- Go to the list of primary sources for the Workshop (at the bottom of this page). Download each of the primary sources to your computer. For the Workshop (and the Voyant Assignment) you can choose which texts you will work with. Make sure you have good reasons for your selections.
- TIP: Rather than making a random choice, we recommend that you skim through each transcribed text quickly (i.e., read it without using Voyant). Source each document (i.e., pay attention to year of publication, author, and as many clues as you can find about each author's unique perspective and purpose for writing about slavery). You can do this quickly (in just a few minutes) by reading the titles and chapter headings, and maybe just a little bit more in some sections. Try to figure out as much as you can about each text in a few minutes using this method of selective, strategic reading.
- Open up the Voyant Tools page at http://voyant-tools.org/.
- In the bottom left-hand corner of the input frame, click the Upload tab. Find the place on your computer desktop where you have put the transcribed files. Select the one or more files that you will try reading with Voyant. Once you open them in Voyant, the program should switch to an analysis screen that you'll be familiar with from the first Voyant Workshop.
- We have included a Voyant window below that has 7 of the transcribed texts preloaded. You can use this window to start experimenting with more tools and to see what you can discover about the texts. TIP: Before you are ready to export a URL to your Forum, make sure you can customize your selection of tools and texts.
- Take a few minutes to look closely at the the initial Voyant output. So far we have focused on the Cirrus. Most initial analysis windows will consist of the Cirrus, the Reader and Trends on a top row, plus Summary and Contexts windows on a bottom row.
- Notice that each of these windows (plus the main window that has "Voyant Tools" and the Voyant owl) have hidden menus that pop up when you move your cursor over the top right-hand corner of each window frame.
- These pop-up menus are important. The option with the box and arrow is for exporting your analysis to the Forum. (NOTE: You can also use the export button to open up one of the smaller tool windows in a separate, larger window of your browser.) The option with a four-part box allows you to switch tools for the window frame that you are in.
- To learn more the tools that you can use, go to the Voyant Tools documentation page. It's URL is http://docs.voyant-tools.org/tools/.
- There are more tools here than you can probably master in this Workshop. You are welcome to try as many as you want. Some are more technical than others. We recommend that you focus on the following tools:
- You can access the input window for each of these tools by clicking on the links immediately above.
- NOTE: One of the complications in using Voyant this year is that there is a new version of Voyant, but the instructions on the Voyant documentation page apply to the old version. That is why we have included the former names of tools. Try your best to use the old documentation and then experiment with the new version.
- You can find video tutorials for the older version of Voyant on YouTube. Click the link to go there.
- Start experimenting as soon as you can. Let us know about any challenges you might have as you play with the tools and texts. We'll probably provide you with little video tutorials of our own as the Workshop progresses.
- Once you have generated some analysis of one, several, or all of the transcribed texts, you should share it with your Forum. Part of your post will explain the steps you took to choose texts, which tools you are exporting and why, and what you think your have discovered in your analysis. If you have encountered a particular problem, or have discovered a trick that you think is useful, share with the group.
- To share your Voyant output, go to the top right corner of the window you want to share. Find the export icon. Click it.
- In the "Export" window that appears, choose the option "Export View (Tools and Data)".
- Then choose the option "an HTML snippet for embedding this view in another web page" ... and then click "Export". A window will pop up.
- Copy the text that appears in the window.
- Go to the Forum in Sakai and "Start a New Conversation".
- Add a title for your post, and then click on the "Source" option in the text frame (it should be on the top left). Once you've selected "Source," paste the details (i.e., the HTML snippet from points 8 and 9) from Voyant there. Then click "post". This will embed your Voyant output in Sakai; if you do not see an active Voyant output window, then you have missed something. For the deadline, see the details at the beginning of the Workshop page.
- Finally, write a response to at least one of your peers' posts by the deadline listed above.
For the assignment on the 15th, write 700 to 800 words about how you used at least two tools from Voyant Tools to "pre-read" at least two of the transcribed texts from our Transcription Exercise. Use the primary sources that are in the Workshop on Advanced Skills in Voyant Tools. Your discussion of how you used the tools should focus on pointing out questions worth further analysis, or other subjects of significance that you can discover using the tools. Do NOT focus your assignment on obvious, trivial or banal observations or questions. Do not, for example, bother observing that "slavery" is a common term in books that we all know are about slavery.
Make sure that you include URLs to the output pages of the data analyses and tools that you are describing.
Note: You do not have to apply the same tools to all texts, but you may, if you wish. Also note that you can take inspiration from other students' posts in your Forum discussion, BUT your work and your words MUST be your own. Therefore, if one of your main observations is inspired by another student, you must indicate this, and you should also make sure that you are adding your own analysis and thoughts that go beyond what that other person wrote. Be clear about which ideas are yours, and which are inspired by others. In this context, it might be helpful to note that we are absolutely fine with you using the pronoun "I" in your writing. This will make it easier to talk about what you (I!) are saying versus what one of your class mates are saying.
Due date: Friday, Feb. 15, at 11:55 pm, submitted using the Assignments Tool.
To expand this output in a new browser screen, follow these instructions.
Voyant output of all 7 transcribed texts:
Some technical notesVoyant runs on a supercomputer system. Although it's a very powerful system, it sometimes gets overloaded. If this happens, you might see a window immediately above this text (or in place of your own Voyant analysis) that reports an error instead of the output you expect. If this is the case, DON'T PANIC! The first thing to try is to refresh your screen -- or redo the inputting of texts. If you're not able to get any output, check to see that your browser is up-to-date. If it's not, update it. Another commonsense troubleshooting step to take is to make sure you are connected to the web. Some students last year found that Internet Explorer did not work well with Voyant Tools. Since then Voyant has been updated, and it should now work better with all browsers, but if you're having troubles again and again with Voyant try using it with a different browser (Chrome, Safari, or Firefox generally work well). Voyant Tools can work off-line, but making that possible involves many extra steps.
Primary sourcesWe intend to include links to the complete, untranscribed texts because there are still gaps and mistakes in our transcribed texts, and you can read the original, untranscribed versions to see the texts as they were printed in the 18th century. You can consult these untranscribed texts if you have questions about what you might be looking at in your Voyant outputs.
- NOTE: These untranscribed texts will NOT work in Voyant. When you load texts into Voyant, make sure you use the pdf versions.
Previous classes in HIST 2F90 transcribed and worked with the following documents. Use these for the Workshop.
- Anon., Remarks on a Pamphlet, written by the Rev. James Ramsay (London, 1784).
- pdf transcription / original untranscribed page view
- Anon., Considerations on the Emancipation of Negroes and on the Abolition of the Slave-Trade. By a West-India Planter (London: Printed for J. Johnson; and J. Debrett, 1788).
- pdf transcript/ original untranscribed page view
- William Beckford, Remarks upon the Situation of Negroes in Jamaica: Impartially Made from a Local Experience of Nearly Thirteen Years in That Island (Whitehall: T. and J. Egerton, 1788).
- pdf transcript / original untranscribed page view
- John Newton, Thoughts upon the African Slave Trade (London: J. Buckland; and J. Johnson, 1788).
- pdf transcript / original untranscribed page view
- Beilby Porteus, A Sermon Preached before the Incorporated Society for the Propagation of the Gospel in Foreign Parts (London, 1784).
- pdf transcription / original untranscribed page view
- James Ramsay, Essay on the Treatment and Conversion of African Slaves (Dublin, 1784).
- pdf transcription / original untranscribed page view (part 1) (and part 2)
- James Ramsay, Objections to the Abolition of the Slave Trade, with Answers (London: James Phillips, 1788).
- pdf transcription / original untranscribed page view
- Geoffrey Rockwell and Stéfan Sinclair, "Tools Index," in Voyant Tools Documentation, http://docs.voyant-tools.org/tools/.
- "Voyant Tools Tutorial Screencasts," YouTube.
- Brian Croxall, "Lesson #4" from "Assignments and Architecture: Pedagogy in the Digital Age," in Brian Croxall: Research, Teaching, Technology (briancroxall.net).
- Note: "Lesson #4" is the last section of the blog post and it is about how a group of students used Voyant Tools. To find the section of the blog post, search for "Lesson #4".