# raw_external corpus index - Lewis Theobald and Restoration/18th-century adaptations

Each sub-folder holds (a) the raw OCR/transcription exactly as downloaded (`*_djvu.txt`, `gutenberg_*.txt`, `*.ia_metadata.json`), (b) cleaned UTF-8 text(s) (`*.clean.txt`, with `*.cleanstats.json`), and (c) `PROVENANCE.md`.

## Summary table

| Pri | slug | work | status | cleaned file(s) |
|---|---|---|---|---|
| 1 | `fatal_secret_1735` | The Fatal Secret. A tragedy. As it is acted at the Theatre-Royal, in Covent-Garden. By Mr. Theo | **OCR UNUSABLE (images only)** | `fatal_secret_1735.clean_UNUSABLE.txt` |
| 1 | `happy_captive_1741` | The Happy Captive, an English opera. With an interlude, in two comick scenes, betwixt Signor Ca | **FOUND** | `happy_captive_1741.clean.txt` |
| 1 | `orestes_1731` | Orestes: a dramatic opera. As it is acted at the Theatre-Royal in Lincoln's-Inn-Fields. Written | **FOUND** | `orestes_1731.clean.txt` |
| 1 | `perfidious_brother_1715` | The Perfidious Brother. A tragedy: as it is acted at the New Theatre in Little Lincolns-Inn-Fie | **FOUND** | `perfidious_brother_1715.clean.txt` |
| 1 | `persian_princess_1715` | The Persian Princess: or, the Royal Villain. A tragedy | **FOUND** | `persian_princess_1715.clean.txt` |
| 1 | `richard_ii_1720` | The Tragedy of King Richard the II. As it is acted at the Theatre in Lincoln's-Inn-Fields. Alte | **NOT FOUND** |  |
| 2 | `antiochus_and_stratonice_1717` | The History of the Loves of Antiochus and Stratonice: in which are interspers'd some accounts r | **FOUND** | `antiochus_and_stratonice_1717.clean.txt` |
| 2 | `apollo_and_daphne_1726` | Vocal parts of an entertainment, called Apollo and Daphne: or, the burgo-master trick'd. As per | **FOUND** | `apollo_and_daphne_1726.clean.txt` |
| 2 | `cave_of_poverty_1715` | The Cave of Poverty, a poem. Written in imitation of Shakespeare. By Mr. Theobald | **FOUND** | `cave_of_poverty_1715_copyA.clean.txt`, `cave_of_poverty_1715_copyB_JHU.clean.txt` |
| 2 | `censor_1717` | The Censor (essay periodical), Vols. I-III, second (collected) edition | **FOUND** | `censor_vol1_nos1-30.clean.txt`, `censor_vol2_nos31-63.clean.txt` ... |
| 2 | `clouds_1715` | The Clouds. A comedy. Translated from the Greek of Aristophanes. By Mr. Theobald | **FOUND** | `clouds_1715.clean.txt` |
| 2 | `decius_and_paulina_1719` | Decius and Paulina, a masque, to which are added, the other musical entertainments, as perform' | **FOUND** | `decius_and_paulina_1719.clean.txt` |
| 2 | `electra_1714` | Electra: a tragedy. Translated from Sophocles, with notes. By Mr. Theobald | **FOUND** | `electra_1714_copyA.clean.txt`, `electra_1714_copyB.clean.txt` |
| 2 | `epistle_to_orrery_1732` | An Epistle humbly addressed to the Right Honourable John, Earl of Orrery. By L. Theobald | **FOUND** | `epistle_to_orrery_1732.clean.txt` |
| 2 | `harlequin_sorcerer_1725` | A dramatick entertainment, call'd Harlequin a Sorcerer: with the loves of Pluto and Proserpine. | **FOUND** | `harlequin_sorcerer_1725.clean.txt` |
| 2 | `life_of_cato_1713` | The Life and Character of Marcus Portius Cato Uticensis: collected from the best ancient Greek  | **FOUND** | `life_of_cato_1713.clean.txt` |
| 2 | `mausoleum_1714` | The Mausoleum. A poem. Sacred to the memory of Her late Majesty Queen Anne. Written by Mr. Theo | **FOUND** | `mausoleum_1714.clean.txt` |
| 2 | `memoirs_of_raleigh_1719` | Memoirs of Sir Walter Raleigh; his life, his military and naval exploits, his preferments and d | **FOUND** | `memoirs_of_raleigh_1719.clean.txt` |
| 2 | `merlin_1734` | The Vocal Parts of an Entertainment, call'd Merlin; or, the Devil of Stone-Henge ... with a suc | **NOT FOUND** |  |
| 2 | `mestayer_perfidious_brother_1720` | The Perfidious Brother, a tragedy. As it was acted at the New Theatre in Little Lincolns-Inn-Fi | **FOUND** | `mestayer_perfidious_brother_1720.clean.txt` |
| 2 | `oedipus_1715` | Oedipus, King of Thebes: a tragedy. Translated from Sophocles, with notes. By Mr. Theobald | **FOUND** | `oedipus_1715.clean.txt` |
| 2 | `orpheus_and_eurydice_1740` | Orpheus and Eurydice. An opera. As it is performed at the Theatre Royal in Covent Garden. Set t | **FOUND** | `orpheus_and_eurydice_1739.clean.txt`, `orpheus_and_eurydice_1740.clean.txt` |
| 2 | `pan_and_syrinx_1718` | Pan and Syrinx: an opera of one act, as it is perform'd at the Theatre in Lincoln's-Inn-Fields. | **FOUND** | `pan_and_syrinx_1718.clean.txt` |
| 2 | `perseus_and_andromeda_1730` | Perseus and Andromeda. As it is performed at the Theatre Royal in Lincoln's-Inn-Fields. Adorn'd | **FOUND** | `perseus_and_andromeda_1730_copyA.clean.txt`, `perseus_and_andromeda_1730_copyB_Rice.clean.txt` |
| 2 | `pindarick_ode_union_1707` | A Pindarick Ode on the Union. Written by Lew. Theobald, Gent. | **FOUND** | `pindarick_ode_union_1707.clean.txt` |
| 2 | `plutus_1715` | Plutus: or, the World's Idol. A comedy. Translated from the Greek of Aristophanes. By Mr. Theob | **FOUND** | `plutus_1715.clean.txt` |
| 2 | `preface_works_of_shakespeare_1733` | Theobald's Dedication (to John, Earl of Orrery) and Preface to The Works of Shakespeare, in sev | **FOUND** | `theobald_1733_preface.gutenberg_transcription.txt`, `theobald_1733_dedication_and_preface.ocr.clean.txt` |
| 2 | `rape_of_proserpine_1727` | The Rape of Proserpine: as it is acted at the Theatre-Royal in Lincoln's-Inn-Fields. Written by | **FOUND** | `rape_of_proserpine_1727.clean.txt` |
| 2 | `shakespeare_restored_1726` | Shakespeare Restored: or, a specimen of the many errors, as well committed, as unamended, by Mr | **FOUND** | `shakespeare_restored_1726.clean.txt` |
| 3 | `burnaby_love_betrayd_1703` | Love Betray'd; or, the Agreable Disapointment. A comedy. As it was acted at the Theatre in Linc | **FOUND** | `burnaby_love_betrayd_1703.clean.txt` |
| 3 | `cibber_love_makes_a_man_1701` | Love makes a Man: or, the Fop's Fortune. A comedy ... Written by C. Cibber | **FOUND** | `cibber_love_makes_a_man_1701_copyB_1701_0.clean.txt`, `cibber_love_makes_a_man_1701_copyA_1701.clean.txt` |
| 3 | `cibber_richard_iii_1700` | The Tragical History of King Richard III. As it is acted at the Theatre Royal, by His Majesty's | **FOUND** | `cibber_richard_iii_1700.clean.txt` |
| 3 | `dennis_comical_gallant_1702` | The Comical Gallant: or the Amours of Sir John Falstaffe. A comedy ... By Mr. Dennis | **NOT FOUND (bag-of-words only)** |  |
| 3 | `farquhar_inconstant_1702` | The Inconstant: or, the Way to Win Him. A comedy ... Written by Mr. George Farquhar | **FOUND** | `farquhar_inconstant_1702.clean.txt` |
| 3 | `granville_jew_of_venice_1701` | The Jew of Venice. A comedy. As it is acted at the Theatre in Little-Lincolns-Inn-Fields, by Hi | **FOUND** | `granville_jew_of_venice_1701.clean.txt` |
| 3 | `hill_henry_v_1723` | King Henry the Fifth: or, the Conquest of France, by the English. A tragedy. As it is acted at  | **FOUND** | `hill_henry_v_1723.clean.txt` |
| 3 | `motteux_don_quixote_1700` | The History of the Renown'd Don Quixote de la Mancha ... Translated from the original by severa | **FOUND** | `motteux_dq_partI_ch23-36_cardenio.clean.txt` |
| 3 | `phillips_don_quixote_1687` | The History of the most Renowned Don Quixote of Mancha: and his trusty squire Sancho Pancha, no | **FOUND** | `phillips_dq_partI_ch23-36_cardenio.clean.txt` |
| 3 | `sheffield_julius_caesar_1723` | The Tragedy of Julius Caesar, altered; with a prologue and chorus [and] The Tragedy of Marcus B | **FOUND** | `sheffield_julius_caesar_1723.clean.txt`, `sheffield_marcus_brutus_1723.clean.txt` |

## Not found / not obtainable (details in each PROVENANCE.md)

- **Priority 1 - `richard_ii_1720`** (Theobald, *The Tragedy of King Richard the II*, 1720): no digitised copy with accessible text anywhere reachable. Not on archive.org; not in HathiTrust's complete inventory (hathi_full_20260901); Google Books has only the 1969 Cornmarket facsimile record (no eBook) and Google is blocked from here; Chadwyck-Healey English Verse Drama (UVA XTF) and Yale digital collections sit behind an AWS-WAF JavaScript challenge; ECCO (Gale) is paywalled. archive.org lending-library Cornmarket facsimiles keep their OCR behind HTTP 401.
- **Priority 1 - `fatal_secret_1735`**: the only digitised copy found (archive.org BL microfilm) has UNUSABLE OCR - the frames were filmed rotated, so tesseract emitted mirror-gibberish for ~92% of lines. Page images exist (PDF on archive.org); no re-OCR was attempted. No HathiTrust or second archive.org copy exists.
- **Priority 2 - `merlin_1734`** (*Merlin; or, the Devil of Stone-Henge*): not on archive.org, not in HathiTrust; exists in ECCO only (Google Books unverifiable from here).
- **Priority 3 - `dennis_comical_gallant_1702`**: full text not obtainable (archive.org copy restricted; HathiTrust page text behind Cloudflare). The HTRC Extracted-Features bag-of-words for HathiTrust pst.000005278602 was saved as a frequency-only fallback (note: that copy is itself the 1969 facsimile).

## Where I looked (and what was reachable)

- **archive.org** (`advancedsearch.php`, `metadata/`, `download/<id>/<id>_djvu.txt`): fully reachable. Queries run: `creator:(Theobald, Lewis)` (118 hits, both pages), `creator:(Theobald) AND mediatype:texts`, and title searches for every listed work (perfidious brother; king richard / tragedy of king richard / richard the ii / richard 1719-1721 / richard + creator Shakespeare 1700-1740; fatal secret; happy captive; orestes; oedipus king of thebes; plutus + aristophanes; clouds + aristophanes; mausoleum 1700-99; censor 1710-99 and `identifier:sim_censor_the-censor*`; merlin 1730-45 / merlin + stone-henge; vocal parts 1725-45; stone-henge/stonehenge 1700-99; decius and paulina; electra + sophocles/theobald; pindarick/pindaric/ode + theobald; naufragium britannicum; love makes a man; the inconstant + farquhar; richard III + cibber; tragical history of king richard 1700-30; jew of venice; comical gallant / amours of sir john; love betray'd / burnaby 1700-10; henry the fifth + hill; julius caesar + buckingham/sheffield; marcus brutus; works + creator buckingham 1720-30; don quixote + motteux, don quixote 1680-1712; publisher:cornmarket). The 'bim_eighteenth-century' and 'bim_early-english-books-1641-1700' items are British Library microfilm scans (the same microfilm ECCO/EEBO were made from) with tesseract OCR.
- **HathiTrust**: catalog and babel (page text) are behind a Cloudflare JavaScript challenge (HTTP 403 for curl and for a web fetch). Reachable: the Bib API (`catalog.hathitrust.org/api/volumes/brief/...`) and the full inventory `hathi_full_20260901.txt.gz` (streamed and grepped; 141 relevant rows saved to `_search_logs/hathitrust_inventory_hits_2026-09-01.tsv`). HathiTrust holds no 18th-c. Theobald play at all - only Raleigh 1719 (mdp.39015063625019), Shakespeare Restored 1726 (nyp.33433003253071), the Shakespeare editions, and Dennis's Comical Gallant (pst.000005278602). The HTRC Extracted-Features API (`data.htrc.illinois.edu/ef-api`) is reachable.
- **Google Books**: `googleapis.com/books/v1` returns 429 (daily quota exhausted for this egress), `books.google.com` returns 403 'automated queries'; the older `google.com/books/feeds` endpoint returns 500. Web-search snippets located only the Cornmarket facsimile records (DJwIAQAAIAAJ Richard II; c5wIAQAAIAAJ Comical Gallant).
- **Project Gutenberg**: only Theobald item is #16346 (the 1733 Preface, ARS reprint) - obtained. **Wikisource**: has Double Falshood (transcribed), the abridged 1778 Preface, and an index for the 1713 Life of Cato; API rate-limited (429). **Oxford Text Archive** (ECCO-TCP host): 504 gateway time-out. **Michigan quod.lib.umich.edu** (ECCO-TCP/EEBO-TCP): Cloudflare challenge. **UVA XTF (Chadwyck-Healey EVD)** and **Yale collections**: AWS WAF challenge (HTTP 202, empty). **WorldCat**: HTTP 429. **Gallica SRU**: reachable, no hits for Theobald/Stone-Henge/Fatal Secret. **MDZ (Munich)**: JavaScript-only UI, no open search API found. **Folger catalog**: 403.

## Extras obtained

Pan and Syrinx 1718, Apollo and Daphne 1726 (attrib.), Epistle to Orrery 1732 (verse), Antiochus and Stratonice 1717 (prose romance), Memoirs of Raleigh 1719 (prose), Life of Cato 1713 (prose, attrib.), Mestayer's Perfidious Brother 1720 (contrast text), Sheffield's Marcus Brutus 1723, second copies of Electra, Cave of Poverty, Perseus and Andromeda, Orpheus and Eurydice (1739 + 1740), Love Makes a Man, Phillips's Don Quixote. Theobald's own *Double Falshood* is NOT included here (assumed already in hand) but archive.org copies are: doublefalshoodor00shak (1728, 1st ed.), bib_fict_4103197_1 (1728 2nd ed., JHU), bim_eighteenth-century_double-falshood-or-the_theobald-mr-lewis_1728 / _1767 / _1769, doublefalshoodo00conggoog, cu31924013363894 (1920 reprint); Wikisource also has a transcription.

## Cleaning method (applies to every `*.clean.txt`)

`clean_ocr.py` (copy kept in `_search_logs/`): NFC-normalise; ſ->s; trim microfilm target frames / library plates at both ends; drop IA boilerplate, page-number and signature lines, junk lines (<2 letters, or short lines that are mostly symbols), and repeated running heads (per-item regex); join end-of-line hyphenation when the next line starts lower-case; collapse double spaces; conservative long-s correction using the `wordfreq` English list (replace an 'f' word only if it is itself rare (zipf<3) and an s-variant is common (zipf>=3 and >=1 point higher), plus a fixed override list for so/she/sir/see/sun/save/sin/send/slay/should/shall/such/some/since/say/said/side/son/sea/sense/speak... ; ambiguous common words left alone). Nothing else was altered: 18th-century spelling, capitalisation and italics-driven OCR errors remain. Word counts and per-file change logs are in `*.cleanstats.json`. The raw OCR is always kept alongside.

## Caveats for stylometry

- Translations (Electra, Oedipus, Plutus, Clouds) carry Theobald's verse/prose style but constrained by the source; Shakespeare Restored quotes Shakespeare at length; the pantomime librettos are short sung verse.
- Perfidious Brother 1715 is Theobald's rewriting of Mestayer's draft; Sheffield's Julius Caesar retains much Shakespeare; Cibber's Richard III, Granville's Jew of Venice, Hill's Henry V likewise retain Shakespearean lines - filter shared passages before using them as pure author profiles.
- OCR legibility scores are in each PROVENANCE.md; the weakest usable texts are Persian Princess (0.88), Happy Captive (0.87), Mausoleum (0.86), Decius and Paulina and Love Betray'd (noisy microfilm).