Full-text corpus data


The new iWeb corpus has about 14 billion words of data, which makes it about 25 times as large as other BYU corpora like COCA. When you purchase the full-text data, you will have access to 95% of this data, and you can process and search the text however you would like on your own computer. (See notes on limitations re the data, as well as notes on the lexicon data, for the database format).

Take a look at the samples (for all three formats). These samples represent just 1% of the complete full-text data, but at about 13.2 million words, the samples are still larger than many other corpora of English.

There are three different formats, and when you purchase the data you have a license to use any and all formats that you want.
 
Database format Word / lemma / PoS Text format
textID ID wordID
99057619 20945360332 45
99057619 20945360333 19
99057619 20945360334 18
99057619 20945360335 31130
99057619 20945360336 7
99057619 20945360337 3922
99057619 20945360338 7
99057619 20945360339 8
99057619 20945360340 1998
99057619 20945360341 12989
99057619 20945360342 13
99057619 20945360343 8
99057619 20945360344 191
99057619 20945360345 230
99057619 20945360346 3
99057619 20945360348 12128
99057619 20945360349 1217
99057619 20945360350 56
99057619 20945360351 24
99057619 20945360352 10893
99057619 20945360353 10
99057619 20945360354 1199
99057619 20945360355 17
99057619 20945360356 42
99057619 20945360357 4067
99057619 20945360358 49846
99057619 20945360359 2
99057619 20945360360 4737
99057619 20945360361 23073
99057619 20945360362 2
99057619 20945360363 7
99057619 20945360364 24718
99057619 20945360365 13219
word lemma PoS
but but CCB
it it PPH1
was be VBDZ
cozy cozy JJ
and and CC
warm warm JJ
and and CC
a a AT1
nice nice JJ
retreat retreat NN1
for for IF
a a AT1
few few DA2
days day NNT2
. . .
Mountain mountain NN1
homes home NN2
can can VM
be be VBI
predictable predictable JJ
in in II
style style NN1
with with IW
their their APPGE
stone stone NN1
fireplaces fireplace NN2
, , ,
wood wood NN1
beams beam NN2
, , ,
and and CC
iron iron NN1_VV0@
fixtures fixture NN2
but it was cozy and warm and a nice retreat for a few days . <p> Mountain homes can be predictable in style with their stone fireplaces , wood beams , and iron fixtures . Their timber frame exteriors allows for pitched roofs that can manage snowfall , and soaring ceilings to take in the amazing views . Well designed mountain homes blend in with the local landscape , and do n't compete with the beauty of their natural surroundings . <p> Contemporary meets rustic in the homes featured below , I rounded up six remarkable ones that capture the mountain style but also incorporate modern elements inside . Click through the links to tour the entire home ! <p> This ski home in Big Sky , Montana showcases beautiful combinations of natural stone walls with rustic doors and beams . <p> These two bathrooms in this home share a medley of wood tones , textures , and stains . Beautiful contrast is created by partnering raw organic doors and timber ceilings with semi gloss stained wood floors . <p> I love getting away to the mountains and checking out all the cute and cozy home , cabins &amp; accommodations .