
from SkipgramSampler import PyTorchSampler

corpus1 = """
The Georgia Institute of Technology (commonly referred to as Georgia Tech, Tech, or GT) is a public research university in Atlanta, Georgia, in the United States. It is a part of the University System of Georgia and has satellite campuses in Savannah, Georgia; Metz, France; Athlone, Ireland; Shenzhen, China; and Singapore.
The educational institution was founded in 1885 as the Georgia School of Technology as part of Reconstruction plans to build an industrial economy in the post-Civil War Southern United States. Initially, it offered only a degree in mechanical engineering. By 1901, its curriculum had expanded to include electrical, civil, and chemical engineering. In 1948, the school changed its name to reflect its evolution from a trade school to a larger and more capable technical institute and research university.
"""

corpus2 = """
The Battle of Hastings was fought on 14 October 1066 between the Norman-French army of William, the Duke of Normandy, and an English army under the Anglo-Saxon King Harold Godwinson, about 7 miles (11 kilometres) northwest of Hastings. The death of the childless King Edward the Confessor in January of that year led to a bloody struggle for the throne. After Harold defeated his own brother Tostig and the Norwegian King Harald Hardrada at the Battle of Stamford Bridge in September, William landed his invasion forces in the south of England at Pevensey.
"""



content = [map(lambda x: x.lower(), corpus1.split()), map(lambda x: x.lower(), corpus2.split())]
content = list(content)
sam = PyTorchSampler(content, 2)
batch = sam.get_batch()
for b in batch:
    print(b)