Semtrace::CLI
Constants
BENCHMARK_COMPLEX = ["The old building was undergoing a major renovation.", "She carefully reviewed the environmental sustainability report before the meeting.", "The new semiconductor chip was surprisingly efficient but the manufacturing process needed improvement.", "After the investigation, the researchers published their extraordinary findings about developmental psychology in a well-known international journal last year.", "The archaeological team from the university spent three long summers at the remote site before they finally uncovered the sophisticated agricultural tools that changed our understanding of Mediterranean civilizations in the seventeenth century."]
Battery B: Mixed vocabulary — common words alongside multi-syllable, technical, and compound words that produce BPE subword fragments
BENCHMARK_MULTI = ["Hello, world! How are you?", "The cat sat down. It was tired. The dog, however, was not.", "She said: \"I don't believe it.\" He replied, \"Well, it's true.\"", "First, we went to the store; then, we stopped at the park. Finally, we came home -- exhausted but happy -- and made dinner.", "Dr. Smith (the lead researcher) published her findings in Nature. The results, which contradicted previous studies, were surprising. \"We didn't expect this,\" she admitted. However, the data was clear: the hypothesis was wrong. Period."]
Battery C: Multi-sentence, punctuation, mixed structure
BENCHMARK_PAIRS = [["cat", "dog"], ["man", "woman"], ["king", "queen"]]
BENCHMARK_SIMPLE = ["the cat sat on the mat", "the dog and the cat are friends", "the big red dog chased the small black cat across the yard", "the old man walked down the long and dusty road that led to the small town by the river", "the young girl and her older brother went to the park near the lake and they played with the dog and the cat and then they all went home and had dinner together with the rest of the family", "in the morning the sun rose over the hills and the birds began to sing in the trees and the wind blew through the fields of green grass and the farmer went out to the barn to feed the animals and milk the cows before he came back to the house for a hot cup of tea", "the big brown dog and the small black cat ran fast down the long dirt road to the old farm where the man and the woman lived with the birds and the fish and they all had food and water and the sun was warm and the sky was blue and the grass was green and the wind was cool and the trees were tall and the flowers were red and the air was fresh and the day was good and the night was dark and the moon was full", "the big brown dog and the small black cat ran fast down the long dirt road to the old farm where the man and the woman lived with the birds and the fish and they all had food and water and the sun was warm and the sky was blue and the grass was green and the wind was cool and the trees were tall and the flowers were red and the air was fresh and the day was good and the night was dark and the moon was full and the stars were bright and the world was still and the fire was hot and the snow was white and the rain was cold and the ice was hard and the stone was gray and the sand was soft and the sea was deep and the land was wide"]
Battery A: Simple vocabulary, single clause, common words only
BENCHMARK_SINGLES = ["cat", "dog", "the", "hello", "world", "man", "woman", "king"] of ::String
DATA_DIR = Path["/tmp/tmp.cFakkN/src/src"].parent / "data"
SWEEP_WORDS = ["the", "dog", "and", "cat", "ran", "fast", "down", "long", "dirt", "road", "to", "old", "farm", "where", "man", "woman", "lived", "with", "birds", "fish", "all", "had", "food", "water", "sun", "was", "warm", "sky", "blue", "grass", "green", "wind", "cool", "trees", "tall", "flowers", "red", "air", "fresh", "day", "good", "night", "dark", "moon", "full", "stars", "bright", "world", "still", "fire", "hot", "snow", "white", "rain", "cold", "ice", "hard", "stone", "gray", "sand", "soft", "sea", "deep", "land", "wide", "river", "high", "hill", "low", "field", "dry", "cloud", "light", "path", "home", "door", "wall", "roof", "floor", "chair", "table", "book", "pen", "ink", "lamp", "bed", "hat", "coat", "shoe", "ring", "bell", "song", "drum", "flag", "rope", "ship", "cart", "wheel", "plow", "seed", "crop", "barn", "gate", "fence", "yard", "well", "pond", "cave", "fort", "town", "gold", "clay", "silk", "wool", "corn", "wheat", "hay", "oil", "salt", "iron", "tin", "lead", "coal", "dust", "fog", "dew"] of ::String
Reproducible word list for sweep text generation (seeded by position).
Class methods
run
Source