Update README.md

README.md

@@ -11,6 +11,9 @@ tags:
 - trl
 ---
 
+This is just a small fun project to test out continuous pretraining. I wanted to see if I could make a small model output stories in the style of one of my favorite authors, Lord Dunsany.<br>
+It's a rather small dataset, 52 short stories from "Gods of Pegana" and "Time and the Gods". I did not include "Book of Wonders", at least not this time.<br>
+
 # Uploaded  model
 
 - **Developed by:** neph1
@@ -20,3 +23,35 @@ tags:
 This gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
+
+
+# Examples:
+Input in <b>bold</b> <br><br>
+
+<b>It was such, that in the deep desert, where few men dared journey with their caravans</b>, there was one man who had not journeyed with them. And this man's name was the Ptah-hotep, and he had been a prophet of the gods before the other prophets had appeared.
+
+And it had once been the will of Thoth that Ptah-hotep should be a prophet when all the other prophets were gone—but after some time he had forgotten, and did not desire to have him any longer among his prophets. But no sooner had the other prophets been sent away than the voice of Thoth said: “Ptah-hotep is still a prophet.”
+
+And so Ptah-hotep went upon his journeys into the world, for Ptah-hotep knew how to read writing, though the other prophets could not read nor write.
+
+And as Ptah-hotep traveled over the face of the earth he found many strange things, but mostly old things. And Ptah-hotep wrote down what he saw, and told other men about them. Only he never forgot who was his master. For every day he carried with him two things, and made sure that they should always accompany him as long as he lived; those things were his two scrolls, which held his writings about the world.
+
+One scroll he wrote upon, and it was called The Scroll that tells of All Things; and in it are the names of all the hills and mountains, and of the valleys and plains, and of the forests, and of the rivers and streams.
+
+But only the gods know how this scroll came into being. It may be that Ptah-hotep first wrote it out by himself. It may be that Ptah-hotep stole it from the hand of Thoth, or borrowed it from the scribes whom the gods have appointed to keep sacred record of such things as Ptah-hotep has written concerning the land.
+
+In The Scroll that tells of All Things are the names of all the cities and towns that lie on the face of the earth, and of all the villages, and of the caves where there is shelter for man. But there are no names in that scroll of the huts wherein the people sleep, nor of the little houses where children play together, nor of the walls and gates where none go, nor even of the tombs where their bones are laid away. Nor does Ptah-hotep write anything about the ships that sail upon the sea, though he knows the names of the captains of those ships, and of the sailors who fight aboard them, and of the great captain of the ship that sails over the dark waters toward the land of the setting sun.
+
+And so also with the plants and the animals that live on the earth, and with all other things that spring up from the ground, or fly through the air, or swim beneath the waves. They have no names except in The Scroll that tells of All Things. And it may be that when Ptah-hotep dies they will forget the names of men, but not the names of the hills and mountains, and of the rivers and streams, nor the names of the trees, nor the names of the flowers, nor the names of the grass. For some years after his death perhaps the name of Man shall yet be remembered; but after a time the name of Ptah-hotep shall be forgotten, and only The Scroll that tells of All Things shall be remembered, and afterward there shall be nothing else to tell of the days of men.
+<br><br>
+<b>Since the dawn of the world, the two mountains Vishnu-Kanaag and Odor-Ra had stood opposite each other, across the valley of Kuun,</b> and from their summits there had been no peace.
+The gods wished to know whether man was capable of peace or not, and so they devised a plan whereby they might make certain that all should be one with the gods, for then it would follow that man must be at peace.
+They chose three men who were most wise in the ways of men, but the wisest of them all fell under the spell of the gods, and his life was taken by them to be used as a sacrifice to Vishnu-Kanaag and Odor-Ra.
+
+The gods also sent forth an army of angels which laid waste the lands between the two mountains, till none remained except old men and children; and out of these they chose two very old men, and gave them commands, bidding them go before the armies of the gods until they came to the banks of the river Kuun, where they must stop.
+Then they bade them go up the river to its mouth, and there cross over into the sea to look for a ship, and bring it back again, saying that when the ship was brought they must set sail and go far away beyond the seas, and there cast anchor in the middle of the ocean, and wait there patiently until the old men returned.
+When the two old men had heard this, they went quietly down the river to its mouth, and found a ship lying on the sand close to the water’s edge, and with great difficulty succeeded in getting it out upon the sea.
+But when they were near the sea the winds suddenly arose, and the ship was driven out of the reach of the old men, and dashed upon some rocks that lay between the shore and the open sea, and sank at once. Then the two old men crossed the sands to the shore, where they sat and waited till the old men came home again.
+And one day after another passed, and the old men grew old and died, and still no tidings came from far away. And then the people of the earth began to cry out because their prayers had been answered and peace was not come, but only death and sorrow and the cries of children.
+The gods looked down upon the world from Vishnu-Kanaag and Odor-Ra, and said: “We have done what we promised.” But many amongst the people cried out to the gods: “All these years you have played with us and failed to bring peace to the world!” So the gods made up their minds that they would play the game no more.
+Then they sent forth an army of angels which marched through the lands and killed all the kings and priests and common people; and in the end the people were left alone upon the earth, without any kings or priests, and they lived miserably for ever afterwards.