mrq commited on
Commit
e626434
1 Parent(s): e1f07f0
README.md CHANGED
@@ -45,39 +45,6 @@ This repo contains the following configurations under `./models/`:
45
  + Seems to be a decent foundation for "distillation", at the very least for LoRA training.
46
  - Addendum: it seems to serve fine for patch-training a few extra tweaks, to non-unified position IDs, split classifier heads, and para-parallel decoding for the AR.
47
 
48
- ## Experiments
49
-
50
- Under `./models/experiments/` are some failed models, but are included to serve as references for my errors. Do ***not*** use them unless you're curious, or know what you're doing.
51
-
52
- * `config.llama.split.yaml` / `ar-llama-1` + `nar-llama-8`: The above model, but split and trained a little bit more.
53
- + This experiment is to see whether the AR and NAR benefitted from being split up after enough pretraining, to un-"lobotomize" any penalties from attending to two different tasks (as the AR predicts the next token, and the NAR predicts the same token but a different level).
54
- + I believe I trained each separate model an additional extra day for another additional audio-duration window for similar training lengths.
55
- + ~~I don't think audio quality differs a non-trivial amount to warrant splitting the model.~~
56
- - Addendum: From recent experiments, it does seem a NAR-only model is beneficial; I will need to explore this in the future.
57
-
58
- * `config.dac.yaml` / `ar+nar-dac-llama-9`: Utilizes [Descript-Audio-Codec](https://github.com/descriptinc/descript-audio-codec/) instead as the audio backend.
59
- + This utilizies the 44KHz (erroneously at 44,000 Hz instead of 44,100 Hz) model at 9 RVQ levels (majorly trained at 8, then the 9th was included).
60
- + Originally experimented with with feeding 24Khz audio through the 44Khz model (naively assuming nothing would go wrong), but artifacts in the output proved to be too much.
61
- + Later experimented with the 24Khz model, but training would *always* diverge.
62
- + *Heavily* benefits from inferencing only the first four RVQ levels; levels afterwards includes far too much noise in the final output.
63
- + I imagine the nature of DAC itself amplifies errors in the remaining RVQ levels (either due to less resilliency to errors in the codes, or each RVQ level affecting hte final waveform more).
64
- + Addendum: restricting to the first four RVQ levels seems to help remove noisy artifacts, but quality is hindered as there's still less RVQ levels to rely on.
65
- + Has not received as much training as the EnCodec-based models.
66
- + Because of this, performance leaves more to be desired.
67
- + Further experimentation is needed, but the next approach is unknown.
68
- + Train a NAR only model to help bolster the remaining RVQ levels (outputted utterances seem a bit sluggish).
69
- + Continue training the AR+NAR to try and bolster the AR tasks (as it's quite lacking at the moment).
70
- + Delve into other, exotic features, such as utilizing DAC's decoding embeddings (which might not be necessary at all since it seems *fine* at the moment).
71
- + Addendum: This seems unneccessary, as freezing to these embeddings is harmful, and not freezing them will just inevitably cause them to shift elsewhere.
72
-
73
- * `config.llama-x4.yaml` / `ar+nar-llama-8`: The above `ar+nar-llama-8` model, but with para-parallel decoding for the AR in-post.
74
- + This mostly serves as a proof-of-concept for speeding up inferencing by reducing the number of steps required, by decoding multiple tokens in parallel with a similar approach to how the NAR decodes in parallel.
75
- + Trained with the trainer's batch-by-durations sampler for a maximum duration batch size of 100 seconds (750 resp tokens), with ProdigyOpt at bfloat16 (no AMP) on my 4070Ti (because I can't be assed to fire up my 4xV100 machine again for a simple test).
76
- + The model definitely needs to be retrained as there's some errors for the additional tokens.
77
- + If these cannot be nailed out with more training, then I imagine a similar approach to speculative decoding where the nth tokens are discarded if the confidence is low.
78
- + Greedy sampling might be beneficial instead for this, as the NAR does benefit greatly from low temperatures / greedy sampling.
79
- + It seems naively just adjusting the "causal size" (amount of tokens to predict into the future, and in turn, how many tokens are returned per step) introduces crackles at fixed intervals.
80
-
81
  Some additional configurations have been explored with, but experiments have not been fruitful:
82
  * Exotic wrappers like `BitNet` seemed to yield little gains in inferencing, somehow. The memory savings is pretty much unneccessary as the models are already manageable at ~200M parameters.
83
  * Mamba / Mamba2-based models have shown that it's ***really*** hard to have an AR+NAR model. I really do not want to bother throwing the compute at another ~~meme~~ arch I can't easily make use of all the other tech to throw at.
@@ -85,6 +52,18 @@ Some additional configurations have been explored with, but experiments have not
85
  + Transformer-based (or at least attention based) models can't seem to handle generating the initial (RVQ level 0) tokens from "thin air" (be it special tokens to repeating the input prompt).
86
  + A diffusion-based model will definitely work, as those are good at generating from noise.
87
  + The performance gains seem nice as the biggest "bottleneck" is the initial (RVQ level 0) AR pass, but it seems to require a lot of effort.
 
 
 
 
 
 
 
 
 
 
 
 
88
 
89
  Some current "achitectural features" are in-use, but their effects need to be experimented with further:
90
  * `split_classifier_heads` is still a mystery whether it's truly helpful or not (each RVQ level gets its own output head).
 
45
  + Seems to be a decent foundation for "distillation", at the very least for LoRA training.
46
  - Addendum: it seems to serve fine for patch-training a few extra tweaks, to non-unified position IDs, split classifier heads, and para-parallel decoding for the AR.
47
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
  Some additional configurations have been explored with, but experiments have not been fruitful:
49
  * Exotic wrappers like `BitNet` seemed to yield little gains in inferencing, somehow. The memory savings is pretty much unneccessary as the models are already manageable at ~200M parameters.
50
  * Mamba / Mamba2-based models have shown that it's ***really*** hard to have an AR+NAR model. I really do not want to bother throwing the compute at another ~~meme~~ arch I can't easily make use of all the other tech to throw at.
 
52
  + Transformer-based (or at least attention based) models can't seem to handle generating the initial (RVQ level 0) tokens from "thin air" (be it special tokens to repeating the input prompt).
53
  + A diffusion-based model will definitely work, as those are good at generating from noise.
54
  + The performance gains seem nice as the biggest "bottleneck" is the initial (RVQ level 0) AR pass, but it seems to require a lot of effort.
55
+ * a model using [Descript-Audio-Codec](https://github.com/descriptinc/descript-audio-codec/):
56
+ + the 24KHz model will *not* converge no matter what. However, naively using just the first 8 RVQ levels might not be good enough, as there's too many codebooks for viable use.
57
+ + the 44KHz model was erroneously assumed to be an even 44KHz, when in reality it's 44.1KHz. *All* of my audio has to be requantized, as there's some stuttering in it.
58
+ + Because of this, training losses are high and it's having a hard time trying to converge.
59
+ + It has *sub-servicable* output for the first 4 RVQ levels, but it's massive cope to try and use it as a model.
60
+ + I believe there's hope to use it when I requantize my audio properly.
61
+ * a model with a causal size >1 (sampling more than one token for the AR):
62
+ + re-using an exisitng model or training from scratch does not have fruitful results.
63
+ + there's an inherent periodic stutter that doesn't seem to be able to be trained out, but it might require exotic sampling methods.
64
+ + unfortunately it requires:
65
+ + either something similar to Medusa heads, where there's additional parameters to perform speculative sampling,
66
+ + a solution similar to what VALL-E 2 uses with group token embeddings or whatever, which *will* harm the NAR tasks in an AR+NAR model.
67
 
68
  Some current "achitectural features" are in-use, but their effects need to be experimented with further:
69
  * `split_classifier_heads` is still a mystery whether it's truly helpful or not (each RVQ level gets its own output head).
models/experiments/ckpt/ar+nar-dac-llama-9/ckpt/fp32.pth DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c3d6445b433edf576c4f48670035f4bf1054c4b4bb78fae3b77c3757f406b46
3
- size 445272958
 
 
 
 
models/experiments/ckpt/ar+nar-llama-8/fp32.pth DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:5232f9d3c74ca154faa94c93af07ad9211d717c2c29956f8835e9a3fde46e8f5
3
- size 455759373
 
 
 
 
models/experiments/ckpt/ar-llama-1/fp32.pth DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:de64a12741767b4e3e013f779cdf3ff5d638c1db8635553f63156c321865d668
3
- size 411697230
 
 
 
 
models/experiments/ckpt/nar-len-llama-9/fp32.pth DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:71feafe1da09f56b562ac5438b60d357195330e1966071b507157ae24a84e89f
3
- size 462088425
 
 
 
 
models/experiments/ckpt/nar-llama-8/fp32.pth DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:81277dee1c67b6809e09fa6d983a71bddab05218bacf0aa1c5ac3e1bb4958844
3
- size 441075976
 
 
 
 
models/experiments/config.dac-nar-len.yaml DELETED
@@ -1,133 +0,0 @@
1
- sample_rate: 44_000
2
- audio_backend: "dac"
3
-
4
- models:
5
- - name: "nar-len"
6
- size:
7
- audio_tokens: 1024
8
- text_tokens: 256
9
- dim: 1024
10
- heads: 16
11
- layers: 16
12
- resp_levels: 9
13
- prom_levels: 9
14
- tasks: 8
15
- langs: 2
16
- tones: 1
17
- arch_type: llama
18
- training: True
19
- version: 5
20
- attention: flash_attention_2
21
- dropout: 0.1
22
- #loss_factors:
23
- # text: 0.01
24
- # prom: 0.5
25
- # resp: 1.0
26
- # len: 1.0
27
- capabilities: ["nar", "len"]
28
- experimental:
29
- audio_embedding_sums: False
30
- interleave: False
31
- unified_position_ids: True
32
- rvq_level_range: []
33
- split_classifiers: True
34
- tie_classifier_to_embedding: False
35
-
36
- #loras:
37
- #- name : "lora-test"
38
- # rank: 128
39
- # alpha: 128
40
- # training: True
41
- # rvq_levels: []
42
-
43
- hyperparameters:
44
- batch_size: 16
45
- gradient_accumulation_steps: 4
46
- gradient_clipping: 1.0
47
- warmup_steps: 10
48
-
49
- optimizer: Prodigy
50
- learning_rate: 1.0
51
- torch_optimizer: True
52
-
53
- scheduler: "" # ScheduleFree
54
- torch_scheduler: True
55
-
56
- evaluation:
57
- batch_size: 4
58
- frequency: 250
59
- size: 4
60
-
61
- steps: 500
62
- ar_temperature: 1.0
63
- nar_temperature: 0.0
64
-
65
- trainer:
66
- iterations: 1_000_000
67
- save_frequency: 250
68
- keep_last_checkpoints: 4
69
-
70
- check_for_oom: False
71
- gradient_checkpointing: False
72
-
73
- weight_dtype: bfloat16
74
- amp: False
75
-
76
- backend: deepspeed
77
- deepspeed:
78
- inferencing: False
79
- amp: False
80
-
81
- load_webui: False
82
-
83
- inference:
84
- backend: local
85
- normalize: False
86
-
87
- weight_dtype: bfloat16
88
- amp: False
89
-
90
- optimizations:
91
- injects: False
92
- replace: True
93
-
94
- linear: False
95
- embedding: False
96
- optimizers: True
97
-
98
- bitsandbytes: False
99
- dadaptation: False
100
- bitnet: False
101
- fp8: False
102
-
103
- dataset:
104
- speaker_name_getter: "lambda p: f'{p.parts[-3]}_{p.parts[-2]}'"
105
- speaker_group_getter: "lambda p: f'{p.parts[-3]}'"
106
-
107
- use_hdf5: True
108
- hdf5_flag: r
109
-
110
- use_metadata: True
111
- validate: True
112
-
113
- workers: 1
114
- cache: False
115
-
116
- duration_range: [3.0, 24.0]
117
-
118
- random_utterance: 1.0
119
- max_prompts: 1
120
- prompt_duration_range: [3.0, 3.0]
121
-
122
- max_resps: 1
123
- p_resp_append: 0.25
124
-
125
- sample_type: path # path # speaker
126
- sample_order: duration
127
- sample_max_duration_batch: 100
128
-
129
- tasks_list: [ "tts" ] #, "tts-c", "ns", "sr" ]
130
-
131
- training: []
132
- validation: []
133
- noise: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
models/experiments/config.dac.yaml DELETED
@@ -1,155 +0,0 @@
1
- sample_rate: 44_000
2
- audio_backend: "dac"
3
-
4
- models:
5
- - name: "ar+nar-dac"
6
- size:
7
- audio_tokens: 1024
8
- text_tokens: 256
9
- dim: 1024
10
- heads: 16
11
- layers: 16
12
- resp_levels: 8
13
- prom_levels: 8
14
- tasks: 8
15
- langs: 2
16
- tones: 1
17
- arch_type: llama
18
- training: True
19
- version: 5
20
- attention: auto
21
- dropout: 0.1
22
-
23
- loss_factors:
24
- text: 0.01
25
- prom: 0.5
26
- resp: 1.0
27
-
28
- capabilities: ["ar", "nar"]
29
-
30
- experimental:
31
- hf: False
32
- interleave: False
33
- audio_embedding_sums: False
34
- rvq_level_range: []
35
-
36
- hyperparameters:
37
- autotune: False
38
- autotune_params:
39
- start_profile_step: 1
40
- end_profile_step: 50
41
- num_tuning_micro_batch_sizes: 8
42
-
43
- batch_size: 16
44
- gradient_accumulation_steps: 2
45
- gradient_clipping: 1.0
46
- warmup_steps: 10
47
-
48
- optimizer: Prodigy
49
- learning_rate: 1.0
50
- torch_optimizer: True
51
-
52
- scheduler: "" # ScheduleFree
53
- torch_scheduler: True
54
-
55
- evaluation:
56
- batch_size: 4
57
- frequency: 1000
58
- size: 4
59
-
60
- steps: 500
61
- ar_temperature: 1.0
62
- nar_temperature: 0.0
63
- load_disabled_engines: True
64
-
65
- trainer:
66
- #no_logger: True
67
- ddp: False
68
- check_for_oom: False
69
- iterations: 1_000_000
70
-
71
- save_tag: step
72
- save_on_oom: True
73
- save_on_quit: True
74
- save_frequency: 500
75
- export_on_save: True
76
-
77
- keep_last_checkpoints: 4
78
-
79
- aggressive_optimizations: False
80
- load_disabled_engines: False
81
- gradient_checkpointing: True
82
-
83
- #load_state_dict: True
84
- strict_loading: False
85
- #load_tag: "9500"
86
- #load_states: False
87
- #restart_step_count: True
88
-
89
- gc_mode: None # "global_step"
90
-
91
- weight_dtype: bfloat16
92
- amp: False
93
-
94
- backend: deepspeed
95
- deepspeed:
96
- inferencing: False
97
- zero_optimization_level: 0
98
- use_compression_training: False
99
-
100
- amp: False
101
-
102
- load_webui: False
103
-
104
- inference:
105
- backend: local
106
- normalize: False
107
-
108
- weight_dtype: bfloat16
109
- amp: False
110
-
111
- optimizations:
112
- injects: False
113
- replace: True
114
-
115
- linear: False
116
- embedding: False
117
- optimizers: True
118
-
119
- bitsandbytes: False
120
- dadaptation: False
121
- bitnet: False
122
- fp8: False
123
-
124
- dataset:
125
- speaker_name_getter: "lambda p: f'{p.parts[-3]}_{p.parts[-2]}'"
126
- speaker_group_getter: "lambda p: f'{p.parts[-3]}'"
127
- speaker_languages:
128
- ja: []
129
-
130
- use_hdf5: True
131
- use_metadata: True
132
- hdf5_flag: r
133
- validate: True
134
-
135
- workers: 6
136
- cache: True
137
-
138
- duration_range: [2.0, 60.0]
139
-
140
- random_utterance: 1.0
141
- max_prompts: 1
142
- prompt_duration_range: [3.0, 3.0]
143
-
144
- max_resps: 1
145
- p_resp_append: 0.25
146
-
147
- sample_type: path # path | speaker | group
148
- sample_order: duration
149
- sample_max_duration_batch: 0
150
-
151
- tasks_list: [ "tts" ] # , [ "tts", "tts-c", "ns", "sr", "tse", "cse", "nse", "tts"]
152
-
153
- training: []
154
- validation: []
155
- noise: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
models/experiments/config.llama-split.yaml DELETED
@@ -1,167 +0,0 @@
1
- sample_rate: 24_000
2
- audio_backend: "vocos"
3
-
4
- models:
5
- - name: "ar"
6
- size: "full"
7
- resp_levels: 1
8
- prom_levels: 1
9
- tasks: 8
10
- langs: 2
11
- tones: 1
12
- arch_type: llama
13
- training: False
14
- version: 5
15
- attention: auto
16
- dropout: 0.1
17
-
18
- loss_factors:
19
- text: 0.01
20
- prom: 0.5
21
- resp: 1.0
22
-
23
- capabilities: ["ar"]
24
- experimental:
25
- audio_embedding_sums: False
26
-
27
- - name: "nar"
28
- size: "full"
29
- resp_levels: 8
30
- prom_levels: 8
31
- tasks: 8
32
- langs: 2
33
- tones: 1
34
- arch_type: llama
35
- training: False
36
- version: 5
37
- attention: auto
38
- dropout: 0.1
39
-
40
- loss_factors:
41
- text: 0.01
42
- prom: 0.5
43
- resp: 1.0
44
-
45
- capabilities: ["nar"]
46
- experimental:
47
- audio_embedding_sums: False
48
-
49
- hyperparameters:
50
- autotune: False
51
- autotune_params:
52
- start_profile_step: 1
53
- end_profile_step: 50
54
- num_tuning_micro_batch_sizes: 8
55
-
56
- batch_size: 16
57
- gradient_accumulation_steps: 8
58
- gradient_clipping: 1.0
59
- warmup_steps: 250
60
-
61
- optimizer: Prodigy
62
- learning_rate: 1.0
63
- torch_optimizer: True
64
-
65
- scheduler: "" # ScheduleFree
66
- torch_scheduler: True
67
-
68
- evaluation:
69
- batch_size: 16
70
- frequency: 1000
71
- size: 16
72
-
73
- steps: 500
74
- ar_temperature: 0.95
75
- nar_temperature: 0.25
76
- load_disabled_engines: True
77
-
78
- trainer:
79
- #no_logger: True
80
- ddp: False
81
- check_for_oom: False
82
- iterations: 1_000_000
83
-
84
- save_tag: step
85
- save_on_oom: True
86
- save_on_quit: True
87
- save_frequency: 500
88
- export_on_save: True
89
-
90
- keep_last_checkpoints: 8
91
-
92
- aggressive_optimizations: False
93
- load_disabled_engines: False
94
- gradient_checkpointing: True
95
-
96
- #load_state_dict: True
97
- strict_loading: False
98
- #load_tag: "9500"
99
- #load_states: False
100
- #restart_step_count: True
101
-
102
- gc_mode: None # "global_step"
103
-
104
- weight_dtype: bfloat16
105
- amp: True
106
-
107
- backend: deepspeed
108
- deepspeed:
109
- inferencing: True
110
- zero_optimization_level: 0
111
- use_compression_training: False
112
-
113
- amp: False
114
-
115
- load_webui: False
116
-
117
- inference:
118
- backend: deepspeed
119
- audio_backend: "vocos"
120
- normalize: False
121
-
122
- weight_dtype: bfloat16
123
- amp: True
124
-
125
- optimizations:
126
- injects: False
127
- replace: True
128
-
129
- linear: False
130
- embedding: False
131
- optimizers: True
132
-
133
- bitsandbytes: False
134
- dadaptation: False
135
- bitnet: False
136
- fp8: False
137
-
138
- dataset:
139
- speaker_name_getter: "lambda p: f'{p.parts[-3]}_{p.parts[-2]}'"
140
- speaker_group_getter: "lambda p: f'{p.parts[-3]}'"
141
- speaker_languages:
142
- ja: []
143
-
144
- use_hdf5: True
145
- use_metadata: True
146
- hdf5_flag: r
147
- validate: True
148
-
149
- workers: 6
150
- cache: True
151
-
152
- duration_range: [24.0, 32.0]
153
-
154
- random_utterance: 1.0
155
- max_prompts: 1
156
- prompt_duration_range: [3.0, 9.0]
157
-
158
- max_resps: 1
159
- p_resp_append: 0.25
160
-
161
- sample_type: path # path # speaker
162
-
163
- tasks_list: [ "tts" ] # , [ "tts", "tts-c", "ns", "sr", "tse", "cse", "nse", "tts"]
164
-
165
- training: []
166
- validation: []
167
- noise: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
models/experiments/config.llama-x4.yaml DELETED
@@ -1,1254 +0,0 @@
1
- sample_rate: 24_000
2
- audio_backend: "vocos"
3
-
4
- models:
5
- - name: "ar+nar"
6
- size: "full"
7
- resp_levels: 8
8
- prom_levels: 8
9
- tasks: 8
10
- langs: 2
11
- tones: 1
12
- arch_type: llama
13
- training: True
14
- version: 5
15
- attention: flash_attention_2
16
- dropout: 0.1
17
- #loss_factors:
18
- # text: 0.01
19
- # prom: 0.5
20
- # resp: 1.0
21
- capabilities: ["ar", "nar", "lang"]
22
- experimental:
23
- audio_embedding_sums: False
24
- interleave: False
25
- unified_position_ids: False
26
- rvq_level_range: []
27
- split_classifiers: True
28
- tie_classifier_to_embedding: False
29
- causal_size: 4
30
- p_rvq_levels: [
31
- 0, 0, 0, 0, 0, 0, 0, 0,
32
- 0, 0, 0, 0, 0, 0, 0, 0,
33
- 1, 1, 2, 3, 4, 5, 6, 7
34
- ]
35
-
36
- #loras:
37
- #- name : "lora-shodan"
38
- # rank: 128
39
- # alpha: 128
40
- # training: True
41
- # rvq_levels: []
42
-
43
- hyperparameters:
44
- batch_size: 16
45
- gradient_accumulation_steps: 4
46
- gradient_clipping: 1.0
47
- warmup_steps: 10
48
-
49
- optimizer: Prodigy
50
- learning_rate: 1.0
51
- torch_optimizer: True
52
-
53
- scheduler: "" # ScheduleFree
54
- torch_scheduler: True
55
-
56
- evaluation:
57
- batch_size: 4
58
- frequency: 250
59
- size: 4
60
-
61
- steps: 500
62
- ar_temperature: 1.0
63
- nar_temperature: 0.0
64
-
65
- trainer:
66
- iterations: 1_000_000
67
- save_frequency: 250
68
- keep_last_checkpoints: 4
69
-
70
- check_for_oom: False
71
- gradient_checkpointing: True
72
-
73
- weight_dtype: bfloat16
74
- amp: False
75
-
76
- backend: deepspeed
77
- deepspeed:
78
- inferencing: False
79
- amp: False
80
-
81
- load_webui: False
82
-
83
- inference:
84
- backend: local
85
- normalize: False
86
-
87
- weight_dtype: bfloat16
88
- amp: False
89
-
90
- optimizations:
91
- injects: False
92
- replace: True
93
-
94
- linear: False
95
- embedding: False
96
- optimizers: True
97
-
98
- bitsandbytes: False
99
- dadaptation: False
100
- bitnet: False
101
- fp8: False
102
-
103
- dataset:
104
- speaker_name_getter: "lambda p: f'{p.parts[-3]}_{p.parts[-2]}'"
105
- speaker_group_getter: "lambda p: f'{p.parts[-3]}'"
106
- speaker_languages:
107
- ja: [
108
- "housamo"
109
- ]
110
-
111
- use_hdf5: True
112
- hdf5_flag: r
113
-
114
- use_metadata: True
115
- validate: True
116
-
117
- workers: 1
118
- cache: True
119
-
120
- duration_range: [3.0, 24.0]
121
-
122
- random_utterance: 1.0
123
- max_prompts: 1
124
- prompt_duration_range: [3.0, 3.0]
125
-
126
- max_resps: 1
127
- p_resp_append: 0.25
128
-
129
- sample_type: path # path # speaker
130
- sample_order: duration
131
- sample_max_duration_batch: 100
132
-
133
- tasks_list: [ "tts" ] #, "tts-c", "ns", "sr" ]
134
-
135
- training: [
136
- #"Audiobooks/A Court of Thorns and Roses (1 of 2) [Dramatized Adaptation] A Court of Thorns and Roses 1",
137
- "Audiobooks/A Court of Thorns and Roses",
138
- "Audiobooks/A Cowboy and his Daughter A Johnson Brothers Novel",
139
- "Audiobooks/A Delusion of Satan The Full Story of the Salem Witch Trials",
140
- "Audiobooks/A Game of Fate",
141
- "Audiobooks/A Game of Thrones",
142
- "Audiobooks/A Good Girls Guide to Murder",
143
- "Audiobooks/A Million Kisses in Your Lifetime",
144
- "Audiobooks/A Short Time to Stay Here",
145
- "Audiobooks/A Shot in the Dark",
146
- "Audiobooks/A Slice of Murder",
147
- "Audiobooks/A Whimsical Notion",
148
- "Audiobooks/A Whole Life",
149
- "Audiobooks/A Yorkshire Carol",
150
- "Audiobooks/About Grace",
151
- "Audiobooks/Ace of Shades",
152
- "Audiobooks/Acid Reflux Diet An Easy Way to Heal and Prevent Gastro-Esophageal Reflux Disease",
153
- "Audiobooks/Activating Beast Mode After 40 Manifest Victory and Happiness in the 2nd Half of Your Life",
154
- "Audiobooks/Alien King Crashes the Wedding",
155
- "Audiobooks/Alkaline Diet for Beginners The Ultimate Guide to Lose Weight, Cleansing Your Body, Fighting Chronic Diseases and Improving Your Lifestyle with the Alkaline Diet",
156
- "Audiobooks/All The Light We Cannot See",
157
- "Audiobooks/All The Sacred Things",
158
- "Audiobooks/Amari and the Night Brothers",
159
- "Audiobooks/American Sniper The Autobiography of the Most Lethal Sniper in U.S. Military History",
160
- "Audiobooks/An Ember in the Ashes",
161
- "Audiobooks/Animal Farm",
162
- "Audiobooks/Annihilation",
163
- "Audiobooks/At the Grave of the Unknown Fisherman",
164
- "Audiobooks/Atlas The Story of Pa Salt",
165
- "Audiobooks/Attached Are you Anxious, Avoidant or Secure How the science of adult attachment can help you find – and keep – love",
166
- "Audiobooks/Authority",
167
- "Audiobooks/Autobiography of Andrew Carnegie",
168
- "Audiobooks/Autophagy Metabolic and the Intermittent Fasting Get the Full Benefits of the Intermittent Fasting,Burns Body Fats and Weight Loss",
169
- "Audiobooks/Awaken The Path to Purpose, Inner Peace, and Healing",
170
- "Audiobooks/Back to the Start",
171
- "Audiobooks/Backpacker",
172
- "Audiobooks/Bad Boss",
173
- "Audiobooks/Bad Habits",
174
- "Audiobooks/Bathwater Blues",
175
- "Audiobooks/Because of Miss Bridgerton",
176
- "Audiobooks/Beyond the Black Stump",
177
- "Audiobooks/Beyond the Darkest Myth",
178
- "Audiobooks/Beyond the Team",
179
- "Audiobooks/Billionaire Romance - Dirty Money",
180
- "Audiobooks/Birth School Metallica Death, Vol. 1",
181
- "Audiobooks/Black Dolphin",
182
- "Audiobooks/Black Star - Season 1",
183
- "Audiobooks/Black Star No Way Back - Book 3",
184
- "Audiobooks/Blood Angel Tooth Collector - Book 1",
185
- "Audiobooks/Blood Bound",
186
- "Audiobooks/Blowing Up the Airwaves An Adventure on the Radio",
187
- "Audiobooks/Blue Twilight Sky & Fall Book 2",
188
- "Audiobooks/Body Language Get Better at Job Interviews, Flirting, and Nonverbal Communication",
189
- "Audiobooks/Borne",
190
- "Audiobooks/Bound to Deception",
191
- "Audiobooks/Brave Talk Building Resilient Relationships in the Face of Conflict",
192
- "Audiobooks/Breathe Again",
193
- "Audiobooks/Bridgerton An Offer From a Gentleman",
194
- "Audiobooks/Bridgerton The Duke and I",
195
- "Audiobooks/Broken Chains A Paranormal Protector Tale",
196
- "Audiobooks/Broken The most shocking childhood story ever told. An inspirational author who survived it.",
197
- "Audiobooks/Brood",
198
- "Audiobooks/Build a Better Brain The Ultimate Guide to Brain Health, Learn How to Take Care of Your Brain and Nourish It for Peak Performance",
199
- "Audiobooks/Cappuccinos, Cupcakes, and a Corpse",
200
- "Audiobooks/Change Us Not God",
201
- "Audiobooks/CHATGPT BOOK FOR BEGINNERS Getting Started with ChatGPT-4, Make Money Online with AI and Earn Passive Income Now",
202
- "Audiobooks/Christmas Charms",
203
- "Audiobooks/Cinema Speculation",
204
- "Audiobooks/City of Vengeance",
205
- "Audiobooks/Clean Sweep [Dramatized Adaptation]",
206
- "Audiobooks/Cloud Cuckoo Land",
207
- "Audiobooks/Codependency Workbook",
208
- "Audiobooks/Collided",
209
- "Audiobooks/Come to Me",
210
- "Audiobooks/Confessions of A Shopaholic",
211
- "Audiobooks/Conscious",
212
- "Audiobooks/Continental Divide",
213
- "Audiobooks/Corpse Path Cottage",
214
- "Audiobooks/Couch Potato Chaos Gamebound",
215
- "Audiobooks/Counterfeit A Novel",
216
- "Audiobooks/Crave Mechanic Adult Romance - Complete Series",
217
- "Audiobooks/Criminal Intentions Season One, Episode One The Cardigans",
218
- "Audiobooks/Crying in H Mart The Number One New York Times Bestseller",
219
- "Audiobooks/Dantes Inferno",
220
- "Audiobooks/Dark Horse A Why Choose Paranormal Romance",
221
- "Audiobooks/Dear Daddy, Please Praise Me",
222
- "Audiobooks/Death of the Scharnhorst",
223
- "Audiobooks/Dial A For Aunties",
224
- "Audiobooks/Diamonds and Demons",
225
- "Audiobooks/Divergent",
226
- "Audiobooks/Do Not Disturb",
227
- "Audiobooks/Domain",
228
- "Audiobooks/Double or Nothing",
229
- "Audiobooks/Dracula",
230
- "Audiobooks/Driving the Deep [Dramatized Adaptation] The Finder Chronicles 2",
231
- "Audiobooks/Easy Everyday Meditations, Mindfulness, and Pranayamas",
232
- "Audiobooks/Eat Your Rice Cakes Discovering Empowerment After a Life-Changing Diagnosis",
233
- "Audiobooks/Eden",
234
- "Audiobooks/Edge of Defiance",
235
- "Audiobooks/Edge of Madness",
236
- "Audiobooks/Emotional Eating How To Stop Food Addiction Naturally - Reap the Benefits of Weight Loss and Better Health",
237
- "Audiobooks/Emotionally Healthy Relationships Audio Bible Studies",
238
- "Audiobooks/Emperors Axe",
239
- "Audiobooks/Everything I Know About Love A Memoir",
240
- "Audiobooks/Eyes Behind the Lines L Company Rangers in Vietnam, 1969",
241
- "Audiobooks/Failed State A Novel",
242
- "Audiobooks/Famous for a Living",
243
- "Audiobooks/Farewell, Ghosts",
244
- "Audiobooks/Fatal Discord",
245
- "Audiobooks/Fencing with the King A Novel",
246
- "Audiobooks/Fighting the Flying Circus",
247
- "Audiobooks/Finder [Dramatized Adaptation] The Finder Chronicles 1",
248
- "Audiobooks/Fire And Blood A History Of Mexico",
249
- "Audiobooks/First One In, Last One Out",
250
- "Audiobooks/First Sorcerer",
251
- "Audiobooks/Five Weeks in a Balloon",
252
- "Audiobooks/Flight Behavior",
253
- "Audiobooks/Focus Beat Procrastination and Increase Willpower and Attentiveness",
254
- "Audiobooks/Focus Eliminate Distractions, Perfectionism, and Get More Done",
255
- "Audiobooks/Follow The Leader A Collection Of The Best Lectures On Leadership",
256
- "Audiobooks/Forever and a Day A Those Who Wait Story",
257
- "Audiobooks/Four The Transfer",
258
- "Audiobooks/Four Weddings and a Duke",
259
- "Audiobooks/Fourth Wing",
260
- "Audiobooks/Fox Creek",
261
- "Audiobooks/Girl in a Sect - A True Story",
262
- "Audiobooks/God Luv Us An Achim Jeffers Novel",
263
- "Audiobooks/Green Smoothie Cleanse An Easy Plan To Lose Weight, Boost Energy and Improve your Health With Detox Smoothies",
264
- "Audiobooks/Grieved Loss A Dark Mafia Romance",
265
- "Audiobooks/GRIMM Hansel and Gretel",
266
- "Audiobooks/Harry Haft Survivor of Auschwitz, Challenger of Rocky Marciano",
267
- "Audiobooks/Heartbeat",
268
- "Audiobooks/Helenes Liberation",
269
- "Audiobooks/Helenes War",
270
- "Audiobooks/Hello, Habits A Minimalists Guide to a Better Life",
271
- "Audiobooks/Here and there or The Travels of Max the Jackal",
272
- "Audiobooks/Homage To Catalonia",
273
- "Audiobooks/Home Workout Bible",
274
- "Audiobooks/Hook, Line, and Sinker",
275
- "Audiobooks/Hooked",
276
- "Audiobooks/Hornet Flight",
277
- "Audiobooks/House Rules",
278
- "Audiobooks/How To Be Happy How Developing Your Confidence, Resilience, Appreciation and Communication Can Lead to a Happier, Healthier You",
279
- "Audiobooks/How To Fight Depression - 9 Case Studies",
280
- "Audiobooks/How to Think More Effectively A Guide to Greater Productivity, Insight, and Creativity",
281
- "Audiobooks/Hummingbird Salamander A Novel",
282
- "Audiobooks/Hypnosis Willpower",
283
- "Audiobooks/I am the Rose of Sharon",
284
- "Audiobooks/Ice Planet Barbarians",
285
- "Audiobooks/If I fall",
286
- "Audiobooks/If You Kept a Record of Sins",
287
- "Audiobooks/In the Lives of Puppets",
288
- "Audiobooks/In the Long Run",
289
- "Audiobooks/In the Wet",
290
- "Audiobooks/Inside the Heart of a Billionaire What Makes a Business Professional Successful Oprah Winfrey",
291
- "Audiobooks/Insidious Intent",
292
- "Audiobooks/It Walks by Night",
293
- "Audiobooks/Job Interview Research, Follow-Ups, and the Most Typical Questions and Answers",
294
- "Audiobooks/Job Search Guide The Essential Guide On How to Land A Perfect Job, Learn Everything From Finding Jobs to Effective Interview Hints and Techniques That Will Help You Land Your Dream Job",
295
- "Audiobooks/Junie",
296
- "Audiobooks/Just Drop Out Hannaford Prep Year One",
297
- "Audiobooks/Just One Taste",
298
- "Audiobooks/Ketogenic Diet and Intermittent Fasting for Beginners 2 Audiobooks in 1 - Learn the benefits and Effects of the Keto Fasting Lifestyle",
299
- "Audiobooks/Kindred Spirits A Romance About Love, Life, and the Afterlife",
300
- "Audiobooks/Kraken [Dramatized Adaptation] Deathlands 145",
301
- "Audiobooks/Lady of the Manor - Winds of Change",
302
- "Audiobooks/Law of Attraction Exactly How to Attract Money and Happiness Faster (2 in 1)",
303
- "Audiobooks/Liars and Outliers Enabling the Trust that Society Needs to Thrive",
304
- "Audiobooks/Life on Earth",
305
- "Audiobooks/Lifes Too Short to Go So Fcking Slow Lessons from an Epic Friendship That Went the Distance",
306
- "Audiobooks/Living Right on Wrong Street",
307
- "Audiobooks/Love and War",
308
- "Audiobooks/Love at First Set A Novel",
309
- "Audiobooks/Luna",
310
- "Audiobooks/Mafia Prince Dark Irish Mafia Romance (Young Irish Rebels Book 1) Dark Irish Mafia Romance",
311
- "Audiobooks/Magonia",
312
- "Audiobooks/Make Your Move Hannaford Prep Year Two",
313
- "Audiobooks/Married Love",
314
- "Audiobooks/Me Before You",
315
- "Audiobooks/Menage - Meet The Neighbors",
316
- "Audiobooks/Milfs Threesomes 40-Pack Books 1 - 40 (Milf Erotica Threesome Erotica Anal Sex Erotica Lesbian Erotica)",
317
- "Audiobooks/Minimalism Simplify Your Home and Use Strategies to Declutter",
318
- "Audiobooks/Miss Aldridge Regrets",
319
- "Audiobooks/Montecore",
320
- "Audiobooks/Mr. Gardiner and the Governess A Regency Romance",
321
- "Audiobooks/Mulligan",
322
- "Audiobooks/Murder at Archly Manor",
323
- "Audiobooks/Murder in White",
324
- "Audiobooks/My Life, My Own Melody",
325
- "Audiobooks/My Own Magic A Reappearing Act",
326
- "Audiobooks/Nasty Girls",
327
- "Audiobooks/Never Split the Difference Negotiating As If Your Life Depended On It",
328
- "Audiobooks/Nevernight",
329
- "Audiobooks/New Beginnings at Glendale Hall",
330
- "Audiobooks/Night Shifter",
331
- "Audiobooks/No Ordinary Gentleman",
332
- "Audiobooks/Nocturna",
333
- "Audiobooks/Norse Mythology",
334
- "Audiobooks/Not Alone",
335
- "Audiobooks/Notes on an Execution",
336
- "Audiobooks/Of Kindness and Kilowatts Nothing is Promised Book 3",
337
- "Audiobooks/On a Knifes Edge The Ukraine, November 1942–March 1943",
338
- "Audiobooks/One True Mate",
339
- "Audiobooks/Oops, Ive Fallen",
340
- "Audiobooks/Orchestra of Bandits",
341
- "Audiobooks/Out of Office Ditch the 9-5 and Be Your Own Boss",
342
- "Audiobooks/Over the Top A Raw Journey to Self-Love",
343
- "Audiobooks/Packs Promise",
344
- "Audiobooks/Parable of the Sower",
345
- "Audiobooks/Parable of the Talents",
346
- "Audiobooks/Partials",
347
- "Audiobooks/Pathway to Prosperity The 12 Steps to Financial Freedom",
348
- "Audiobooks/Pecking Order",
349
- "Audiobooks/People Like Me",
350
- "Audiobooks/Pilgrimage to Hell",
351
- "Audiobooks/Pippo and Clara",
352
- "Audiobooks/Prince of the Blood",
353
- "Audiobooks/Probable Sons",
354
- "Audiobooks/Pyromaniac Book 1 Sorrows",
355
- "Audiobooks/Red Dawn Sky & Fall Book 1",
356
- "Audiobooks/RENAISSANCE STATE THE UNWRITTEN STORY OF THE MAKING OF MAHARASHTRA",
357
- "Audiobooks/Resilience How to Cope When Everything Around You Keeps Changing",
358
- "Audiobooks/Responsibility Rebellion An Unconventional Approach to Personal Empowerment",
359
- "Audiobooks/REVELATION Book Three of The Devolution Trilogy",
360
- "Audiobooks/Rhapsodic",
361
- "Audiobooks/Ride",
362
- "Audiobooks/Rise of the Dragons",
363
- "Audiobooks/Road Out of Winter",
364
- "Audiobooks/Robots",
365
- "Audiobooks/Rough & Tumble",
366
- "Audiobooks/Rule of Capture",
367
- "Audiobooks/Sacrifice",
368
- "Audiobooks/Saint",
369
- "Audiobooks/Sandstorm",
370
- "Audiobooks/Second Chance at First Love",
371
- "Audiobooks/Second Chance Ranch",
372
- "Audiobooks/Secrets of the Millionaire Mind",
373
- "Audiobooks/Self-Care for Turbulent Times",
374
- "Audiobooks/Self-Discipline The Ultimate Guide To Beat Procrastination, Achieve Your Goals, and Get What You Want In Your Life",
375
- "Audiobooks/Sergeant Salinger",
376
- "Audiobooks/Serpent & Dove",
377
- "Audiobooks/Seven Surrenders (1 of 2) [Dramatized Adaptation] Terra Ignota 2",
378
- "Audiobooks/Shatter Me",
379
- "Audiobooks/She Got it Bad for a Heartless Gangsta",
380
- "Audiobooks/Shine Until Tomorrow",
381
- "Audiobooks/Signs of Vitamin B12 Deficiencies - Whos At Risk - Why - What Can Be Done",
382
- "Audiobooks/Silenced",
383
- "Audiobooks/SILO Book 1",
384
- "Audiobooks/Simmering Season",
385
- "Audiobooks/Sin Bin",
386
- "Audiobooks/Sinful Arrangement",
387
- "Audiobooks/Single Dad Next Door",
388
- "Audiobooks/Sleep Affirmations Positive Affirmations for Sleep",
389
- "Audiobooks/Sleep Meditation",
390
- "Audiobooks/Slow Horses",
391
- "Audiobooks/So the Wind Wont Blow It All Away",
392
- "Audiobooks/Social Anxiety and Shyness Learn How to Build Self-Esteem, Improve Your Social Skills, and Overcome Fear, Shyness, and Social Anxiety",
393
- "Audiobooks/Song of Silver, Flame Like Night",
394
- "Audiobooks/Soulmate",
395
- "Audiobooks/Spider Boys",
396
- "Audiobooks/Spoiler Alert",
397
- "Audiobooks/Stalins Daughter",
398
- "Audiobooks/State of Fear",
399
- "Audiobooks/Still Life",
400
- "Audiobooks/Stoicism Minimal Edition How the Philosophy of The Stoics works, Understanding and Practicing stoicism, learn the Art of Happiness and how to Manage Your emotions",
401
- "Audiobooks/Stop Drinking Alcohol",
402
- "Audiobooks/STOP Procrastinating Complete Guide to Overcome Procrastination, Build Self-Discipline, Increase Productivity and Overcome Laziness",
403
- "Audiobooks/Sub Zero",
404
- "Audiobooks/Summary of The Secret by Rhonda Byrne",
405
- "Audiobooks/Summerwater",
406
- "Audiobooks/Sun Born A Novel of North Americas Forgotten Past",
407
- "Audiobooks/Sustainable Minimalism Embrace Zero Waste, Build Sustainability Habits That Last, and Become a Minimalist Without Sacrificing the Planet",
408
- "Audiobooks/Sweep In Peace [Dramatized Adaptation] Innkeeper Chronicles 2",
409
- "Audiobooks/Swimming in the Dark A Novel",
410
- "Audiobooks/Talk Like TED",
411
- "Audiobooks/Teach Me",
412
- "Audiobooks/Termination Shock A Novel",
413
- "Audiobooks/Terms and Conditions",
414
- "Audiobooks/The 5 Second Rule by Mel Robbins - Book Summary",
415
- "Audiobooks/The Abyss Beyond Dreams",
416
- "Audiobooks/The Actual Star",
417
- "Audiobooks/The Alchemist",
418
- "Audiobooks/The Almanack of Naval Ravikant",
419
- "Audiobooks/The Ambulance Girl",
420
- "Audiobooks/The Art of War",
421
- "Audiobooks/The Best American Short Stories 2019",
422
- "Audiobooks/The Blind Assassin",
423
- "Audiobooks/The Blood Road",
424
- "Audiobooks/The Book of Man",
425
- "Audiobooks/The Buckets of Money Retirement Solution The Ultimate Guide to Income for Life",
426
- "Audiobooks/The Butcher and the Wren A Novel",
427
- "Audiobooks/The Calico Cat",
428
- "Audiobooks/The Childrens Train",
429
- "Audiobooks/The Christmas Secret",
430
- "Audiobooks/The Cold Dish International Edition",
431
- "Audiobooks/The Complete Works of Florence Scovel Shinn",
432
- "Audiobooks/The Compound Effect Jumpstart Your Income, Your Life, Your Success",
433
- "Audiobooks/The Confessions of Dorian Gray - The complete series four (Unabridged)",
434
- "Audiobooks/The Consolation Prize",
435
- "Audiobooks/The Couple at Number 9",
436
- "Audiobooks/The Diary of Amos Lee I Sit, I Write, I Flush!",
437
- "Audiobooks/The Different Land - E01",
438
- "Audiobooks/The Dragons Bride",
439
- "Audiobooks/The Dragons Secret",
440
- "Audiobooks/The Easy Way to Stop Smoking",
441
- "Audiobooks/The Echoing Darkness",
442
- "Audiobooks/The Emotionally Abusive Relationship How to Stop Being Abused and How to Stop Abusing",
443
- "Audiobooks/The End of the Ocean",
444
- "Audiobooks/The Fiancée Farce A Novel",
445
- "Audiobooks/The Fine Print",
446
- "Audiobooks/The Fogging",
447
- "Audiobooks/The Fortunate Foundlings",
448
- "Audiobooks/The Frat Boy",
449
- "Audiobooks/The Free World Art and Thought in the Cold War",
450
- "Audiobooks/The Girl on the Platform",
451
- "Audiobooks/The Good Wife of Bath",
452
- "Audiobooks/The Happiness Plan The Ultimate Guide to Everything You Need to Know to How to Truly Be Happy, and Learn to Transform Your Life into Happier, Healthier and More Productive You",
453
- "Audiobooks/The Haunted Bookshop",
454
- "Audiobooks/The Healthy Habit Handbook",
455
- "Audiobooks/The History of Love",
456
- "Audiobooks/The Hitchhikers Guide to the Galaxy",
457
- "Audiobooks/The Hobbit",
458
- "Audiobooks/The Hollow Places",
459
- "Audiobooks/The Hunger Games",
460
- "Audiobooks/The Introverts Guide to Online Dating",
461
- "Audiobooks/The Introverts Guide to Speed Dating",
462
- "Audiobooks/The K Code",
463
- "Audiobooks/The Kiss Curse A Novel",
464
- "Audiobooks/The Law Our Road to Marital Happiness",
465
- "Audiobooks/The Lay of the Last Minstrel",
466
- "Audiobooks/The Lazarus Project",
467
- "Audiobooks/The Legend of Sleepy Hollow",
468
- "Audiobooks/The Lie Maker A Novel",
469
- "Audiobooks/The Life and Adventures of Nicholas Nickleby",
470
- "Audiobooks/The Lighthouse Witches",
471
- "Audiobooks/The Magnificent Ambersons",
472
- "Audiobooks/The Man in Black",
473
- "Audiobooks/The Man in the Wooden Hat",
474
- "Audiobooks/The Manuscript A story of revenge",
475
- "Audiobooks/The Minimalist And Decluttering Lifestyle Use Minimalism to Declutter Your Home, Mindset, Digital Presence, And Families Life Today For Living a More Fulfilling Minimalistic Lifestyle With Less Worry!",
476
- "Audiobooks/The Missing Sister",
477
- "Audiobooks/The Never King",
478
- "Audiobooks/The Ninth Metal",
479
- "Audiobooks/The Ocean at the End of the Lane",
480
- "Audiobooks/The Outpost",
481
- "Audiobooks/The Pagan Lord",
482
- "Audiobooks/The Path to Self-Love and World Domination Break Free from Self-Limiting Beliefs and Embrace Your Power",
483
- "Audiobooks/The Patron",
484
- "Audiobooks/The Pillars of the Earth",
485
- "Audiobooks/The Portrait of Molly Dean",
486
- "Audiobooks/The Power of Consistent Self-Discipline Discover How Elite Performers Use Self-Control and Mental Toughness to Achieve Their Goals",
487
- "Audiobooks/The Pretenders",
488
- "Audiobooks/The Problem with Second Chances",
489
- "Audiobooks/The Promise - Part 1",
490
- "Audiobooks/The Pruning",
491
- "Audiobooks/The Raven Boys",
492
- "Audiobooks/The Return Undermined",
493
- "Audiobooks/The Road",
494
- "Audiobooks/The Schopenhauer Cure A Novel",
495
- "Audiobooks/The Secret Diaries of Miss Miranda Cheever",
496
- "Audiobooks/The Secret History",
497
- "Audiobooks/The Silence",
498
- "Audiobooks/The Song of Achilles",
499
- "Audiobooks/The Steel Girls",
500
- "Audiobooks/The Storm Sister",
501
- "Audiobooks/The Storyteller Tales of Life and Music",
502
- "Audiobooks/The Stranger - Book 1",
503
- "Audiobooks/The Stranger - Book 2",
504
- "Audiobooks/The Subtle Art of Not Giving a Fck A Counterintuitive Approach to Living a Good Life",
505
- "Audiobooks/The Sun Sister",
506
- "Audiobooks/The Tao of Self-Confidence A Guide to Moving Beyond Trauma and Awakening the Leader Within",
507
- "Audiobooks/The Thief",
508
- "Audiobooks/The Tolstoy Estate",
509
- "Audiobooks/The U.P. Trail",
510
- "Audiobooks/The Unfamiliar Garden",
511
- "Audiobooks/The Unlovely Bride",
512
- "Audiobooks/The Vampire Diaries The Awakening",
513
- "Audiobooks/The Vampire Knitting Club Cornwall Cozy Mystery Series Book",
514
- "Audiobooks/The Vanishing of Class 3B",
515
- "Audiobooks/The Viscount Who Vexed Me",
516
- "Audiobooks/The Wife of Bath A Biography",
517
- "Audiobooks/The Wife Upstairs",
518
- "Audiobooks/The Wild Shore",
519
- "Audiobooks/The Windsor Knot",
520
- "Audiobooks/The Wolf Den",
521
- "Audiobooks/The Wolfs Royal Baby",
522
- "Audiobooks/There Should Be More Dancing",
523
- "Audiobooks/These Hollow Vows",
524
- "Audiobooks/Thin Black Road",
525
- "Audiobooks/Things No One Will Tell Fat Girls",
526
- "Audiobooks/This is Going to Hurt Secret Diaries of a Junior Doctor",
527
- "Audiobooks/Those People",
528
- "Audiobooks/Threadneedle",
529
- "Audiobooks/Threads West - An American Saga Maps of Fate Book 2",
530
- "Audiobooks/Three Dark Crowns",
531
- "Audiobooks/Tiger Lillie",
532
- "Audiobooks/To Hate Adam Connor",
533
- "Audiobooks/To Quell the Korengal",
534
- "Audiobooks/Too Like The Lightning",
535
- "Audiobooks/Tortuga Breeze",
536
- "Audiobooks/Traces of Gods Sky & Fall Book 3",
537
- "Audiobooks/Trusted & True",
538
- "Audiobooks/Truth and Lies What People Are Really Thinking",
539
- "Audiobooks/Twisted Tea Christmas",
540
- "Audiobooks/Unfettered Journey",
541
- "Audiobooks/Unladylike Lessons in Love A Marleigh Sisters Novel",
542
- "Audiobooks/Unveling The Mario Bros Legacy Decoding The Success Behind One Of Gamings Most Iconic Franchises (Unabridged)",
543
- "Audiobooks/Vault A Madison Kate Novella",
544
- "Audiobooks/Vengeance",
545
- "Audiobooks/Virus Stockholm - Book 2",
546
- "Audiobooks/Warren Buffet The Secret Of His Success - Discover The Skills, Strategies And Mindsets That Took Him To The Top ( Extended Edition )",
547
- "Audiobooks/We Are Unprepared",
548
- "Audiobooks/We Have Always Lived in the Castle",
549
- "Audiobooks/Weight Loss for Women Effective Strategies to Change Mentality and Lose Weight in a Healthy Way",
550
- "Audiobooks/What Happens After Hours",
551
- "Audiobooks/When Youre Ready, This Is How You Heal",
552
- "Audiobooks/Why Has Nobody Told Me This Before",
553
- "Audiobooks/Wrong Place Wrong Time A Novel",
554
- "Audiobooks/Wyoming Mountain Murder",
555
- "Audiobooks/Year of No Sugar A Memoir",
556
- "Audiobooks/Yellowface A Novel",
557
- "Audiobooks/Yoga and the Quest for the True Self",
558
- "Audiobooks/Yoga Discover How to Flow and Relax",
559
- "Audiobooks/Yoga for Insomnia",
560
- "Audiobooks/You Cant Screw This Up Why Eating Takeout, Enjoying Dessert, and Taking the Stress Out of Dieting Leads to Weight Loss That Lasts",
561
- "Audiobooks/Your Life for Mine",
562
- "HL/barney",
563
- "HL/gman",
564
- "HL/hev",
565
- "HL/holo",
566
- "HL/scientist",
567
- "HL/tride",
568
- "HL2/advisor",
569
- "HL2/alyx",
570
- "HL2/barney",
571
- "HL2/breen",
572
- "HL2/eli",
573
- "HL2/fvox",
574
- "HL2/gman",
575
- "HL2/grigori",
576
- "HL2/kleiner",
577
- "HL2/magnusson",
578
- "HL2/mossman",
579
- "housamo/aegir",
580
- "housamo/aegir3",
581
- "housamo/agyou",
582
- "housamo/ahab",
583
- "housamo/ahuramazda",
584
- "housamo/aizen",
585
- "housamo/aizen3",
586
- "housamo/akihagongen",
587
- "housamo/akihagongen3",
588
- "housamo/alberich",
589
- "housamo/algernon",
590
- "housamo/algernon3",
591
- "housamo/alice",
592
- "housamo/alice3",
593
- "housamo/alp",
594
- "housamo/alp3",
595
- "housamo/amatsumara",
596
- "housamo/amatsumara3",
597
- "housamo/amduscias",
598
- "housamo/andvari",
599
- "housamo/andvari3",
600
- "housamo/aracne",
601
- "housamo/aracne3",
602
- "housamo/arc",
603
- "housamo/arc2",
604
- "housamo/arc3",
605
- "housamo/arslan",
606
- "housamo/arslan3",
607
- "housamo/ashigara",
608
- "housamo/ashigara3",
609
- "housamo/astaroth",
610
- "housamo/astaroth2",
611
- "housamo/asterios",
612
- "housamo/asterios3",
613
- "housamo/avarga",
614
- "housamo/azathoth",
615
- "housamo/azathoth3",
616
- "housamo/azazel",
617
- "housamo/azuma",
618
- "housamo/babebunyan",
619
- "housamo/babebunyan3",
620
- "housamo/balor3",
621
- "housamo/barguest",
622
- "housamo/barguest3",
623
- "housamo/barong",
624
- "housamo/bathym",
625
- "housamo/bathym3",
626
- "housamo/behemoth",
627
- "housamo/behemoth2",
628
- "housamo/benten",
629
- "housamo/benten3",
630
- "housamo/beowulf",
631
- "housamo/bertro",
632
- "housamo/bertro3",
633
- "housamo/bigfoot",
634
- "housamo/blake",
635
- "housamo/boogeyman",
636
- "housamo/boogeyman3",
637
- "housamo/breke",
638
- "housamo/breke3",
639
- "housamo/caitsith",
640
- "housamo/caitsith3",
641
- "housamo/catoblepas",
642
- "housamo/catoblepas3",
643
- "housamo/chernobog",
644
- "housamo/chernobog3",
645
- "housamo/chouji",
646
- "housamo/chouji3",
647
- "housamo/christine",
648
- "housamo/cipactli",
649
- "housamo/claude",
650
- "housamo/claude3",
651
- "housamo/cthugha3",
652
- "housamo/cusith",
653
- "housamo/cusith3",
654
- "housamo/dagon",
655
- "housamo/dagon3",
656
- "housamo/ded",
657
- "housamo/ded1",
658
- "housamo/ded2",
659
- "housamo/ded3",
660
- "housamo/ded4",
661
- "housamo/duo",
662
- "housamo/durga",
663
- "housamo/durga3",
664
- "housamo/durga4",
665
- "housamo/ebisu",
666
- "housamo/ebisu3",
667
- "housamo/ebisunaki",
668
- "housamo/echo",
669
- "housamo/eita",
670
- "housamo/eita3",
671
- "housamo/ellie",
672
- "housamo/ellie3",
673
- "housamo/enigma",
674
- "housamo/fafnir",
675
- "housamo/fenrir",
676
- "housamo/fenrir3",
677
- "housamo/fumihito",
678
- "housamo/furufumi",
679
- "housamo/furufumi3",
680
- "housamo/fuxi",
681
- "housamo/fuxi3",
682
- "housamo/gabriel",
683
- "housamo/gabriel3",
684
- "housamo/gandharva",
685
- "housamo/garmr",
686
- "housamo/goemon",
687
- "housamo/gorozaemon",
688
- "housamo/goryou",
689
- "housamo/gouryou",
690
- "housamo/gouryou3",
691
- "housamo/gouryou4",
692
- "housamo/grimalkin",
693
- "housamo/gullinbursti",
694
- "housamo/gunzou",
695
- "housamo/gunzou3",
696
- "housamo/gurangatch",
697
- "housamo/gyoubu",
698
- "housamo/gyuumaou",
699
- "housamo/gyuumaou3",
700
- "housamo/gyuumaou4",
701
- "housamo/hakumen",
702
- "housamo/hakumen3",
703
- "housamo/hanuman",
704
- "housamo/hanuman3",
705
- "housamo/harlot",
706
- "housamo/harlot3",
707
- "housamo/hastur",
708
- "housamo/hekate",
709
- "housamo/hekate3",
710
- "housamo/hephaestus",
711
- "housamo/hephaestus2",
712
- "housamo/hephaestus3",
713
- "housamo/hephaestus4",
714
- "housamo/heracles",
715
- "housamo/heracles3",
716
- "housamo/hermes",
717
- "housamo/hombretigre",
718
- "housamo/hombretigre3",
719
- "housamo/horkeukamui",
720
- "housamo/horkeukamui3",
721
- "housamo/hotei",
722
- "housamo/hougen",
723
- "housamo/hougen3",
724
- "housamo/ibaraki01",
725
- "housamo/ibaraki1",
726
- "housamo/ibaraki2",
727
- "housamo/ibaraki3",
728
- "housamo/ibaraki4",
729
- "housamo/ifrit",
730
- "housamo/ifrit3",
731
- "housamo/ikutoshi1",
732
- "housamo/ikutoshi2",
733
- "housamo/ikutoshi3",
734
- "housamo/inaba",
735
- "housamo/isaac",
736
- "housamo/israfil",
737
- "housamo/itzamna",
738
- "housamo/itzamna3",
739
- "housamo/ixbalanque",
740
- "housamo/jacob",
741
- "housamo/jambavat",
742
- "housamo/jambavat3",
743
- "housamo/jinn",
744
- "housamo/jiraiya",
745
- "housamo/jiraiya3",
746
- "housamo/jiraiya4",
747
- "housamo/jormungandr",
748
- "housamo/joul",
749
- "housamo/juugo",
750
- "housamo/juugo3",
751
- "housamo/kagutsuchi",
752
- "housamo/kagutsuchi3",
753
- "housamo/kalki",
754
- "housamo/kalki3",
755
- "housamo/kengo",
756
- "housamo/kengo2",
757
- "housamo/kengo3",
758
- "housamo/kengo4",
759
- "housamo/kenta",
760
- "housamo/kenta3",
761
- "housamo/kijimuna",
762
- "housamo/kijimuna3",
763
- "housamo/kimunkamui",
764
- "housamo/kimunkamui2",
765
- "housamo/kirito",
766
- "housamo/korpokkur",
767
- "housamo/kotaro",
768
- "housamo/kotarou3",
769
- "housamo/krampus",
770
- "housamo/krampus3",
771
- "housamo/kresnik",
772
- "housamo/kresnik3",
773
- "housamo/kuniyoshi",
774
- "housamo/kuniyoshi3",
775
- "housamo/kurogane",
776
- "housamo/kurogane3",
777
- "housamo/kyuuma",
778
- "housamo/kyuuma3",
779
- "housamo/leib",
780
- "housamo/leib3",
781
- "housamo/licho",
782
- "housamo/licho3",
783
- "housamo/licho4",
784
- "housamo/licht",
785
- "housamo/licht3",
786
- "housamo/loki",
787
- "housamo/lucifuge",
788
- "housamo/macroich",
789
- "housamo/macroich3",
790
- "housamo/magan",
791
- "housamo/magan3",
792
- "housamo/magan4",
793
- "housamo/mahakala",
794
- "housamo/makara",
795
- "housamo/managarmr",
796
- "housamo/managarmr3",
797
- "housamo/marchosias",
798
- "housamo/marduk",
799
- "housamo/maria",
800
- "housamo/maria3",
801
- "housamo/masanori",
802
- "housamo/matoya",
803
- "housamo/melusine",
804
- "housamo/melusine3",
805
- "housamo/mephistopheles",
806
- "housamo/mineaki",
807
- "housamo/moritaka",
808
- "housamo/moritaka3",
809
- "housamo/moritaka4",
810
- "housamo/moritaka5",
811
- "housamo/motosumi",
812
- "housamo/motosumi3",
813
- "housamo/musashi",
814
- "housamo/nekros",
815
- "housamo/nekros2",
816
- "housamo/nobuharu",
817
- "housamo/nobuharu3",
818
- "housamo/nobumichi",
819
- "housamo/nodens",
820
- "housamo/nomad",
821
- "housamo/nomad3",
822
- "housamo/nomad4",
823
- "housamo/nomad5",
824
- "housamo/normad",
825
- "housamo/nyarlathotep",
826
- "housamo/oguchimagami",
827
- "housamo/oguchimagami2",
828
- "housamo/oniwaka",
829
- "housamo/oniwaka3",
830
- "housamo/ophion",
831
- "housamo/ophion1",
832
- "housamo/ophion2",
833
- "housamo/orgus",
834
- "housamo/oscar",
835
- "housamo/ose",
836
- "housamo/ose1",
837
- "housamo/ose2",
838
- "housamo/ose3",
839
- "housamo/ose4",
840
- "housamo/otohime",
841
- "housamo/oz",
842
- "housamo/oz2",
843
- "housamo/oz3",
844
- "housamo/oz4",
845
- "housamo/pazuzu",
846
- "housamo/perun",
847
- "housamo/player1",
848
- "housamo/player2",
849
- "housamo/player21",
850
- "housamo/player22",
851
- "housamo/player23",
852
- "housamo/player24",
853
- "housamo/player25",
854
- "housamo/player3",
855
- "housamo/player4",
856
- "housamo/player5",
857
- "housamo/pollux",
858
- "housamo/pollux3",
859
- "housamo/qursha",
860
- "housamo/rave",
861
- "housamo/riku",
862
- "housamo/robinson",
863
- "housamo/robinson3",
864
- "housamo/ryouta",
865
- "housamo/ryouta3",
866
- "housamo/ryouta4",
867
- "housamo/salomon",
868
- "housamo/sanatkumara",
869
- "housamo/sandayu",
870
- "housamo/sandayu3",
871
- "housamo/seth",
872
- "housamo/seth3",
873
- "housamo/seth4",
874
- "housamo/shennong",
875
- "housamo/shennong3",
876
- "housamo/shennong4",
877
- "housamo/shino",
878
- "housamo/shino3",
879
- "housamo/shinya",
880
- "housamo/shinya3",
881
- "housamo/shirou",
882
- "housamo/shirou3",
883
- "housamo/shirou4",
884
- "housamo/shiva",
885
- "housamo/shiva3",
886
- "housamo/shuten",
887
- "housamo/shuten3",
888
- "housamo/shuuichi",
889
- "housamo/simurgh",
890
- "housamo/sitri",
891
- "housamo/sitri3",
892
- "housamo/snow",
893
- "housamo/snow3",
894
- "housamo/sol",
895
- "housamo/surtr",
896
- "housamo/surtr3",
897
- "housamo/suzuka",
898
- "housamo/suzuka3",
899
- "housamo/tadatomo",
900
- "housamo/tadatomo3",
901
- "housamo/tadatomo4",
902
- "housamo/tadikarao",
903
- "housamo/tadikarao3",
904
- "housamo/taishakuten",
905
- "housamo/takemaru",
906
- "housamo/takemaru3",
907
- "housamo/takeminakata",
908
- "housamo/tangaroa",
909
- "housamo/tangaroa3",
910
- "housamo/tanngrisnir",
911
- "housamo/taromaiti",
912
- "housamo/taurus",
913
- "housamo/taurus3",
914
- "housamo/teda3",
915
- "housamo/temujin",
916
- "housamo/tetsugyuu",
917
- "housamo/tetsugyuu3",
918
- "housamo/tetsuya",
919
- "housamo/tetsuya3",
920
- "housamo/tezcatlipoca",
921
- "housamo/tezcatlipoca3",
922
- "housamo/tezcatlipoca4",
923
- "housamo/thehero",
924
- "housamo/thesmokygod",
925
- "housamo/thesmokygod3",
926
- "housamo/thunderbird",
927
- "housamo/thunderbird3",
928
- "housamo/tianzun",
929
- "housamo/tindalos",
930
- "housamo/tindalos3",
931
- "housamo/title",
932
- "housamo/tomte",
933
- "housamo/touji",
934
- "housamo/touji3",
935
- "housamo/touji4",
936
- "housamo/triton",
937
- "housamo/tritonshadow",
938
- "housamo/tsukuyomi",
939
- "housamo/tsukuyomi3",
940
- "housamo/tuaring",
941
- "housamo/tuatgua",
942
- "housamo/tuatgua3",
943
- "housamo/tvastar",
944
- "housamo/typhoeus",
945
- "housamo/typhon",
946
- "housamo/typhon3",
947
- "housamo/ulaanbaatar",
948
- "housamo/vapula",
949
- "housamo/volkh",
950
- "housamo/volos",
951
- "housamo/volos3",
952
- "housamo/wakantanka",
953
- "housamo/wakantanka3",
954
- "housamo/wakantanka4",
955
- "housamo/wakantankamugen",
956
- "housamo/wakantankamugen2",
957
- "housamo/xolotl",
958
- "housamo/yamanomusume",
959
- "housamo/yamasachihiko",
960
- "housamo/yamasachihiko3",
961
- "housamo/yasuyori",
962
- "housamo/yasuyori3",
963
- "housamo/yoritomo",
964
- "housamo/yoshito",
965
- "housamo/yuma",
966
- "housamo/zabaniya",
967
- "housamo/zabaniya3",
968
- "housamo/zaou",
969
- "housamo/zaou3",
970
- "housamo/zhurong3",
971
- "housamo/ziz",
972
- "housamo/ziz3",
973
- "KH/Aerith Gainsborough",
974
- "KH/Aladdin",
975
- "KH/Alice",
976
- "KH/Ansem",
977
- "KH/Ariel",
978
- "KH/Barrel",
979
- "KH/Captain Hook",
980
- "KH/Clayton",
981
- "KH/Cloud Strife",
982
- "KH/Daisy Duck",
983
- "KH/Donald Duck",
984
- "KH/Dr. Finkelstein",
985
- "KH/Flotsam",
986
- "KH/Flounder",
987
- "KH/Genie",
988
- "KH/Geppetto",
989
- "KH/Goofy Goof",
990
- "KH/Hades",
991
- "KH/Hercules",
992
- "KH/Iago",
993
- "KH/Jack Skellington",
994
- "KH/Jafar",
995
- "KH/Jane Porter",
996
- "KH/Jetsam",
997
- "KH/Jiminy Cricket",
998
- "KH/Kairi",
999
- "KH/KH Beast",
1000
- "KH/King Mickey Mouse",
1001
- "KH/King Triton",
1002
- "KH/Lock",
1003
- "KH/Maleficent",
1004
- "KH/Mayor of Halloween Town",
1005
- "KH/Oogie Boogie",
1006
- "KH/Piglet",
1007
- "KH/Pinocchio",
1008
- "KH/Princess Jasmine",
1009
- "KH/Queen Minnie Mouse",
1010
- "KH/Queen of Hearts",
1011
- "KH/Riku",
1012
- "KH/Sally",
1013
- "KH/Sebastian",
1014
- "KH/Selphie",
1015
- "KH/Shock",
1016
- "KH/Sora",
1017
- "KH/Sora's Mother",
1018
- "KH/Squall Leonhart",
1019
- "KH/Tarzan",
1020
- "KH/Terk",
1021
- "KH/Tidus",
1022
- "KH/Tigger",
1023
- "KH/Ursula",
1024
- "KH/Wakka",
1025
- "KH/Wendy Darling",
1026
- "KH/White Rabbit",
1027
- "KH/Winnie the Pooh",
1028
- "KH/Yuffie Kisaragi",
1029
- "P3/aigis",
1030
- "P3/akihiko",
1031
- "P3/chidori",
1032
- "P3/eiichiro",
1033
- "P3/elizabeth",
1034
- "P3/fuuka",
1035
- "P3/igor",
1036
- "P3/ikutski",
1037
- "P3/jin",
1038
- "P3/junpei",
1039
- "P3/ken",
1040
- "P3/mitsuru",
1041
- "P3/natsuki",
1042
- "P3/pharos",
1043
- "P3/ryuji",
1044
- "P3/shinji",
1045
- "P3/takaya",
1046
- "P3/takeharu",
1047
- "P3/toriumi",
1048
- "P3/yukari",
1049
- "P4/adachi",
1050
- "P4/chie",
1051
- "P4/chie-golden",
1052
- "P4/chihiro",
1053
- "P4/dojima",
1054
- "P4/grandma_rise",
1055
- "P4/hanako",
1056
- "P4/igor",
1057
- "P4/izanami",
1058
- "P4/kanji",
1059
- "P4/kashiwagi",
1060
- "P4/margaret",
1061
- "P4/mitsuo",
1062
- "P4/morooka",
1063
- "P4/namatame",
1064
- "P4/nanako",
1065
- "P4/naoto",
1066
- "P4/rise",
1067
- "P4/saki",
1068
- "P4/teddie",
1069
- "P4/woman",
1070
- "P4/yosuke",
1071
- "P4/yukiko",
1072
- "Portal/announcer",
1073
- "Portal/cave",
1074
- "Portal/glados",
1075
- "Portal/glados-2",
1076
- "Portal/wheatley",
1077
- "PPP/A. K. Yearling",
1078
- "PPP/Ahuizotl",
1079
- "PPP/Amethyst Star",
1080
- "PPP/Apple Bloom",
1081
- "PPP/Applejack",
1082
- "PPP/Babs Seed",
1083
- "PPP/Big Mac",
1084
- "PPP/Braeburn",
1085
- "PPP/Cadance",
1086
- "PPP/Celestia",
1087
- "PPP/Cheerilee",
1088
- "PPP/Chief Thunderhooves",
1089
- "PPP/Chrysalis",
1090
- "PPP/Cloud Chaser",
1091
- "PPP/Cranky",
1092
- "PPP/Daisy",
1093
- "PPP/Diamond Tiara",
1094
- "PPP/Discord",
1095
- "PPP/Donut Joe",
1096
- "PPP/Dr. Fauna",
1097
- "PPP/Fancy Pants",
1098
- "PPP/Filthy Rich",
1099
- "PPP/Flam",
1100
- "PPP/Flim",
1101
- "PPP/Flitter",
1102
- "PPP/Fluttershy",
1103
- "PPP/Garble",
1104
- "PPP/Gilda",
1105
- "PPP/Granny Smith",
1106
- "PPP/Gustave Le Grand",
1107
- "PPP/Hoity Toity",
1108
- "PPP/Iron Will",
1109
- "PPP/Jet Set ",
1110
- "PPP/Jet Set",
1111
- "PPP/Lightning Dust",
1112
- "PPP/Lily Valley",
1113
- "PPP/Little Strongheart",
1114
- "PPP/Luna",
1115
- "PPP/Lyra",
1116
- "PPP/Matilda",
1117
- "PPP/Mayor Mare",
1118
- "PPP/Minuette",
1119
- "PPP/Miss Harshwhinny",
1120
- "PPP/Mr. Cake",
1121
- "PPP/Mrs. Cake",
1122
- "PPP/Mrs.Cake",
1123
- "PPP/Mulia Mild",
1124
- "PPP/Multiple",
1125
- "PPP/Nightmare Moon",
1126
- "PPP/Photo Finish",
1127
- "PPP/Pinkie",
1128
- "PPP/Pipsqueak",
1129
- "PPP/Prince Blueblood",
1130
- "PPP/Rainbow",
1131
- "PPP/Rainbowshine",
1132
- "PPP/Rarity",
1133
- "PPP/Rose",
1134
- "PPP/Sapphire Shores",
1135
- "PPP/Scootaloo",
1136
- "PPP/Shining Armor",
1137
- "PPP/Silver Spoon",
1138
- "PPP/Snails",
1139
- "PPP/Snips",
1140
- "PPP/Soarin",
1141
- "PPP/Sombra",
1142
- "PPP/Spike",
1143
- "PPP/Spitfire",
1144
- "PPP/Steve",
1145
- "PPP/Sweetie Belle",
1146
- "PPP/Thunderlane",
1147
- "PPP/Trixie",
1148
- "PPP/Twilight",
1149
- "PPP/Twinkleshine",
1150
- "PPP/Twist",
1151
- "PPP/Upper Crust",
1152
- "PPP/Zecora",
1153
- "SA2/Amy",
1154
- "SA2/Eggman",
1155
- "SA2/Knuckles",
1156
- "SA2/Omochao",
1157
- "SA2/Rouge",
1158
- "SA2/Shadow",
1159
- "SA2/Sonic",
1160
- "SA2/Tails",
1161
- "Sam and Max/max",
1162
- "Sam and Max/sam",
1163
- "SH2/wav",
1164
- "Stanley Parable/narrator",
1165
- "System Shock/Alice Murdoch",
1166
- "System Shock/Anatoly Korenchkin",
1167
- "System Shock/Angela Loesser",
1168
- "System Shock/Bayliss",
1169
- "System Shock/Constance Sanger",
1170
- "System Shock/Croker",
1171
- "System Shock/Enrique Cortez",
1172
- "System Shock/Erin Bloome",
1173
- "System Shock/Frank Yang",
1174
- "System Shock/Grassi",
1175
- "System Shock/James Watts",
1176
- "System Shock/Janice Polito",
1177
- "System Shock/Juan Curtiz",
1178
- "System Shock/Malick",
1179
- "System Shock/Malone",
1180
- "System Shock/Marc Miller",
1181
- "System Shock/Marie Delacroix",
1182
- "System Shock/Martin",
1183
- "System Shock/McKay",
1184
- "System Shock/Melanie Bronson",
1185
- "System Shock/Myers",
1186
- "System Shock/Norris",
1187
- "System Shock/Prefontaine",
1188
- "System Shock/Rebecca Siddons",
1189
- "System Shock/Rosenberg",
1190
- "System Shock/SHODAN",
1191
- "System Shock/Taz Amanpour",
1192
- "System Shock/The Many",
1193
- "System Shock/Thomas Suarez",
1194
- "System Shock/Trainer",
1195
- "System Shock/Turnbull",
1196
- "System Shock/William Diego",
1197
- "System Shock/Wood",
1198
- "System Shock/Xerxes",
1199
- "System Shock/Yount",
1200
- "TF2/administrator",
1201
- "TF2/demoman",
1202
- "TF2/engineer",
1203
- "TF2/heavy",
1204
- "TF2/medic",
1205
- "TF2/pauling",
1206
- "TF2/scout",
1207
- "TF2/sniper",
1208
- "TF2/soldier",
1209
- "TF2/spy"
1210
- ]
1211
- validation: [
1212
- "Validation/1089",
1213
- "Validation/1188",
1214
- "Validation/121",
1215
- "Validation/1221",
1216
- "Validation/1284",
1217
- "Validation/1320",
1218
- "Validation/1580",
1219
- "Validation/1995",
1220
- "Validation/2300",
1221
- "Validation/237",
1222
- "Validation/260",
1223
- "Validation/2830",
1224
- "Validation/2961",
1225
- "Validation/3570",
1226
- "Validation/3575",
1227
- "Validation/3729",
1228
- "Validation/4077",
1229
- "Validation/4446",
1230
- "Validation/4507",
1231
- "Validation/4970",
1232
- "Validation/4992",
1233
- "Validation/5105",
1234
- "Validation/5142",
1235
- "Validation/5639",
1236
- "Validation/5683",
1237
- "Validation/61",
1238
- "Validation/672",
1239
- "Validation/6829",
1240
- "Validation/6930",
1241
- "Validation/7021",
1242
- "Validation/7127",
1243
- "Validation/7176",
1244
- "Validation/7729",
1245
- "Validation/8224",
1246
- "Validation/8230",
1247
- "Validation/8455",
1248
- "Validation/8463",
1249
- "Validation/8555",
1250
- "Validation/908",
1251
- ]
1252
- noise: [
1253
- "Other/Noise",
1254
- ]