Model Card for Model ID
Trained with Ludwig.ai and Predibase!
Given a passage from a news report generates a headline.
Try it in LoRAX:
from lorax import Client
client = Client("http://<your_endpoint>")
content = "<your news story>"
prompt = f"""
The following passage is content from a news report. Please summarize this
passage in one sentence or less.
Passage: {content}
Summary:
"""
adapter_id = "tgaddair/mistral-7b-tldrnews-headlines-lora-r8"
resp = client.generate(prompt, max_new_tokens=64, adapter_id=adapter_id)
print(resp.generated_text)
Model Details
Model Description
Ludwig config (v0.9.3):
model_type: llm
input_features:
- name: prompt
type: text
preprocessing:
max_sequence_length: null
column: prompt
output_features:
- name: headline
type: text
preprocessing:
max_sequence_length: null
column: headline
prompt:
template: >-
The following passage is content from a news report. Please summarize this
passage in one sentence or less.
Passage: {content}
Summary:
preprocessing:
split:
type: fixed
column: split
global_max_sequence_length: 2048
adapter:
type: lora
generation:
max_new_tokens: 64
trainer:
type: finetune
epochs: 3
optimizer:
type: paged_adam
batch_size: 1
eval_steps: 100
learning_rate: 0.0002
eval_batch_size: 2
steps_per_checkpoint: 1000
learning_rate_scheduler:
decay: cosine
warmup_fraction: 0.03
gradient_accumulation_steps: 16
enable_gradient_checkpointing: true
base_model: mistralai/Mistral-7B-v0.1
quantization:
bits: 4
- Downloads last month
- 1,147
Model tree for tgaddair/mistral-7b-tldrnews-headlines-lora-r8
Base model
mistralai/Mistral-7B-v0.1
Adapter
this model