haz / PREWL

Prompt Engineering Wrapper for LLMs (PREWL)

PREWL

Prompt Engineering Wrapper for LLMs (PREWL): A library for rapidly prototyping LLM-based applications via prompt engineering for NLU.

Usage

import prewl, json

#-----------------------------------------#

# Optionally use a config.json
# prewl.configure("config.json")

# Dynamically detect if the argument is json or a file with json
prewl.configure({
    # 'backend': {
    #     'service'   : 'gpt3', # gpt2, 6b, ...
    #     'token'     : '12345', # whatever is required for authentication
    # },
    'backend': {'service': 'manual'},
    'repeat-limit': 10, # if making repeated requests, no more than 10
    'newline-delimited': True, # Should a new line indicate the end of the completion
    'classes': ['positive', 'negative', 'neutral'], # defaults to None
    'max_length': 100,
})

#-----------------------------------------#

PROMPTS = """
[
    {
        "text": "I really don't like this movie.",
        "sentiment": "negative"
    },

    {
        "text": "This flick was sick!",
        "sentiment": "positive"
    },

    {
        "text": "It was ok. I've seen better, though.",
        "sentiment": "neutral"
    }
]
"""

examples = json.loads(PROMPTS)

PATTERN = """
Text: {text}
Sentiment: {sentiment}
"""

# Prompts objects
prompts = prewl.load_prompts(PATTERN, examples, 'sentiment')


#-----------------------------------------#

# Creates a function that when called will
#  (1) prompt the server
#  (2) fetch the response
#  (3) returns the parsed result
model = prewl.train(prompts) # Model object

# Optionally use a custom method
def check_for_positive(resp):
    return "positive" in resp
model = prewl.train(prompts, check_for_positive)

new_input = "This movie was off the hook!"
resp = model.infer(new_input)

print("\n New input: ", new_input)
print("Prediction: ", resp)
print()

Installing

For now, you can install the package locally by running the following from the top-level of the project (sudo may be required):

pip3 install -e .

Contributing

Coming soon...

Requirements

Coming soon...

Citing This Work

Coming soon...