Instruct Models

Based on our base models from the Jurassic-2 series, Jurassic-2 Instruct were trained specifically to handle instructions-only prompts ("zero-shot") without examples ("few-shot"). It is the most natural way to interact with large language models, and it is the best way to get a sense of the optimal output for your task without any examples.

Below is an example of the difference between Jurassic-2 Instruct and Jurassic-2 Mid to a zero-shot prompt. Jurassic-2 Mid, our base model, starts with a relevant answer but doesn't stop in time (since it wasn't trained specifically to follow instructions).

prompt:
Write a tweet about the future of NLP:

completion:
We want to know what you think NLP will be like in 10 years.
Send a tweet to @iNLP Center or @iNLPTech with the hashtag #NLPFuture: Tell us what NLP will be like in 10 years.
Tag one friend to do the same: The person you tag will be entered into a drawing to win a free gift.
1. Tweet: 10 years from now, what will NLP be like?
2. Tag a friend: The person you tag will be entered into a drawing to win a free gift.
3. Tweet: I tagged @JohnSmith.
4. Tag another friend: The person you tag will be entered into a drawing to win a free gift.
5. Tweet: I tagged @JaneDoe.

While Jurassic-2 Instruct provides a better answer for the instruction provided:

prompt:
Write a tweet about the future of NLP:

completion:
The future of NLP is bright. Using NLP, we can train machines to understand language, reason about knowledge, and interact with humans naturally. #END

The following are some best practices for using our Instruct models, as well as examples that show their capabilities.

Best practices

Make sure your prompt ends clearly

It's important to make sure the instruction ends in a clear way, whether with a punctuation mark (such as ".", ":", "?" or a newline) or through clear wording.

In this case, the prompt ended mid-sentence. As a result, the model completed the instruction itself instead of providing an appropriate response.

prompt:
generate a weather forecast including the following details:
1. the high temperatures will reach 25C
2. the winds will be 100 knots NW

completion:
3. the weather will be cloudy

The same prompt is given here, with the following addition at the end to ensure the model understands the instruction:

prompt:
generate a weather forecast including the following details:
1. the high temperatures will reach 25C
2. the winds will be 100 knots NW
make it in a formal tone:

completion:
The weather forecast for Thursday, April 7, calls for high temperature reaching 25C, with a wind speed of 100 knots.

Specify your style

Would you like your completions written in a particular style? All you have to do is ask. As an example, here is the same prompt from before, but with the request to write like a pirate.

prompt:
generate a weather forecast including the following details:
1. the high temperatures will reach 25C
2. the winds will be 100 knots NW
make it in a style of a pirate:

completion:
Ahoy! Batten down the hatches! High winds are ahead! High temperatures will reach 25C, and winds will reach 100 knots from the NW.

Choose your format

You may get results in different formats if you write a general instruction. For example, the model can list things numbered or separated by dots.

prompt:
list 3 active NBA players, include their team and their total career points.

completion:
1. LeBron James - Los Angeles Lakers - 35,000+ points
2. Stephen Curry - Golden State Warriors - 20,000+ points
3. Kevin Durant - Brooklyn Nets - 23,000+ points
prompt:
list 3 active NBA players, include their team and their total career points.

completion:
Stephen Curry, Golden State Warriors: 18,064 points. James Harden, Houston Rockets: 20,143 point. LeBron James, Los Angeles Lakers: 32,364 points.

You can ask specifically for a bullet list:

prompt:
list 3 active NBA players, include their team and their total career points. Do it in a bullet list.

completion:
- LeBron James - Los Angeles Lakers - 35,000+ points
- Stephen Curry - Golden State Warriors - 20,000+ points
- Kevin Durant - Brooklyn Nets - 23,000+ points

Or a JSON format:

prompt:
list 3 active NBA players, include their team and their total career points. Do it in a JSON format.

completion:
{"players": [
    {"name": "LeBron James", "team": "Cleveland Cavaliers", "totalPoints": "25,614"},
    {"name": "Stephen Curry", "team": "Golden State Warriors", "totalPoints": "18,662"},
    {"name": "Kevin Durant", "team": "Golden State Warriors", "totalPoints": "18,897"}
]}

Specify the desired length in your instruction

If you use different adjectival descriptions for length, you will see different results. For example, here is a brief history:

prompt:
Write a brief history about the war between Pokemons and Digimons.

completion:
The war between Pokemons and Digimons was fought between the two most powerful species in the Digital World. The Pokemons were led by their king, Ash Ketchum, while the Digimons were led by their king, Agumon. The war lasted for many weeks, with neither side being able to gain the upper hand. Eventually, Ash was able to defeat Agumon and bring peace to the Digital World.

In oppose to a long history:

prompt:
Write a long history about the war between Pokemons and Digimons.

completion:
Pokemons and Digimons have always been rivals. They compete for territory, food, and other resources. The Pokemons are considered more powerful, but the Digimons are more intelligent.
The war between Pokemons and Digimons began thousands of years ago. The Pokemons were living on the island of Johto, and the Digimons were living on the island of Digiworld. The Pokemons wanted to expand their territory, so they invaded Digiworld. The Digimons fought back, but they were no match for the Pokemons.
The Pokemons eventually won, and they took control of Digiworld. The Digimons were forced to leave their homes, and they were forced to live in hiding.
The war between Pokemons and Digimons continued for centuries. The Pokemons kept expanding their territory, and the Digimons kept trying to fight back. However, the Pokemons were always victorious.
In modern times, the war has mostly stopped. The Pokemons and the Digimons have come to an agreement to live in peace. However, there are still some tensions between them.
The war between Pokemons and Digimons has been one of the most important conflicts in human history. It has led to the development of new technologies, and it has shaped the world we live in today.

Note: adjusting the length through an instruction is not always successful.

Examples

A few good prompt examples for inspiration are provided below.

Below is an example of a news release with a specific tone:

prompt:
Write a news release in the voice of a global banking conglomerate announcing an unprecedented building campaign to expand and rebuild their corporate headquarters in Alpha Centauri.

completion:
Alpha Centauri, our home for countless generations, is in trouble. After years of neglect, the banking conglomerate that owns it has been forced into a massive rebuilding campaign.

Our headquarters, which once served as a beacon of hope to the many worlds in our galaxy, is now little more than a crumbling ruin. If we are going to save Alpha Centauri, we must act quickly.

That is why, for the first time since its foundation, the banking conglomerate is undertaking a building campaign. We are expanding and rebuilding our corporate headquarters, and doing so using the most advanced technologies at our disposal.

A summary extraction from a chat conversation with a customer:

prompt:
Following is a transcript of a conversation between a customer and our agent.
"""
Customer: Hi, I would like to know about your sneakers
Agent: Hi, I'm Mary, Shoe-La-La's online customer representative! What would you like to know about our sneakers?
Customer: Do you have them in red?
Agent: Unfortunately we don't have red shoes in stock right now, we only have them in White, Black and Green. Let me check if I can order those for you. Which model and size are you interested in?
Customer: Red All-stars, size 37.
Agent: Great! I'll check if we can get those for you and we'll get back to you.
"""
What was the specific reason the customer needed help?

completion:
To ask about the availability of red sneakers

Summary of long text into bullets:

prompt:
Below is some text:
Meet Carbon Maps, a new French startup that raised $4.3 million (€4 million) just a few weeks after its inception. The company is building a software-as-a-service platform for the food industry so that they can track the environmental impact of each of their products in their lineup. The platform can be used as a basis for eco ratings.

While there are quite a few carbon accounting startups like Greenly, Sweep, Persefoni and Watershed, Carbon Maps isn’t an exact competitor as it doesn’t calculate a company’s carbon emissions as a whole. It doesn’t focus on carbon emissions exclusively either. Carbon Maps focuses on the food industry and evaluates the environmental impact of products — not companies.

Co-founded by Patrick Asdaghi, Jérémie Wainstain and Estelle Huynh, the company managed to raise a seed round with Breega and Samaipata — these two VC firms already invested in Asdaghi’s previous startup, FoodChéri.


FoodChéri is a full-stack food delivery company that designs its own meals and sells them directly to end customers with an important focus on healthy food. It also operates Seazon, a sister company for batch deliveries. The startup was acquired by Sodexo a few years ago.

“On the day that I left, I started working on food and health projects again,” Asdaghi told me. “I wanted to make an impact, so I started moving up the supply chain and looking at agriculture.”

And the good news is that Asdaghi isn’t the only one looking at the supply chain of the food industry. In France, some companies started working on an eco-score with a public agency (ADEME) overseeing the project. It’s a life cycle assessment that leads to a letter rating from A to E.

While very few brands put these letters on their labels, chances are companies that have good ratings will use the eco-score as a selling point in the coming years.


But these ratings could become even more widespread as regulation is still evolving. The European Union is even working on a standard — the Product Environmental Footprint (PEF). European countries can then create their own scoring systems based on these European criteria, meaning that food companies will need good data on their supply chains.


“The key element in the new eco-score that’s coming up is that there will be some differences within a product category because ingredients and farming methods are different,” Asdaghi said. “It’s going to take into consideration the carbon impact, but also biodiversity, water consumption and animal welfare.”

For instance, when you look at ground beef, it’s extremely important to know whether farmers are using soy from Brazil or grass to feed cattle.

“We don’t want to create the ratings. We want to create the tools that help with calculations — a sort of SAP,” Asdaghi said.

So far, Carbon Maps is working with two companies on pilot programs as it’s going to require a ton of work to cover each vertical in the food industry. The startup creates models with as many criteria as possible to calculate the impact of each criteria. It uses data from standardized sources like GHG Protocol, IPCC, ISO 14040 and 14044.


The company targets food brands because they design the recipes and select their suppliers. Eventually, Carbon Maps hopes that everybody across the supply chain is going to use its platform in one way or another.

“You can’t have a true climate strategy if you don’t have some collaboration across the chain,” Asdaghi said.

##

Summarize the above text in 5 bullets.

completion:
- Carbon Maps is a startup that raised $4.3 million (€4 million) just a few weeks after its inception.
- The company is building a software-as-a-service platform for the food industry so that they can track the environmental impact of each of their products in their lineup.
- The platform can be used as a basis for eco ratings.
- While there are quite a few carbon accounting startups like Greenly, Sweep, Persefoni and Watershed, Carbon Maps isn't an exact competitor as it doesn't calculate a company's carbon emissions as a whole.
- Carbon Maps focuses on the food industry and evaluates the environmental impact of products — not companies.

Notes

We will keep improving our models as we collect feedback, and in particular refine our instruction-tuned models in the coming weeks and months. Stay tuned for updates!