Class: LlamaDeuce

Llama2 LLM implementation

Implements

• LLM

Constructors

constructor

• new LlamaDeuce(init?)

Parameters

Name	Type
init?	Partial<LlamaDeuce>

Defined in

llm/LLM.ts:283

Properties

chatStrategy

• chatStrategy: DeuceChatStrategy

Defined in

llm/LLM.ts:277

---

maxTokens

• Optional maxTokens: number

Defined in

llm/LLM.ts:280

---

model

• model: "Llama-2-70b-chat-old" | "Llama-2-70b-chat-4bit" | "Llama-2-13b-chat" | "Llama-2-13b-chat-4bit" | "Llama-2-7b-chat" | "Llama-2-7b-chat-4bit"

Defined in

llm/LLM.ts:276

---

replicateSession

• replicateSession: ReplicateSession

Defined in

llm/LLM.ts:281

---

temperature

• temperature: number

Defined in

llm/LLM.ts:278

---

topP

• topP: number

Defined in

llm/LLM.ts:279

Methods

chat

▸ chat(messages, _parentEvent?): Promise<ChatResponse>

Get a chat response from the LLM

Parameters

Name	Type
messages	ChatMessage[]
_parentEvent?	Event

Returns

Promise<ChatResponse>

Implementation of

LLM.chat

Defined in

llm/LLM.ts:402

---

complete

▸ complete(prompt, parentEvent?): Promise<ChatResponse>

Get a prompt completion from the LLM

Parameters

Name	Type	Description
prompt	string	the prompt to complete
parentEvent?	Event	-

Returns

Promise<ChatResponse>

Implementation of

LLM.complete

Defined in

llm/LLM.ts:439

---

mapMessageTypeA16Z

▸ mapMessageTypeA16Z(messageType): string

Parameters

Name	Type
messageType	MessageType

Returns

string

Defined in

llm/LLM.ts:326

---

mapMessagesToPrompt

▸ mapMessagesToPrompt(messages): Object

Parameters

Name	Type
messages	ChatMessage[]

Returns

Object

Name	Type
prompt	string
systemPrompt	undefined | string

Defined in

llm/LLM.ts:298

---

mapMessagesToPromptA16Z

▸ mapMessagesToPromptA16Z(messages): Object

Parameters

Name	Type
messages	ChatMessage[]

Returns

Object

Name	Type
prompt	string
systemPrompt	undefined

Defined in

llm/LLM.ts:312

---

mapMessagesToPromptMeta

▸ mapMessagesToPromptMeta(messages, opts?): Object

Parameters

Name	Type
messages	ChatMessage[]
opts?	Object
opts.replicate4Bit?	boolean
opts.withBos?	boolean

Returns

Object

Name	Type
prompt	string
systemPrompt	undefined | string

Defined in

llm/LLM.ts:339