主题
如果你在 Colab 中打开这个 Notebook,可能需要先安装 LlamaIndex 🦙。
%pip install llama-index-embeddings-openai1
!pip install llama-index1
import os
os.environ["OPENAI_API_KEY"] = "sk-..."1
2
3
2
3
from llama_index.embeddings.openai import OpenAIEmbedding
from llama_index.core import Settings
embed_model = OpenAIEmbedding(embed_batch_size=10)
Settings.embed_model = embed_model1
2
3
4
5
2
3
4
5
使用 OpenAI text-embedding-3-large 和 text-embedding-3-small
注意,你可能需要更新 openai 客户端:pip install -U openai
# get API key and create embeddings
from llama_index.embeddings.openai import OpenAIEmbedding
embed_model = OpenAIEmbedding(model="text-embedding-3-large")
embeddings = embed_model.get_text_embedding(
"Open AI new Embeddings models is great."
)1
2
3
4
5
6
7
8
2
3
4
5
6
7
8
print(embeddings[:5])1
[-0.011500772088766098, 0.02457442320883274, -0.01760469563305378, -0.017763426527380943, 0.029841400682926178]1
print(len(embeddings))1
30721
# get API key and create embeddings
from llama_index.embeddings.openai import OpenAIEmbedding
embed_model = OpenAIEmbedding(
model="text-embedding-3-small",
)
embeddings = embed_model.get_text_embedding(
"Open AI new Embeddings models is awesome."
)1
2
3
4
5
6
7
8
9
10
2
3
4
5
6
7
8
9
10
print(len(embeddings))1
15361
更改输出嵌入的维度
注意:请确保你使用的是最新的 OpenAI 客户端
# get API key and create embeddings
from llama_index.embeddings.openai import OpenAIEmbedding
embed_model = OpenAIEmbedding(
model="text-embedding-3-large",
dimensions=512,
)
embeddings = embed_model.get_text_embedding(
"Open AI new Embeddings models with different dimensions is awesome."
)
print(len(embeddings))1
2
3
4
5
6
7
8
9
10
11
12
2
3
4
5
6
7
8
9
10
11
12
5121