Skip to main content
Welcome back. In this lesson we’ll demystify a term that sounds fancy but is actually straightforward: vectors. If you’re creating search, recommendation, or generative AI systems, understanding vectors and embeddings is essential.

What is a vector?

A vector is a numeric list (an array) that encodes descriptive attributes about an item so a computer can process and compare meaning. Think of describing a friend to someone who has never met them: “tall, funny, loves coffee, speaks quickly.” A vector does the same for data — it turns characteristics into numbers.
  • Words, images, audio, and video can all be converted into arrays of numbers.
  • Each array (vector) is a sequence of numeric values (usually floating-point) that capture features or semantics of the original item.
  • As you encode more attributes, the vector’s dimensionality increases.
Example (conceptual):
vector = [0.12, -0.03, 0.99, ...]
In short: a vector is a list of real numbers (positive or negative) where each position corresponds to a feature or coordinate in a multidimensional space. Those coordinates together represent the item’s meaning.

The embedding process

Turning text, images, or audio into vectors is called embedding. Embeddings are produced by models that map inputs into a numeric space where similar items are positioned near each other. When you embed many items (millions or billions), each becomes a point in this high-dimensional space, enabling similarity-based retrieval.
The image illustrates the concept of vectors placing data in multi-dimensional space to show that similar items are close together, allowing for searches by meaning rather than exact words. It includes diagrams of colorful circles, animal outlines, and a vector database icon.

Why proximity matters

Imagine storing one vector per animal in a vector database. Animals that share attributes (for example, “can fly”) cluster together because their embeddings are similar. That makes it possible to ask semantic questions like:
  • “Give me a bird that cannot fly” — even if the term “penguin” never appears in the query, the database can surface relevant matches based on geometric closeness in vector space.
A short analogy: latitude and longitude pinpoint physical location in 2D. Embeddings pinpoint meaning in many more dimensions.

How vector search works (brief)

  • Index: embeddings are stored and indexed (often with techniques like approximate nearest neighbor search) to enable fast similarity queries.
  • Query embedding: a query (text, image, etc.) is embedded into the same vector space.
  • Nearest neighbors: the system finds vectors closest to the query embedding using a distance metric (e.g., cosine similarity, Euclidean distance).
  • Return ranked results: items most semantically similar to the query are returned.

Common vector use cases

Use CaseDescriptionExample
Semantic searchFind results by meaning rather than keywordsSearch documents for conceptually similar passages
RecommendationsSuggest similar items based on user/item embeddingsRecommend products or songs
Clustering & categorizationGroup similar items automaticallyOrganize image collections by visual similarity
Retrieval for LLMsProvide context to language modelsRetrieve relevant documents for summarization or question answering

Examples of embeddable data types

Data TypeWhy embed it?Typical application
TextCaptures semantics and contextDocument search, Q&A
ImagesEncodes visual featuresImage search, reverse image lookup
AudioEncodes timbre, speech featuresSpeaker detection, audio retrieval
VideoCombines visual & temporal featuresVideo recommendation, scene search

Key points

  • A vector is a numeric representation (array) encoding features or semantics.
  • Dimensionality increases as you encode more attributes.
  • Embeddings place similar items near each other in high-dimensional space.
  • Vector search finds items by semantic similarity (nearest neighbors), not only keyword matches.
Embedding = converting data (text, images, audio) into numeric vectors so that semantic similarity corresponds to geometric proximity in vector space.

Further reading & references

That’s the core idea: vectors are numbers that carry meaning. This lesson covered what vectors are, how embeddings are created, and why vector proximity enables semantic search and retrieval. Thanks for reading.

Watch Video