Pulsejet has 7 types of indexes. These indexes has different characteristics and optimizations based on different input.

We are working on custom index implementation and it will become Pulsejet’s de-facto index implementation.

​
Index Types

  1. FlatL2 - Flat Index with L2 distance calculation
    • It is exact search with L2 (Euclidean Distance).
  2. FlatIP - Flat Index with Cosine Similarity (Inner Product) distance
    • It is exact search with Inner Product
  3. HNSW - Hierarchical Navigable Small Worlds
  4. IVFFlat - Inverted File Index - Flat
  5. IVFScalar - Inverted File Index - Scalar
  6. IVFPQ - Inverted File Index - Product Quantized
  7. OPQPQ - Optimized PQ chained with Flat Product Quantization

​
How to select my index type?

Below you can find how to select which index and their general starting requirements.

Whatever your selection will be (unless you don’t disable optimizer) your indexes will optimized to better indexes through time by Pulsejet (with given constraints.)

Learn more about Optimizer Structure.

First, you can use FlatL2 index at collection creation with:

{

    "name": "sift1m",

    "vector_config": {

        "size": 128,

        "index_type": "FlatL2",

        "on_disk": true

    },

    "optimizer_config": {}

}

☝️ Welcome to the content that you can only see inside the first Tab.

Was this page helpful?

Suggest editsRaise issue