Divante VueStorefrontIndexer Extension for Magento2

This projects is a native, Magento2 data indexer for Vue Storefront - first Progressive Web App for e-Commerce. It fills the ElasticSearch data index with all the products, categories and static information required by Vue Storefront to work.

Note on mage2vuestorefront project: This native indexer updates the ElasticSearch index in the very same format like the mage2vuestorefront. Our intention was to speed up the indexation process and make it more reliable. With native indexer we were able to use the Magento2 ORM and events to optimize the indexation process. Please do use this module instead of mage2vuestorefront if You experience any issues regarding indexing performance. Both projects are currently supported.

Vue Storefront is a standalone PWA storefront for your eCommerce, possible to connect with any eCommerce backend (eg. Magento, Pimcore, Prestashop or Shopware) through the API.

Video demo

Overview

Version 1.5.0/1.5.1 - support for aliases.

Command php bin/magento vsbridge:reindex --all will reindex all data to new index. It will create new index and update aliases at the end.

If you used previous versions, you will have to delete index (created with this extension) from ES manually: If you won't do that, you will get error when running "error":{"root_cause":[{"type":"invalid_alias_name_exception","reason":"Invalid alias name [vue_storefront_magento_1], an index exists with the same name as the alias"

Installation/Getting Started

Install with composer

composer config repositories.divante vcs https://github.com/DivanteLtd/magento2-vsbridge-indexer
composer require divante/magento2-vsbridge-indexer

php bin/magento setup:upgrade

Installation/Getting Started - MSI support

Install second module which will support MSI

composer require divante/magento2-vsbridge-indexer-msi:0.1.0

Not fully supported, few fields are exported to ES. From inventory indexer: -- qty => qty, -- is_salable => is_in_stock/stock_status

Example

Website 1

{
    "sku": "24-MB01",
    "stock": {
      "qty": 100,
      "is_in_stock": false,
      "stock_status": 0
    }
}

Website 2

{
    "sku": "24-MB01",
    "stock": {
      "qty": 73,
      "is_in_stock": true,
      "stock_status": 1
    }
}

php bin/magento setup:upgrade

Magento Configuration

Configure the module in Magento panel and run full indexation.

Check configuration here

Update VSF/VSF-API configuration

Important: It is crucial to update configuration elasticsearch.index in the VSF and elasticsearch.indices in VSF-API

Index Alias Prefix → define prefixes for ElasticSearch indexes. The panel allows adding prefix only to the catalog name e.g.: vue_storefront_catalog. For each store (store view) index name is generated on the base of defined prefix and either ID or Store Code. Aliases cannot be created.
Example: When we define following indexes: vue_storefront_catalog_1, vue_storefront_catalog_2, "vue_storefront_catalog_3".

Index Identifier → defines the unique store identifier to append to the ElasticSearch indexes. The default value is ID which will append the Store ID to the index name e.g.: vue_storefront_catalog_1. You can choose to change this to Store Code which will add the Store Code to the index name e.g.: vue_storefront_catalog_storecode.

Example with Store ID

VSF config (base on default index prefix name: vue_storefront_magento)

"vue_storefront_magento_1" - index for store view with id 1

"elasticsearch": {
  "httpAuth": "",
  "host": "localhost:8080/api/catalog",
  "index": "vue_storefront_magento_1" 
}

VSF-API config

  "elasticsearch": {
    "host": "localhost",
    "port": 9200,
    "user": "elastic",
    "password": "changeme",
    "indices": [
      "vue_storefront_magento_1" 
    ],

Example with Store Code

VSF config (base on default index prefix name: vue_storefront_magento)

"vue_storefront_magento_en_us" - index for store view with code "en_us"

"elasticsearch": {
    "httpAuth": "",
    "host": "localhost:8080/api/catalog",
    "index": "vue_storefront_magento_en_us" 
}

VSF-API config

  "elasticsearch": {
    "host": "localhost",
    "port": 9200,
    "user": "elastic",
    "password": "changeme",
    "indices": [
      "vue_storefront_magento_en_us"
    ],
}

Running the full indexation:

There are two options to run full indexations

Indexation of new indexes.

In general, this indexation can be run in any order. It is worth, to begin with taxrule as it is the fastest.

php bin/magento indexer:reindex vsbridge_taxrule_indexer
php bin/magento indexer:reindex vsbridge_attribute_indexer
php bin/magento indexer:reindex vsbridge_product_indexer
php bin/magento indexer:reindex vsbridge_category_indexer
php bin/magento indexer:reindex vsbridge_cms_block_indexer
php bin/magento indexer:reindex vsbridge_cms_page_indexer
php bin/magento indexer:reindex vsbridge_review_indexer

Reindexation of all indexes

Recommended for smaller databases. In the case of big databases it is better to run commands manually.

php bin/magento indexer:reindex

php bin/magento vsbridge:reindex --store=[STORE ID|STORE CODE]
php bin/magento vsbridge:reindex --store=1

Note: If a docker with ElasticSearch is disabled, Indexer will display error: "No alive nodes found in your cluster".

Update on Save Mode

Update on Save mode works for the following operations:

save/delete the product
save/delete the category
save/delete the static block
save/delete the static page
save/delete the attribute (deleting the attribute causes displaying “invalid” status for vsbridge products indexer).
save/delete the review

Update on Schedule Mode

Update on Schedule mode observes changes in corresponding tables, and probably will be more relevant in most cases. It is the default mode in any bigger stores.

Compatibility

-- Vue Storefront >= 1.4.4 Module was tested on: -- Magento Community version 2.2.7. It should perform without any issues on Magento 2.2.* and above versions.

-- Magento Commerce version 2.3.0. The bridge indexer cannot be installed on lower versions of Magento Enterprise.

-- You can install module on Magento 2.3.* Commerce, but you still need ES 5.* to export data. Module will work with library elasticsearch/elastichserach (5.*, 6.*)

TODO

add a limitation of the categories sent to ElasticSearch, by adding new configurations: send only categories visible in the menu, send only active categories @Agata
add a new command allowing to enable/disable following indexes: CMS Block, CMS Page.
add an option to exclude the default Magento indexes (which do not impact new indexes operations)
split catalog module to smaller modules
remove "vsbridge_product_category" all together and run partial update in ES in different way

Kidl / magento2-vsbridge-indexer