Skip to main content

elasticsearch script field

I often need to compute some fields of a Elasticsearch record and make it part of the result.

For example, I have this document:

{
  "fields": {
    "connected": [true],
    "incall": [false],
    "timestamp": ["2021-09-02T10:35:06.000Z"]
  }
}

And I want to have a field named "lack_of_optimization" which is 1 when "connected" is "true" AND "incall" is "false"
See this from the point of view of a callcenter manager: when the callcenter agent is "connected" but not in call, it can be rated as a lack of optimization

In other words:

if( connected && incall)
  lack_of_optimization = 0
else
  lack_of_optimization = 1

To achieve this, we need to write a script that will compute the value of the fields "connected" and "incall" then return a 0 or a 1 depending on the result. HEre is the query:

{
  "size": 750, 
  "sort":[
    {
      "timestamp":{
        "order":"desc",
        "unmapped_type":"boolean"
      }
    }
  ],
  "fields": [
    {"field": "incall"},
    {"field": "connected"}
  ],
  "script_fields":{
    "lack_of_optimization":{
      "script":{
        "source":"""
           if (doc['connected'].value == true && doc['incall'].value == true) 
           { 
             0; 
           } else { 
             1; 
           }
        """
      }
    }
  },
  "_source":false,
  "query":{
    "bool":{
      "must":[],
      "filter":[
        {"match_all":{}},
        {
          "range":{
            "timestamp":{
              "gte":"2021-08-15T00:30:00+0300",
              "lte":"2021-08-15T01:00:00+0300",
              "format":"strict_date_optional_time"
            }
          }
        },
        {"match_phrase":{"connected":true}}
      ],
      "should":[],
      "must_not":[]
    }
  }
}
	

The needed script is the value of the "source"

  "script_fields":{
    "animation_value":{
      "script":{
        "source":"""
           if (doc['connected'].value == true && doc['incall'].value == true) 
           { 
             0; 
           } else { 
             1; 
           }
        """
      }
    }
	

In the Elasticsearch documentation, it is refered as a "script field", written in the "Painless language"

The final document will then include the computed field:

    {
        "fields" : {
          "connected" : [
            true
          ],
          "incall" : [
            false
          ],
          "lack_of_optimization" : [
            1
          ]
        }
      }	



Popular posts from this blog

npm run build base-href

Using NPM to specify base-href When building an Angular application, people usually use "ng" and pass arguments to that invocation. Typically, when wanting to hard code "base-href" in "index.html", one will issue: ng build --base-href='https://ngx.rktmb.org/foo' I used to build my angular apps through Bamboo or Jenkins and they have a "npm" plugin. I got the habit to build the application with "npm run build" before deploying it. But the development team once asked me to set the "--base-href='https://ngx.rktmb.org/foo'" parameter. npm run build --base-href='https://ngx.rktmb.org/foo did not set the base href in indext.html After looking for a while, I found https://github.com/angular/angular-cli/issues/13560 where it says: You need to use −− to pass arguments to npm scripts. This did the job! The command to issue is then: npm run build -- --base-href='https://ngx.rktmb.org/foo&

Jenkins invalid privatekey

Publish over SSH, Message "invalid privatekey:" With quite recent (June-July 2020) installations of Jenkins and OpenSSH, I have the following error message when using the "Deploy overs SSH" Jenkins plug-in and publishing artifacts to the target overs SSH: jenkins.plugins.publish_over.BapPublisherException: Failed to add SSH key. Message [invalid privatekey: [B@d8d395a] This problem seems to be referenced here: https://issues.jenkins-ci.org/browse/JENKINS-57495 Just regenerate a key with the right parameters To solve it: ssh-keygen -t rsa -b 4096 Or ssh-keygen -t rsa -b 4096 -m PEM

AzureCLI Custom Python

Installing Azure CLI on Archlinux When trying to install Azure CLI on Archlinux, I follow the documentation, in the "script" tab , and it leads to the following errors: [mihamina@arch-00 ~]$ curl -L https://aka.ms/InstallAzureCli | bash [...] Running install script. -- Verifying Python version. -- Python version 3.11.3 okay. [...] -- Executing: ['/usr/bin/python3', 'virtualenv.py', '--python', '/usr/bin/python3', '/home/mihamina/lib/azure-cli'] /tmp/tmpn0w4l6w9/virtualenv-16.7.11/virtualenv.py:24: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives import distutils.spawn /tmp/tmpn0w4l6w9/virtualenv-16.7.11/virtualenv.py:25: DeprecationWarning: The distutils.sysconfig module is deprecated, use sysconfig instead import distutils.sysconfig Already using interpreter /u